00010000:00080000:2.2F:1787818495.673464:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00080000:3.2F:1787818623.673375:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00000100:00100000:1.0:1787826018.423662:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042894592 00000100:00100000:1.0:1787826018.423694:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042894592 00000100:00100000:1.0:1787826018.423780:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 587 00000100:00100000:1.0:1787826018.423791:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155274:x1874663042894592:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826018.423818:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826018.423845:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00ceaed7 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eac5 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.423934:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00ceaede lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.423949:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481ce3800/0x878a5eea00ceaea6 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceae9f expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.423959:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00ceaede lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x20:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.424003:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481ce3800/0x878a5eea00ceaea6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceae9f expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826018.424030:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049132544:0@lo:104: 00000100:00100000:1.0:1787826018.424115:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826018.424179:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826018.424887:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049132544:0@lo:104: 00010000:00010000:1.0:1787826018.424923:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00ceaede lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x20:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826018.430634:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869775 is committed 00010000:00010000:1.0:1787826018.431082:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00ceaede lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.431096:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00ceaede lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826018.431171:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x20:0x0]: returning size 4096 00000004:00200000:1.0:1787826018.431178:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826018.431235:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00ceaed7 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eac5 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.431254:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00ceaede lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eac5 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.431261:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x20:0x0].0x0 (ffff8eb452580600) 00010000:00010000:1.0:1787826018.431265:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826018.431267:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511400, rc 0) 00000100:00100000:1.0:1787826018.433861:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155274:x1874663042894592:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 10054us (14304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.433877:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 587 00000100:00100000:1.0:1787826018.443774:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.461177:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.470018:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.470791:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049133184 00000100:00100000:1.0:1787826018.470797:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049133184 00000100:00100000:1.0:1787826018.470842:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4698 00000100:00100000:1.0:1787826018.470850:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6476:x1874663049133184:12345-0@lo:105: 00010000:00010000:1.0:1787826018.470863:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.470881:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.470891:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.470900:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.470908:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.470928:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.470945:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb481ce2600) 00000100:00100000:1.0:1787826018.471106:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6476:x1874663049133184:12345-0@lo:105: Request processed in 256us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.471114:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4698 00000100:00100000:1.0:1787826018.487680:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a5db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049133312:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1787826018.490870:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].405, 656 off625400 00000040:00080000:1.0:1787826018.491119:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].276, 736 off461840 00000004:00080000:1.0:1787826018.491125:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925ecc0 with version 594 00000100:00100000:1.0:1787826018.494056:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049133568:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787826018.494733:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826018.494741:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.494748:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2600 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826018.494753:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826018.494761:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.494809:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.494816:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826018.494846:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.494853:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2600/0x878a5eea00ceaf01 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceaf08 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.494874:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826018.494876:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826018.494878:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826018.497007:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049133696 00000100:00100000:1.0:1787826018.497024:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049133696 00000100:00100000:1.0:1787826018.497428:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4172 00000100:00100000:1.0:1787826018.497440:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb449164050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3619:x1874663049133696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826018.497461:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826018.497494:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462be00/0x878a5eea00ceaf08 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceaf01 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.497515:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x20:0x0].0x0 (ffff8eb452580600) 00010000:00010000:1.0:1787826018.497529:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826018.497681:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb449164050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049133696:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.497689:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4172 00000100:00100000:1.0:1787826018.512824:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.562549:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042895872 00000100:00100000:1.0:1787826018.562555:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042895872 00000100:00100000:1.0:1787826018.562621:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042895744 00000100:00100000:1.0:1787826018.562625:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042895744 00000100:00100000:1.0:1787826018.562651:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6900 00000100:00100000:1.0:1787826018.562660:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042895872:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826018.562708:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042895872:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 50us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.562716:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6900 00000100:00100000:1.0:1787826018.562734:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6901 00000100:00100000:1.0:1787826018.562741:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042895744:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826018.562767:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042895744:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.562786:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6901 00000100:00100000:1.0:1787826018.563058:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000004:00080000:1.0:1787826018.565114:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 595 rpc_version 595 00000020:00100000:1.0:1787826018.565253:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826018.565267:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c140000 x1874663049133952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826018.565300:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049133952:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826018.565417:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826018.565471:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826018.573238:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049133952:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826018.618423:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.624971:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.629472:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042896512 00000100:00100000:1.0:1787826018.629481:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042896512 00000100:00100000:1.0:1787826018.629549:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 595 00000100:00100000:1.0:1787826018.629559:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155306:x1874663042896512:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826018.629579:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826018.629602:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00ceaf9b lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eaef expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.629663:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00ceafa2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.629690:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462bc00/0x878a5eea00ceaf6a lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceaf63 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.629699:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00ceafa2 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.629735:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462bc00/0x878a5eea00ceaf6a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceaf63 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826018.629749:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049134208:0@lo:104: 00000100:00100000:1.0:1787826018.629806:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826018.629856:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826018.631162:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049134208:0@lo:104: 00010000:00010000:1.0:1787826018.631183:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00ceafa2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826018.636899:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869777 is committed 00010000:00010000:1.0:1787826018.640179:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00ceafa2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.640189:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00ceafa2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826018.640250:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x21:0x0]: returning size 4096 00000004:00200000:1.0:1787826018.640257:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826018.640317:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00ceaf9b lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eaef expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.640359:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00ceafa2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x21:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eaef expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.640366:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x21:0x0].0x0 (ffff8eb476e51500) 00010000:00010000:1.0:1787826018.640369:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826018.640372:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:1.0:1787826018.640430:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155306:x1874663042896512:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 10872us (11726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.640438:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 595 00000100:00100000:1.0:1787826018.645602:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.657056:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.671171:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.671845:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049134848 00000100:00100000:1.0:1787826018.671850:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049134848 00000100:00100000:1.0:1787826018.671879:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4700 00000100:00100000:1.0:1787826018.671885:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049134848:12345-0@lo:105: 00010000:00010000:1.0:1787826018.671895:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b400/0x878a5eea00ceafc5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceafcc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.671905:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b400/0x878a5eea00ceafc5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceafcc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.671913:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b400/0x878a5eea00ceafc5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceafcc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.671920:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b400/0x878a5eea00ceafc5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceafcc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.671928:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b400/0x878a5eea00ceafc5 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceafcc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.671936:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b400/0x878a5eea00ceafc5 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceafcc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.671948:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34462b400) 00000100:00100000:1.0:1787826018.677949:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049134848:12345-0@lo:105: Request processed in 6055us (6195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.677964:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4700 00000004:00080000:1.0:1787826018.689573:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 596 rpc_version 596 00000020:00100000:1.0:1787826018.689605:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826018.689615:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c142680 x1874663049135232/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826018.689638:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049135232:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826018.689704:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826018.689739:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826018.694972:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049135232:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826018.698141:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049135360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826018.724601:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.724938:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 597 00000100:00100000:1.0:1787826018.724950:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+21:155324:x1874663042897152:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826018.724972:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826018.724993:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceafd3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eaf6 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725057:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725070:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725081:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725093:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725100:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725106:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725150:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725156:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725162:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725167:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826018.725171:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725178:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725188:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826018.725191:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826018.725196:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725202:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceafda lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725511:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725519:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725526:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725532:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826018.725535:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725542:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725552:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826018.725554:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826018.725557:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725563:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceafe1 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725594:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceafd3 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eaf6 expref: 22 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725605:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826018.725607:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826018.725611:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceafd3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eaf6 expref: 22 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.725620:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:1.0:1787826018.733277:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.736950:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.744889:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000004:00080000:1.0:1787826018.752490:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 597 rpc_version 597 00000020:00100000:1.0:1787826018.752549:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826018.752562:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb476e73480 x1874663049135616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826018.752587:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049135616:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826018.752654:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826018.752705:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826018.769604:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.786626:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.796278:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.800274:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 603 00000100:00100000:1.0:1787826018.800288:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155333:x1874663042898048:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826018.800344:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826018.800597:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00ceb05f lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb19 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.802043:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.802072:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb02e lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb027 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.802082:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.802136:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb02e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb027 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826018.802158:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049135872:0@lo:104: 00000100:00100000:1.0:1787826018.802246:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826018.802510:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826018.803653:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049135872:0@lo:104: 00010000:00010000:1.0:1787826018.803690:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.809863:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.809874:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826018.809957:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x22:0x0]: returning size 4096 00000004:00200000:1.0:1787826018.809965:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826018.810029:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00ceb05f lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.810052:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.810061:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x22:0x0].0x0 (ffff8eb452580200) 00010000:00010000:1.0:1787826018.810064:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826018.810067:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511200, rc 0) 00000100:00100000:1.0:1787826018.810170:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155333:x1874663042898048:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 9883us (13906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.810181:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 603 00000100:00100000:1.0:1787826018.814721:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a5d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049136000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826018.817899:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb06d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.817917:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.817927:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.817935:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.818040:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb07b lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.818049:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb07b lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.818056:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb07b lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.818077:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb082 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.818091:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb058 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb12 expref: 24 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.818100:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb082 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.818148:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb058 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb12 expref: 24 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.818173:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb058 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb12 expref: 24 pid: 187904 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826018.818190:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049136128:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826018.818308:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826018.821525:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049136128:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826018.821566:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb082 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826018.823764:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042898432 00000100:00100000:1.0:1787826018.823777:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042898432 00010000:00010000:1.0:1787826018.823832:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb058 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb12 expref: 25 pid: 187904 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826018.823876:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12121 00000100:00100000:1.0:1787826018.823888:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+25:2392:x1874663042898432:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826018.823907:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826018.823913:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb058 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x22:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb12 expref: 25 pid: 187904 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.823925:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb058 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x22:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb12 expref: 25 pid: 187904 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.823953:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb058 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x22:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb12 expref: 25 pid: 187904 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.823972:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x22:0x0].0x0 (ffff8eb344814300) 00010000:00010000:1.0:1787826018.823977:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb082 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.823988:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb082 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.823997:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb082 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.824027:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826018.824107:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+24:2392:x1874663042898432:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 219us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.824116:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12121 00000100:00100000:1.0:1787826018.825163:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049136256 00000100:00100000:1.0:1787826018.825169:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049136256 00000100:00100000:1.0:1787826018.825256:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12281 00000100:00100000:1.0:1787826018.825266:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049136256:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826018.825287:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826018.825318:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb089 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.825370:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.825379:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb089 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.825411:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.825426:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 6 pid: 187906 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826018.825439:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049136384:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826018.825510:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826018.827880:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049136384:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826018.827920:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb089 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.827943:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x22:0x0].0x0 (ffff8eb452580200) 00010000:00010000:1.0:1787826018.827947:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826018.827951:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb089 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.827962:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb089 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.827972:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511a00, rc 0) 00000100:00100000:1.0:1787826018.828040:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049136256:12345-0@lo:101:mdt00_003.0 Request processed in 2774us (2923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.828049:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12281 00000100:00100000:3.0:1787826018.828364:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042898560 00000100:00100000:3.0:1787826018.828373:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042898560 00010000:00010000:3.0:1787826018.828412:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 7 pid: 187906 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826018.828440:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12122 00000100:00100000:3.0:1787826018.828459:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb449166850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2390:x1874663042898560:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826018.828478:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826018.828486:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 7 pid: 187906 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.828506:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 7 pid: 187906 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.828532:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00ceb066 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x22:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb19 expref: 7 pid: 187906 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.828555:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x22:0x0].0x0 (ffff8eb452580200) 00010000:00010000:3.0:1787826018.828560:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb089 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.828570:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb089 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.828579:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb089 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.828612:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb090 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb089 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826018.828626:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b159180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049136512:0@lo:105: 00000100:00100000:3.0:1787826018.828666:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826018.828717:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826018.828787:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049136512 00000100:00100000:1.0:1787826018.828791:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049136512 00000100:00100000:1.0:1787826018.828823:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4702 00000100:00100000:1.0:1787826018.828829:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b15b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049136512:12345-0@lo:105: 00010000:00010000:1.0:1787826018.828840:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3000/0x878a5eea00ceb089 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb090 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.828850:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3000/0x878a5eea00ceb089 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb090 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.828859:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3000/0x878a5eea00ceb089 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb090 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.828865:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3000/0x878a5eea00ceb089 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb090 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.828873:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3000/0x878a5eea00ceb089 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb090 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.828881:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3000/0x878a5eea00ceb089 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb090 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.828895:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb481ce3000) 00000100:00100000:1.0:1787826018.828927:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b15b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049136512:12345-0@lo:105: Request processed in 98us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.828933:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4702 00000100:00100000:3.0:1787826018.831484:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b159180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049136512:0@lo:105: 00010000:00010000:3.0:1787826018.831562:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826018.834702:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb449166850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042898560:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 6246us (6932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826018.834716:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12122 00000100:00100000:3.0:1787826018.835746:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049136896 00000100:00100000:3.0:1787826018.835756:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049136896 00000100:00100000:3.0:1787826018.835805:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12283 00000100:00100000:3.0:1787826018.835814:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049136896:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826018.836122:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049136896:12345-0@lo:1000:osp_up1-0.0 Request processed in 307us (519us total) trans 17179869780 rc 0/0 00000100:00100000:3.0:1787826018.836130:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12283 00000100:00100000:3.0:1787826018.850369:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042898688 00000100:00100000:3.0:1787826018.850383:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042898688 00000100:00100000:3.0:1787826018.850468:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 605 00000100:00100000:3.0:1787826018.850480:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+25:155346:x1874663042898688:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826018.850525:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826018.850552:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb097 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb20 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850637:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850654:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850666:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850691:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850700:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850708:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850766:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850775:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850782:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850788:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462b200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826018.850794:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850801:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850815:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826018.850818:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826018.850825:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850831:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb09e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850845:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850851:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850856:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850861:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826018.850864:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850870:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850877:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826018.850880:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826018.850883:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850889:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0a5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850922:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb097 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb20 expref: 26 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850933:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826018.850936:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826018.850939:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb097 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb20 expref: 26 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.850950:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462b800, rc 0) 00000100:00100000:3.0:1787826018.851206:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+25:155346:x1874663042898688:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 726us (1717us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826018.851215:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 605 00000100:00100000:1.0:1787826018.863395:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.877401:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042898944 00000100:00100000:1.0:1787826018.877416:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042898944 00000100:00100000:1.0:1787826018.891611:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826018.894706:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049137280:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826018.894938:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.894957:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.894971:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.894993:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895001:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895008:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895044:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895052:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895062:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826018.895140:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049137408:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787826018.895185:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826018.895247:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826018.895680:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049137408:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826018.895696:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895707:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826018.895736:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cdba23a reply state 00000000a0c8a74c transno 335007449154 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895749:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895755:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x23:0x0].0x0 (ffff8eb476e51f00) 00010000:00010000:3.0:1787826018.895758:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826018.895761:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826018.895768:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895776:0:187904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826018.895789:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x23:0x0] 00000004:00010000:3.0:1787826018.895796:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cdba23a reply state 00000000a0c8a74c transno 335007449154 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895804:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895810:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1baf:0x0].0x0 (ffff8eb476e51500) 00010000:00010000:3.0:1787826018.895813:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826018.895815:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826018.895820:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1baf:0x0]: returning size 4096 00010000:00010000:3.0:1787826018.895828:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb0cf lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895835:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb0cf lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895842:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb0cf lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895849:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826018.895854:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb0cf lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895863:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb0cf lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895875:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826018.895877:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826018.895881:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb0cf lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895887:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb0cf lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826018.895902:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cdba23a reply state 00000000a0c8a74c transno 335007449154 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895911:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.895917:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826018.895920:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826018.895922:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826018.896005:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155346:x1874663042899200:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 4171us (4405us total) trans 335007449154 rc 0/0 00000100:00100000:3.0:1787826018.896014:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 608 00000100:00100000:1.0:1787826018.908507:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826018.908667:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042899328 00000100:00100000:3.0:1787826018.908692:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042899328 00000100:00100000:3.0:1787826018.908833:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 609 00000100:00100000:3.0:1787826018.908847:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155359:x1874663042899328:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826018.908881:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826018.908910:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb0f9 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb35 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909002:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909019:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909032:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909045:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909053:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909218:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909527:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb10e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909537:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb10e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909550:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb10e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826018.909657:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1baf:0x0]: returning size 4096 00000004:00200000:3.0:1787826018.909663:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826018.909701:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb10e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.909716:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910737:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910748:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910756:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462ac00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826018.910761:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910770:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910788:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826018.910791:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826018.910797:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910804:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb100 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910831:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910838:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910845:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910851:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462be00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826018.910854:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910860:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910869:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826018.910871:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826018.910875:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910881:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb107 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910927:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb0f9 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb35 expref: 29 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910943:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb10e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb35 expref: 28 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.910956:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1baf:0x0].0x0 (ffff8eb476e51500) 00010000:00010000:3.0:1787826018.910959:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826018.910961:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462a400, rc 0) 00000100:00100000:3.0:1787826018.911070:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+28:155359:x1874663042899328:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 2218us (2570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826018.911081:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 609 00000100:00100000:3.0:1787826018.930876:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042899584 00000100:00100000:3.0:1787826018.930890:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042899584 00000100:00100000:3.0:1787826018.930961:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 611 00000100:00100000:3.0:1787826018.930974:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155359:x1874663042899584:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826018.931001:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826018.931031:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb123 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.931194:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462be00/0x878a5eea00ceb12a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.931212:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb0f2 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb0eb expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.931222:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462be00/0x878a5eea00ceb12a lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x23:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.931265:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb0f2 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb0eb expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826018.931284:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049137536:0@lo:104: 00000100:00100000:3.0:1787826018.931947:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787826018.931964:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049137536 00000100:00100000:3.0:1787826018.931971:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049137536 00000100:00100000:3.0:1787826018.932022:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4703 00000100:00100000:3.0:1787826018.932034:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d10450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049137536:12345-0@lo:104: 00010000:00010000:3.0:1787826018.932051:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.932122:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826018.932129:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d10450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049137536:12345-0@lo:104: Request processed in 99us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826018.932136:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4703 00010000:00010000:3.0:1787826018.932202:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826018.932209:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.932218:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462b200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826018.932225:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826018.932235:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.932266:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.932274:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826018.932456:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.932471:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb0eb lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb0f2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.932492:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826018.932494:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826018.932496:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826018.932512:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049137664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826018.932555:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826018.932597:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049137664 00000100:00100000:3.0:1787826018.932602:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049137664 00010000:00010000:3.0:1787826018.932625:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb0f2 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ceb0eb expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826018.932650:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12123 00000100:00100000:3.0:1787826018.932657:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b15b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3617:x1874663049137664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826018.932678:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826018.935869:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb0f2 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x23:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb0eb expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.935891:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x23:0x0].0x0 (ffff8eb344814500) 00010000:00010000:3.0:1787826018.935896:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462be00/0x878a5eea00ceb12a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x23:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.935907:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462be00/0x878a5eea00ceb12a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x23:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.935914:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462be00/0x878a5eea00ceb12a lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x23:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826018.936598:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049137664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826018.957477:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042899968 00000100:00100000:3.0:1787826018.957489:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042899968 00010000:00010000:3.0:1787826018.957547:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb11c lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x23:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb3c expref: 29 pid: 188682 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826018.957604:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12124 00000100:00100000:3.0:1787826018.957616:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+29:2390:x1874663042899968:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826018.957635:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826018.957644:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb11c lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x23:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb3c expref: 29 pid: 188682 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.957660:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb11c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x23:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb3c expref: 29 pid: 188682 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.957699:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x23:0x0].0x0 (ffff8eb476e51f00) 00010000:00010000:3.0:1787826018.957706:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.957718:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.957727:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.957752:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826018.957822:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+29:2390:x1874663042899968:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 207us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826018.957831:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12124 00000100:00100000:3.0:1787826018.964581:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:1.0:1787826018.966289:0:177386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462be00/0x878a5eea00ceb12a lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb43 expref: 6 pid: 187906 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826018.966306:0:177386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049138048:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826018.966349:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb154 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb14d expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.966357:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x23:0x0].0x0 (ffff8eb344814500) 00010000:00010000:1.0:1787826018.966361:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826018.966365:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3e00, rc 0) 00000100:00100000:1.0:1787826018.966406:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049137920:12345-0@lo:101:mdt00_003.0 Request processed in 7435us (7573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.966414:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12286 00000100:00100000:1.0:1787826018.969165:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049138304 00000100:00100000:1.0:1787826018.969176:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049138304 00000100:00100000:1.0:1787826018.969274:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12287 00000100:00100000:1.0:1787826018.969286:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049138304:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787826018.975757:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049138304:12345-0@lo:403:mdt00_003.0 Request processed in 6458us (7569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826018.976087:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12287 00000100:00100000:3.0:1787826018.979975:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a5da300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049138304:0@lo:403:mdt00_003.0 00000004:00080000:1.0:1787826018.989314:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 600 rpc_version 600 00000020:00100000:1.0:1787826018.989382:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826018.989395:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb476e72a00 x1874663049138560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826018.989423:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049138560:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826018.989513:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826018.989553:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826018.991444:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049138560:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826018.991532:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1baf:0x0]: returning size 4096 00010000:00010000:1.0:1787826018.991576:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991588:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991596:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991602:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826018.991608:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991615:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991635:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x23:0x0].0x0 (ffff8eb476e51f00) 00010000:00010000:1.0:1787826018.991638:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826018.991644:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991650:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb146 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991680:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991689:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991697:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991724:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826018.991735:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x23:0x0] 00010000:00010000:1.0:1787826018.991743:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb13f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991750:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb13f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991756:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb13f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991762:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826018.991765:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb13f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991781:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb13f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991791:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1baf:0x0].0x0 (ffff8eb476e51500) 00010000:00010000:1.0:1787826018.991793:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826018.991796:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb13f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991801:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb13f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991817:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb131 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991823:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb131 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991828:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb131 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991833:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826018.991836:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb131 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991842:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb131 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991853:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826018.991856:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826018.991858:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb131 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991864:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb131 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826018.991874:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1a79d8f reply state 00000000b6714cc1 transno 335007449155 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991890:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826018.991897:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826018.991900:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826018.991904:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826018.991999:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+29:155359:x1874663042899840:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 50038us (50220us total) trans 335007449155 rc 0/0 00000100:00100000:1.0:1787826018.992008:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 612 00010000:00010000:3.0:1787826018.992191:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826018.992199:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.992208:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826018.992213:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826018.992221:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.992258:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.992265:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826018.992296:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.992304:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39200/0x878a5eea00ceb14d lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb154 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.992348:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826018.992350:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826018.992353:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826018.992496:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826018.992515:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049138688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826018.992578:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826018.992620:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049138688 00000100:00100000:3.0:1787826018.992627:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049138688 00000100:00100000:3.0:1787826018.992685:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4175 00000100:00100000:3.0:1787826018.992694:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049138688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826018.992708:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826018.992729:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb154 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb14d expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826018.992742:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x23:0x0].0x0 (ffff8eb344814500) 00010000:00010000:3.0:1787826018.992751:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826018.992786:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049138688:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826018.992793:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4175 00000100:00100000:3.0:1787826018.992828:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049138688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826019.019698:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.019975:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042900224 00000100:00100000:1.0:1787826019.019988:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042900224 00000100:00100000:1.0:1787826019.020075:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 613 00000100:00100000:1.0:1787826019.020088:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+29:155365:x1874663042900224:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826019.020118:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.020144:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb15b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb4a expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020238:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020257:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020270:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020282:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020850:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020862:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020919:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020928:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020936:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020943:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.020949:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020961:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020976:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.020979:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.020984:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.020990:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb162 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021004:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021011:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021016:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021022:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.021024:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021030:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021036:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826019.021039:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.021041:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021048:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb169 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021084:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb15b lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb4a expref: 30 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021095:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.021098:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.021101:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb15b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb4a expref: 30 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.021113:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00000100:00100000:1.0:1787826019.021254:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+29:155365:x1874663042900224:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1167us (1570us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826019.021263:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 613 00000100:00100000:3.0:1787826019.024898:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826019.048989:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000004:00080000:3.0:1787826019.051012:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 601 rpc_version 601 00000020:00100000:3.0:1787826019.051059:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826019.051071:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34b158700 x1874663049138944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826019.051110:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b158700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049138944:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.051187:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.051229:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.055403:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b158700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049138944:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.056205:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049139072:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826019.056221:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2a00/0x878a5eea00ceb1af lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb1b6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056231:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2a00/0x878a5eea00ceb1af lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb1b6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826019.056255:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cfc8c55 reply state 0000000012c65d42 transno 335007449156 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056268:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056275:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x24:0x0].0x0 (ffff8eb47f8ff700) 00010000:00010000:3.0:1787826019.056277:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826019.056280:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826019.056287:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2a00/0x878a5eea00ceb1af lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb1b6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056305:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce2a00/0x878a5eea00ceb1af lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb1b6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826019.056316:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x24:0x0] 00000004:00010000:3.0:1787826019.056322:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cfc8c55 reply state 0000000012c65d42 transno 335007449156 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056356:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056374:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb0:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:3.0:1787826019.056377:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826019.056379:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826019.056385:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb0:0x0]: returning size 4096 00010000:00010000:3.0:1787826019.056392:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb193 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056398:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb193 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056404:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb193 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056411:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.056416:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb193 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056424:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb193 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056437:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.056439:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.056443:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb193 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056449:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb193 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826019.056463:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cfc8c55 reply state 0000000012c65d42 transno 335007449156 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056477:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.056482:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826019.056485:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826019.056487:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826019.056595:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155365:x1874663042900736:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 7171us (7617us total) trans 335007449156 rc 0/0 00000100:00100000:3.0:1787826019.056603:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 616 00000100:00100000:3.0:1787826019.084580:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042900992 00000100:00100000:3.0:1787826019.084594:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042900992 00000100:00100000:3.0:1787826019.084787:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 618 00000100:00100000:3.0:1787826019.084800:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+32:155368:x1874663042900992:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826019.084829:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.084856:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb1d9 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb66 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.084943:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb1e0 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.084960:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb1e0 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.084973:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb1e0 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826019.085049:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x24:0x0]: returning size 4096 00000004:00200000:3.0:1787826019.085056:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826019.085113:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb1d9 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb66 expref: 34 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.085136:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb1e0 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb66 expref: 33 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.085146:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x24:0x0].0x0 (ffff8eb47f8ff700) 00010000:00010000:3.0:1787826019.085149:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826019.085153:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462ac00, rc 0) 00000100:00100000:3.0:1787826019.085278:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+33:155368:x1874663042900992:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 479us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.085287:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 618 00000100:00100000:3.0:1787826019.088236:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.088406:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042901120 00000100:00100000:1.0:1787826019.088419:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042901120 00000100:00100000:1.0:1787826019.088495:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 619 00000100:00100000:1.0:1787826019.088506:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155368:x1874663042901120:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826019.088530:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.088558:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb1e7 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb6d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.088637:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.088655:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb1b6 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb1af expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.088666:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.088730:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb1b6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb1af expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826019.088751:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049139200:0@lo:104: 00000100:00100000:1.0:1787826019.088822:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826019.088874:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826019.089677:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049139200:0@lo:104: 00010000:00010000:1.0:1787826019.089705:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.090065:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826019.090082:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049139328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826019.090129:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.094199:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049139328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826019.096884:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.096906:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826019.096998:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x24:0x0]: returning size 4096 00000004:00200000:1.0:1787826019.097007:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826019.097083:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00ceb1e7 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb6d expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.097112:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb6d expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.097123:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x24:0x0].0x0 (ffff8eb344814f00) 00010000:00010000:1.0:1787826019.097127:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826019.097132:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511e00, rc 0) 00000100:00100000:1.0:1787826019.097396:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155368:x1874663042901120:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 8889us (9179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826019.097407:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 619 00000100:00100000:3.0:1787826019.118277:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049139584 00000100:00100000:3.0:1787826019.118284:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049139584 00000100:00100000:3.0:1787826019.118373:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12291 00000100:00100000:3.0:1787826019.118383:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049139584:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826019.118402:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.118425:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462b200/0x878a5eea00ceb218 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb211 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.118453:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb6d expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.118480:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462b200/0x878a5eea00ceb218 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb211 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.118508:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb6d expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.118523:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceb1ee lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb6d expref: 6 pid: 187905 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.118536:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b15b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049139712:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826019.118609:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.137161:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b15b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049139712:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826019.137214:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462b200/0x878a5eea00ceb218 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb211 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.137229:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x24:0x0].0x0 (ffff8eb344814f00) 00010000:00010000:3.0:1787826019.137232:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826019.137237:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462b200/0x878a5eea00ceb218 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb211 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.137249:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462b200/0x878a5eea00ceb218 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb211 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.137257:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462b200, rc 0) 00000100:00100000:3.0:1787826019.137692:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049139584:12345-0@lo:101:mdt00_003.0 Request processed in 19307us (19482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.137706:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12291 00000100:00100000:3.0:1787826019.138773:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826019.139956:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049139840 00000100:00100000:3.0:1787826019.139961:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049139840 00000100:00100000:3.0:1787826019.139997:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4706 00000100:00100000:3.0:1787826019.140005:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049139840:12345-0@lo:105: 00010000:00010000:3.0:1787826019.142831:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.142855:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.142865:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.142875:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.142884:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.143248:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.143280:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34bf38400) 00000100:00100000:3.0:1787826019.143425:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049139840:12345-0@lo:105: Request processed in 3416us (3612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.143439:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4706 00000100:00100000:3.0:1787826019.150220:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049139968 00000100:00100000:3.0:1787826019.150231:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049139968 00000100:00100000:3.0:1787826019.150307:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12292 00000100:00100000:3.0:1787826019.150318:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049139968:12345-0@lo:403:mdt00_003.0 00010000:00010000:3.0:1787826019.156451:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826019.156555:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049139968:12345-0@lo:403:mdt00_003.0 Request processed in 6231us (6565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.156569:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12292 00000004:00080000:3.0:1787826019.159032:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 602 rpc_version 602 00000020:00100000:3.0:1787826019.159088:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826019.159102:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34b158700 x1874663049140224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826019.159131:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b158700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049140224:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.159215:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.159269:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.174363:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b158700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049140224:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826019.180193:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826019.180203:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.180212:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826019.180217:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826019.180227:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.180281:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.180290:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826019.181313:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.181347:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38400/0x878a5eea00ceb211 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb218 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.181377:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826019.181379:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826019.181381:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826019.183507:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049140352 00000100:00100000:3.0:1787826019.183526:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049140352 00000100:00100000:3.0:1787826019.183624:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4176 00000100:00100000:3.0:1787826019.183634:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049140352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826019.183652:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826019.183698:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462b200/0x878a5eea00ceb218 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb211 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.183721:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x24:0x0].0x0 (ffff8eb344814f00) 00010000:00010000:3.0:1787826019.183737:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826019.188628:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049140352:12345-0@lo:103:ldlm_bl.0 Request processed in 4806us (7955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.188648:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4176 00000100:00100000:3.0:1787826019.217567:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.217700:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042901760 00000100:00100000:1.0:1787826019.217713:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042901760 00000100:00100000:1.0:1787826019.217782:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 621 00000100:00100000:1.0:1787826019.217793:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+33:155371:x1874663042901760:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826019.217823:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.217850:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb21f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb74 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.217943:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.217959:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.217970:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.217982:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.217989:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.217995:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218049:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218056:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218062:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218068:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.218072:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218079:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218092:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.218095:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.218099:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218105:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb226 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218119:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218125:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218130:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218135:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.218137:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218142:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218149:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826019.218152:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.218155:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218161:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb22d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218190:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb21f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb74 expref: 34 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218202:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.218204:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.218208:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb21f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb74 expref: 34 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.218218:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:1.0:1787826019.218305:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+33:155371:x1874663042901760:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 512us (752us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826019.218314:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 621 00000100:00100000:3.0:1787826019.243700:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042901888 00000100:00100000:3.0:1787826019.243713:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042901888 00000100:00100000:3.0:1787826019.243787:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 622 00000100:00100000:3.0:1787826019.243798:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+33:155371:x1874663042901888:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826019.243825:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.243852:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb234 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb7b expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244013:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244031:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244043:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244055:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244063:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244068:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244124:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244131:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244143:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244150:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462ba00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.244154:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244162:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244174:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.244177:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.244182:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244188:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb23b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244201:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244206:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244212:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244217:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.244220:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244230:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244236:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826019.244239:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.244241:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244247:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb242 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244273:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb234 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb7b expref: 34 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244283:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.244285:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.244288:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb234 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb7b expref: 34 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.244297:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462b200, rc 0) 00000100:00100000:3.0:1787826019.244401:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+33:155371:x1874663042901888:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 605us (793us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826019.244409:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 622 00000100:00100000:1.0:1787826019.259737:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826019.268851:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000040:00080000:1.0:1787826019.280998:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].414, 2152 off638784 00000040:00080000:1.0:1787826019.281107:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].285, 2352 off476544 00000004:00080000:1.0:1787826019.281114:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb441374000 with version 603 00000004:00080000:3.0:1787826019.283463:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 603 rpc_version 603 00000020:00100000:3.0:1787826019.283528:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826019.283543:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34b159c00 x1874663049140608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826019.283569:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b159c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049140608:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.283644:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.283703:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.284871:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b159c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049140608:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.285932:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049140736 00000100:00100000:3.0:1787826019.285939:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049140736 00000100:00100000:3.0:1787826019.285983:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12295 00000100:00100000:3.0:1787826019.285991:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187904:x1874663049140736:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826019.286008:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.286024:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb27a lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb273 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286043:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb27a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb273 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286054:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb27a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb273 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286061:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x25:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826019.286064:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.286067:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462ac00, rc 0) 00000100:00100000:3.0:1787826019.286107:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187904:x1874663049140736:12345-0@lo:101:mdt00_000.0 Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.286113:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12295 00000100:00100000:3.0:1787826019.286146:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049140736:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826019.286161:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb273 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb27a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286170:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb273 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb27a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826019.286188:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d097fe98 reply state 0000000033371a88 transno 335007449158 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286200:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286206:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x25:0x0].0x0 (ffff8eb449543100) 00010000:00010000:3.0:1787826019.286209:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826019.286211:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826019.286217:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb273 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb27a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286225:0:187904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb273 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb27a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826019.286236:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x25:0x0] 00000004:00010000:3.0:1787826019.286242:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d097fe98 reply state 0000000033371a88 transno 335007449158 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286250:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286255:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb1:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:3.0:1787826019.286257:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826019.286259:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826019.286263:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb1:0x0]: returning size 4096 00010000:00010000:3.0:1787826019.286271:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb257 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286277:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb257 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286283:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb257 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286301:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.286307:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb257 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286313:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb257 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286349:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.286351:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.286355:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb257 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286361:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb257 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826019.286385:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d097fe98 reply state 0000000033371a88 transno 335007449158 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286395:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.286400:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826019.286403:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826019.286405:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826019.286472:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155371:x1874663042902272:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 17415us (17630us total) trans 335007449158 rc 0/0 00000100:00100000:3.0:1787826019.286492:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 624 00000100:00100000:3.0:1787826019.328197:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.345269:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.366565:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:3.0:1787826019.376062:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb27a lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb273 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.376080:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x25:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826019.376085:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb2b2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.376095:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb2b2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.376102:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb2b2 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.376137:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826019.376229:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049140992:12345-0@lo:103:ldlm_bl.0 Request processed in 8734us (8929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.376239:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12129 00000100:00100000:3.0:1787826019.384591:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.384646:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042902912 00000100:00100000:1.0:1787826019.384657:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042902912 00000100:00100000:1.0:1787826019.384722:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 628 00000100:00100000:1.0:1787826019.384733:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155375:x1874663042902912:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:1.0:1787826019.384784:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826019.384808:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb296 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb89 expref: 37 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.384823:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb1:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:1.0:1787826019.384827:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826019.384847:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.384861:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.384871:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.384881:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.384891:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.384902:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.385140:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.385150:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.385157:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.385175:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 3/0,1 mode: --/EX res: [0x200026560:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.385185:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb2a4 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb90 expref: 36 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.385193:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 4/0,1 mode: --/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.385225:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb2a4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb90 expref: 36 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.385240:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb2a4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb90 expref: 36 pid: 188682 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826019.385255:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049141120:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826019.385531:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.390370:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049141120:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826019.390411:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 3/0,1 mode: --/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.400730:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:3.0:1787826019.401739:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.401752:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.401793:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.401800:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.401810:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.401827:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049141248:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787826019.401866:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.401898:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.406705:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869785 gen 2 00000004:00080000:3.0:1787826019.406712:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869784 committed transno 17179869785 00000004:00080000:3.0:1787826019.406733:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869785 committed transno 17179869785 00000100:00100000:3.0:1787826019.406748:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049141248:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826019.406765:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.406775:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.412728:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042903168 00000100:00100000:3.0:1787826019.412738:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042903168 00010000:00010000:3.0:1787826019.413000:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb2b2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb97 expref: 7 pid: 187905 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.413052:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12131 00000100:00100000:3.0:1787826019.413063:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042903168:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826019.413078:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826019.413085:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb2b2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb97 expref: 7 pid: 187905 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413098:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb2b2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb97 expref: 7 pid: 187905 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413120:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb2b2 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x25:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb97 expref: 7 pid: 187905 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413134:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x25:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826019.413141:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb2dc lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb2d5 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413152:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb2dc lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb2d5 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413161:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb2dc lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb2d5 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413197:0:9496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb2dc lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb2d5 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.413212:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b159c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9496:1874663049141504:0@lo:105: 00000100:00100000:3.0:1787826019.413258:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.413303:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.413354:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049141504 00000100:00100000:3.0:1787826019.413359:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049141504 00000100:00100000:3.0:1787826019.413623:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4708 00000100:00100000:3.0:1787826019.413632:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9496:x1874663049141504:12345-0@lo:105: 00010000:00010000:3.0:1787826019.413643:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413654:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413664:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413684:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413693:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413702:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.413721:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34462b200) 00000100:00100000:3.0:1787826019.413761:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9496:x1874663049141504:12345-0@lo:105: Request processed in 130us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.413768:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4708 00000100:00100000:3.0:1787826019.414545:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b159c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9496:1874663049141504:0@lo:105: 00010000:00010000:3.0:1787826019.414563:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826019.414620:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042903168:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1558us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.414629:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12131 00010000:00010000:3.0:1787826019.414656:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.414678:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.416597:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34b159c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049141632:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1787826019.416689:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.416724:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.419109:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34b159c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049141632:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1787826019.421065:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].415, 656 off639440 00000040:00080000:3.0:1787826019.421239:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].286, 736 off477280 00000004:00080000:3.0:1787826019.421245:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a240 with version 604 00000100:00100000:3.0:1787826019.421676:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049141888 00000100:00100000:3.0:1787826019.421683:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049141888 00000100:00100000:3.0:1787826019.421733:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12298 00000100:00100000:3.0:1787826019.421742:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049141888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.421928:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049141888:12345-0@lo:1000:osp_up1-0.0 Request processed in 186us (350us total) trans 17179869786 rc 0/0 00000100:00100000:3.0:1787826019.421937:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12298 00000100:00100000:3.0:1787826019.421987:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a5da300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049141888:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1787826019.422015:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb1:0x0]: returning size 4096 00010000:00010000:3.0:1787826019.422035:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422045:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422052:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422058:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.422062:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422069:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422084:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x25:0x0].0x0 (ffff8eb449543100) 00010000:00010000:3.0:1787826019.422087:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826019.422091:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 2/0,0 mode: --/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422096:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb2ce lrc: 0/0,0 mode: --/EX res: [0x200026560:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422109:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422117:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422129:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb2d5 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb2dc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422144:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787826019.422151:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x25:0x0] 00010000:00010000:3.0:1787826019.422158:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422165:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422171:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422175:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.422179:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422184:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422192:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb1:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:3.0:1787826019.422194:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826019.422197:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422203:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb2c7 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422215:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422221:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422227:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422231:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.422234:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422240:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422246:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.422248:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.422251:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422257:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2b9 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826019.422266:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a32dbc86 reply state 00000000be9449f9 transno 335007449159 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422277:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.422284:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826019.422286:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826019.422375:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826019.422436:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155375:x1874663042902912:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 37703us (37853us total) trans 335007449159 rc 0/0 00000100:00100000:3.0:1787826019.422443:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 628 00000100:00100000:3.0:1787826019.465830:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.465902:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042903296 00000100:00100000:1.0:1787826019.465912:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042903296 00000100:00100000:1.0:1787826019.465966:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 629 00000100:00100000:1.0:1787826019.465976:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155380:x1874663042903296:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826019.465997:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.466016:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb2e3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eb9e expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466074:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466088:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466099:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466110:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466118:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466124:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466159:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466166:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466177:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466183:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.466187:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466194:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466205:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.466209:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.466213:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466219:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb2ea lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466230:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466236:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466241:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466246:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.466249:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466259:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466266:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826019.466269:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.466272:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466277:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb2f1 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466316:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb2e3 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb9e expref: 38 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466360:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.466363:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.466367:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb2e3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eb9e expref: 38 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.466378:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511e00, rc 0) 00000100:00100000:1.0:1787826019.466431:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155380:x1874663042903296:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 455us (609us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826019.466438:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 629 00000100:00100000:3.0:1787826019.472592:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.472662:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042903424 00000100:00100000:1.0:1787826019.472681:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042903424 00000100:00100000:1.0:1787826019.472738:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 630 00000100:00100000:1.0:1787826019.472747:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155380:x1874663042903424:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826019.472769:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.472788:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00ceb2f8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eba5 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472847:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472861:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472872:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472883:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472891:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472898:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472932:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472939:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472945:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472950:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.472955:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472962:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472973:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.472976:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.472980:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.472986:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb2ff lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473000:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473006:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473012:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473017:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.473020:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473027:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473034:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826019.473036:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.473040:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473046:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb306 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473072:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00ceb2f8 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eba5 expref: 38 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473082:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.473084:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.473087:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00ceb2f8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eba5 expref: 38 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.473096:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:1.0:1787826019.473152:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155380:x1874663042903424:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 405us (567us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826019.473160:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 630 00000100:00100000:3.0:1787826019.486264:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042903552 00000100:00100000:3.0:1787826019.486273:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042903552 00000100:00100000:3.0:1787826019.487204:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 631 00000100:00100000:3.0:1787826019.487219:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155380:x1874663042903552:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826019.487238:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.487257:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb30d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ebac expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.487319:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb314 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.487360:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb314 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.487372:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb314 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826019.487416:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:3.0:1787826019.487420:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826019.487440:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb314 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.487463:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb30d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebac expref: 39 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.487487:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb314 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebac expref: 38 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.487495:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.487498:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826019.487501:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462a200, rc 0) 00000100:00100000:3.0:1787826019.487556:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+38:155380:x1874663042903552:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 341us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.487563:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 631 00000100:00100000:3.0:1787826019.495973:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.504073:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042903808 00000100:00100000:1.0:1787826019.504087:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042903808 00000100:00100000:1.0:1787826019.504159:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 632 00000100:00100000:1.0:1787826019.504171:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+38:155380:x1874663042903808:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826019.504225:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826019.504251:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb314 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebac expref: 38 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.504270:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.504275:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826019.504351:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.504365:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.504374:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.504387:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.504397:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.504403:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826019.505262:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].416, 2152 off641592 00000040:00080000:1.0:1787826019.505372:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].287, 2352 off479632 00000004:00080000:1.0:1787826019.505378:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925e480 with version 605 00000004:00080000:3.0:1787826019.505587:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 605 rpc_version 605 00000020:00100000:3.0:1787826019.505622:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826019.505632:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472584e00 x1874663049142272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826019.505654:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049142272:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.505728:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.505758:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.506581:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049142272 00000100:00100000:3.0:1787826019.506590:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049142272 00000100:00100000:3.0:1787826019.506643:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12299 00000100:00100000:3.0:1787826019.506652:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049142272:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.507170:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049142272:12345-0@lo:1000:osp_up1-0.0 Request processed in 518us (1440us total) trans 17179869787 rc 0/0 00000100:00100000:3.0:1787826019.507178:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12299 00000100:00100000:1.0:1787826019.508697:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049142272:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.513039:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049142400 00000100:00100000:3.0:1787826019.513053:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049142400 00000100:00100000:3.0:1787826019.513114:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12300 00000100:00100000:3.0:1787826019.513125:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049142400:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826019.513147:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.513170:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb33e lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb337 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.513199:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb33e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb337 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.513214:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb33e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb337 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.513223:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x26:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826019.513226:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.513231:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462ac00, rc 0) 00000100:00100000:3.0:1787826019.513311:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049142400:12345-0@lo:101:mdt00_003.0 Request processed in 188us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.513318:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12300 00000100:00100000:1.0:1787826019.513434:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049142400:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826019.513453:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3a00/0x878a5eea00ceb337 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb33e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513465:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3a00/0x878a5eea00ceb337 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb33e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826019.513498:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000327d7cb4 reply state 000000009c828d7d transno 335007449160 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513515:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513521:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x26:0x0].0x0 (ffff8eb449543300) 00010000:00010000:1.0:1787826019.513524:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826019.513527:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826019.513532:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3a00/0x878a5eea00ceb337 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb33e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513540:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3a00/0x878a5eea00ceb337 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb33e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826019.513550:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x26:0x0] 00000004:00010000:1.0:1787826019.513556:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000327d7cb4 reply state 000000009c828d7d transno 335007449160 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513564:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513569:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb2:0x0].0x0 (ffff8eb449543700) 00010000:00010000:1.0:1787826019.513572:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826019.513574:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826019.513579:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb2:0x0]: returning size 4096 00010000:00010000:1.0:1787826019.513587:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513592:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513599:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513605:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.513610:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513618:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513629:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.513631:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.513634:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513640:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb31b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826019.513652:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000327d7cb4 reply state 000000009c828d7d transno 335007449160 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513661:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.513677:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826019.513679:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826019.513681:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826019.513757:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155380:x1874663042903808:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 9586us (17791us total) trans 335007449160 rc 0/0 00000100:00100000:1.0:1787826019.513765:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 632 00000100:00100000:3.0:1787826019.544970:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042903936 00000100:00100000:3.0:1787826019.544981:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042903936 00000100:00100000:3.0:1787826019.545585:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 633 00000100:00100000:3.0:1787826019.545600:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155383:x1874663042903936:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826019.545622:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.545641:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb345 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ebb3 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545728:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545743:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545755:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545767:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545775:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545781:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545856:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb35a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545864:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb35a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545871:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb35a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826019.545953:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb2:0x0]: returning size 4096 00000004:00200000:3.0:1787826019.545957:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826019.545976:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb35a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545988:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.545998:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546005:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546011:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462be00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.546016:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546022:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546035:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.546038:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.546042:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546049:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb34c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546061:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546067:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546073:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546078:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.546082:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546087:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546095:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826019.546098:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.546101:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546106:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb353 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546129:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb345 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebb3 expref: 41 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546143:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb35a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebb3 expref: 40 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.546151:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb2:0x0].0x0 (ffff8eb449543700) 00010000:00010000:3.0:1787826019.546153:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826019.546155:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462bc00, rc 0) 00000100:00100000:3.0:1787826019.546224:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+40:155383:x1874663042903936:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 629us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.546232:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 633 00000100:00100000:1.0:1787826019.554097:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826019.564172:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042904192 00000100:00100000:3.0:1787826019.564182:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042904192 00000100:00100000:3.0:1787826019.564274:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 635 00000100:00100000:3.0:1787826019.564285:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155383:x1874663042904192:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826019.564306:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.564382:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb36f lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ebc1 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.564444:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.564459:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb33e lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb337 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.564468:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.564501:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb33e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb337 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.564518:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049142528:0@lo:104: 00000100:00100000:3.0:1787826019.564580:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.564642:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826019.565176:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049142528 00000100:00100000:1.0:1787826019.565183:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049142528 00000100:00100000:1.0:1787826019.565224:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4709 00000100:00100000:1.0:1787826019.565232:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049142528:12345-0@lo:104: 00010000:00010000:1.0:1787826019.565246:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3a00/0x878a5eea00ceb337 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb33e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.565320:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826019.565344:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049142528:12345-0@lo:104: Request processed in 112us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826019.565352:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4709 00000100:00100000:3.0:1787826019.565654:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049142528:0@lo:104: 00010000:00010000:3.0:1787826019.565686:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826019.569930:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869787 is committed 00010000:00010000:3.0:1787826019.570813:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.570828:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826019.570913:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x26:0x0]: returning size 4096 00000004:00200000:3.0:1787826019.570920:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826019.570980:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb36f lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebc1 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.571002:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebc1 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.571013:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x26:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826019.571016:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826019.571020:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcc400, rc 0) 00000100:00100000:3.0:1787826019.571103:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155383:x1874663042904192:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 6819us (7138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.571113:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 635 00000100:00100000:1.0:1787826019.579109:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042904448 00000100:00100000:1.0:1787826019.579124:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042904448 00000100:00100000:1.0:1787826019.579210:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 636 00000100:00100000:1.0:1787826019.579226:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+41:155383:x1874663042904448:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:1.0:1787826019.579318:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826019.579555:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb35a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebb3 expref: 41 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579580:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb2:0x0].0x0 (ffff8eb449543700) 00010000:00010000:1.0:1787826019.579587:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826019.579621:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb37d lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579638:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb37d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579650:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00ceb37d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579679:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579691:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579698:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579879:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb38b lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579888:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb38b lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579895:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00ceb38b lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579916:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb392 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579926:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb368 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebba expref: 40 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579936:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00ceb392 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.579979:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb368 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebba expref: 40 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.580001:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb368 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebba expref: 40 pid: 187904 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826019.580016:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049142784:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826019.580264:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826019.593135:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826019.600945:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049142912 00000100:00100000:3.0:1787826019.600970:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049142912 00000100:00100000:3.0:1787826019.617925:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042904704 00000100:00100000:3.0:1787826019.617932:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042904704 00010000:00010000:3.0:1787826019.617973:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebc1 expref: 7 pid: 187906 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.618010:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12134 00000100:00100000:3.0:1787826019.618023:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042904704:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826019.618039:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826019.618047:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebc1 expref: 7 pid: 187906 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618065:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebc1 expref: 7 pid: 187906 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618087:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb376 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebc1 expref: 7 pid: 187906 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618102:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x26:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826019.618106:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb3a0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb399 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618115:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb3a0 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb399 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618126:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb3a0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb399 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618160:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb3a0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb399 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.618173:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049143168:0@lo:105: 00000100:00100000:3.0:1787826019.618218:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.618257:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.618306:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787826019.618317:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049143168 00000100:00100000:3.0:1787826019.618321:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049143168 00000100:00100000:3.0:1787826019.618385:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4710 00000100:00100000:3.0:1787826019.618392:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049143168:12345-0@lo:105: 00010000:00010000:3.0:1787826019.618402:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618410:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618419:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618426:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618432:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618438:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.618451:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb4429cbe00) 00000100:00100000:3.0:1787826019.618484:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049143168:12345-0@lo:105: Request processed in 93us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.618490:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4710 00000100:00100000:3.0:1787826019.618539:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049143168:0@lo:105: 00010000:00010000:3.0:1787826019.618550:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826019.618586:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042904704:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 567us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.618593:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12134 00000100:00100000:3.0:1787826019.627097:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049143296 00000100:00100000:3.0:1787826019.627104:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049143296 00000100:00100000:3.0:1787826019.627158:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12302 00000100:00100000:3.0:1787826019.627168:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049143296:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1787826019.628859:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049143296:12345-0@lo:403:mdt00_003.0 Request processed in 1684us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.628872:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12302 00000004:00080000:3.0:1787826019.630281:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 606 rpc_version 606 00000020:00100000:3.0:1787826019.630310:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826019.630319:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472584380 x1874663049143552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826019.630398:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049143552:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.630450:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.630572:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826019.631481:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049143552:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826019.646176:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826019.646197:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.646213:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4429cbe00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826019.646223:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826019.646233:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.646396:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.646412:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826019.646453:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.646461:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4429cbe00/0x878a5eea00ceb399 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb3a0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.646517:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049143680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826019.646637:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.646732:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049143680 00000100:00100000:3.0:1787826019.646743:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049143680 00000100:00100000:3.0:1787826019.646823:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4178 00000100:00100000:3.0:1787826019.646834:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049143680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826019.646860:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826019.646886:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb3a0 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb399 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.646905:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x26:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826019.646916:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826019.646969:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049143680:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.646978:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4178 00000100:00100000:3.0:1787826019.647042:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049143680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826019.647072:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826019.647075:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826019.647078:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826019.661201:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.662504:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042904832 00000100:00100000:1.0:1787826019.662523:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042904832 00000100:00100000:1.0:1787826019.662608:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 637 00000100:00100000:1.0:1787826019.662621:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+41:155391:x1874663042904832:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826019.662652:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.662689:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00ceb3a7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ebc8 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662774:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662791:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662804:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662822:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662831:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662838:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662890:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662898:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662905:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.662912:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.663164:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663173:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663189:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.663192:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.663197:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663203:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00ceb3ae lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663220:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663227:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663233:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663239:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb46e31f400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.663241:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663248:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663256:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826019.663259:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.663263:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663269:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f400/0x878a5eea00ceb3b5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663304:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00ceb3a7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebc8 expref: 42 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663316:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.663319:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.663352:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00ceb3a7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebc8 expref: 42 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.663371:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:1.0:1787826019.663461:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+41:155391:x1874663042904832:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 841us (2274us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826019.663470:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 637 00000100:00100000:1.0:1787826019.673725:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042904960 00000100:00100000:1.0:1787826019.673739:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042904960 00000100:00100000:1.0:1787826019.673832:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 638 00000100:00100000:1.0:1787826019.673844:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+41:155391:x1874663042904960:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826019.673871:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.673900:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f600/0x878a5eea00ceb3bc lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ebcf expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.673987:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674005:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674018:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674033:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674043:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674050:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674103:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674111:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674119:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674126:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb46e31e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.674131:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674140:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674155:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.674158:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.674164:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674171:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31e200/0x878a5eea00ceb3c3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674676:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674683:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674689:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674695:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826019.674698:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674704:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674714:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826019.674717:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.674720:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674726:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb3ca lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674764:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f600/0x878a5eea00ceb3bc lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebcf expref: 42 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674775:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.674778:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.674781:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb46e31f600/0x878a5eea00ceb3bc lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebcf expref: 42 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.674791:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb46e31f600, rc 0) 00000100:00100000:1.0:1787826019.674869:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+41:155391:x1874663042904960:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1026us (1238us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826019.674879:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 638 00000100:00100000:1.0:1787826019.680864:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000004:00080000:3.0:1787826019.696381:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 607 rpc_version 607 00000020:00100000:3.0:1787826019.696437:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826019.696451:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472584e00 x1874663049143936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826019.696481:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049143936:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.696572:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.696615:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.698230:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049143936:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826019.699237:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049144064 00000100:00100000:1.0:1787826019.699247:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049144064 00000100:00100000:1.0:1787826019.699384:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12305 00000100:00100000:1.0:1787826019.699397:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a7ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187904:x1874663049144064:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787826019.699420:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.699453:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceb402 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb3fb expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.699483:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceb402 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb3fb expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.699498:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceb402 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb3fb expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.699507:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x27:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:1.0:1787826019.699510:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826019.699515:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357400, rc 0) 00000100:00100000:1.0:1787826019.699567:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a7ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187904:x1874663049144064:12345-0@lo:101:mdt00_000.0 Request processed in 173us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826019.699574:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12305 00000100:00100000:3.0:1787826019.732223:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042905472 00000100:00100000:3.0:1787826019.732239:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042905472 00000100:00100000:3.0:1787826019.732485:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 641 00000100:00100000:3.0:1787826019.732499:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155399:x1874663042905472:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826019.732534:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.732565:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb409 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ebdd expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734717:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734748:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734765:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734778:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734786:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734794:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734892:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb41e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734899:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb41e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.734906:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb41e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826019.736423:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb3:0x0]: returning size 4096 00000004:00200000:3.0:1787826019.736434:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826019.736543:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb41e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736564:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736572:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736580:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736587:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.736592:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736601:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736620:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.736624:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.736630:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736637:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb410 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736650:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736661:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736682:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736688:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcce00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.736690:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736696:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736704:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826019.736706:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.736710:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736715:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb417 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736762:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb409 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebdd expref: 45 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736778:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb41e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebdd expref: 44 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.736785:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb3:0x0].0x0 (ffff8eb449543800) 00010000:00010000:3.0:1787826019.736788:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826019.736791:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd600, rc 0) 00000100:00100000:3.0:1787826019.736911:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+44:155399:x1874663042905472:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 4413us (5206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.736922:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 641 00000100:00100000:1.0:1787826019.743202:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042905600 00000100:00100000:1.0:1787826019.743224:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042905600 00000100:00100000:1.0:1787826019.743343:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 642 00000100:00100000:1.0:1787826019.743356:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+44:155399:x1874663042905600:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826019.743392:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826019.743424:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb425 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ebe4 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.743527:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00ceb42c lrc: 3/1,0 mode: --/PR res: [0x200026560:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.743544:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00ceb42c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x27:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.743558:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00ceb42c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x27:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826019.743629:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x27:0x0]: returning size 4096 00000004:00200000:1.0:1787826019.743636:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826019.743693:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb425 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebe4 expref: 46 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.743911:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00ceb42c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x27:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebe4 expref: 45 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.743926:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x27:0x0].0x0 (ffff8eb449543a00) 00010000:00010000:1.0:1787826019.743930:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826019.743935:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357800, rc 0) 00000100:00100000:1.0:1787826019.744031:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:155399:x1874663042905600:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 677us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826019.744040:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 642 00000100:00100000:1.0:1787826019.746820:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:3.0:1787826019.763090:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceb402 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb3fb expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.763117:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x27:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:3.0:1787826019.763123:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb43a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x27:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.763144:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb43a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x27:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.763152:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb43a lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x27:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.763197:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826019.763314:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049144320:12345-0@lo:103:ldlm_bl.0 Request processed in 15232us (15323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.763358:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12135 00000100:00100000:3.0:1787826019.779877:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826019.779919:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042906112 00000100:00100000:3.0:1787826019.779932:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042906112 00010000:00010000:3.0:1787826019.779997:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00ceb42c lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x27:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebe4 expref: 45 pid: 188682 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.780044:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12136 00000100:00100000:3.0:1787826019.780056:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:2392:x1874663042906112:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826019.780078:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826019.780087:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00ceb42c lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x27:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebe4 expref: 45 pid: 188682 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.780103:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00ceb42c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x27:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebe4 expref: 45 pid: 188682 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.780133:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x27:0x0].0x0 (ffff8eb449543a00) 00010000:00010000:3.0:1787826019.780139:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb456 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x27:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.780150:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb456 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x27:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.781294:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb456 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x27:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.781351:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826019.781456:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:2392:x1874663042906112:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1396us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.781469:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12136 00010000:00010000:3.0:1787826019.781572:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00ceb42c lrc: 0/0,0 mode: --/PR res: [0x200026560:0x27:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebe4 expref: 44 pid: 188682 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.781594:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049144448:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826019.781626:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb456 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.781637:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb456 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.781644:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb456 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.781710:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.781720:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.781732:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.781754:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049144576:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826019.781815:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.781857:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.781880:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049144576 00000100:00100000:3.0:1787826019.781888:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049144576 00000100:00100000:3.0:1787826019.781932:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12306 00000100:00100000:3.0:1787826019.781941:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049144576:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826019.781962:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.781981:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb464 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb45d expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.782009:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb43a lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x27:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebeb expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.782020:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb464 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb45d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.782047:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb43a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x27:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebeb expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.782062:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb43a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x27:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebeb expref: 6 pid: 187906 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.782074:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049144704:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826019.782121:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826019.795437:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:0.0:1787826019.795732:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x27:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:0.0:1787826019.795741:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb464 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb45d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.795753:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb464 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00ceb45d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.795763:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb464 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00ceb45d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.795803:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb464 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb45d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826019.795818:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049144832:0@lo:105: 00000100:00100000:0.0:1787826019.795871:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826019.795911:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b600 going to sleep for 11 seconds 00010000:00010000:3.0:1787826019.797731:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb43a lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x27:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebeb expref: 7 pid: 187906 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.797760:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049144704:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826019.797802:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb464 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb45d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.797814:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x27:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:3.0:1787826019.797818:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826019.797822:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcce00, rc 0) 00000100:00100000:3.0:1787826019.797913:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049144576:12345-0@lo:101:mdt00_003.0 Request processed in 15971us (16096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.797923:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12306 00000100:00100000:3.0:1787826019.797978:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049144832 00000100:00100000:3.0:1787826019.797985:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049144832 00000100:00100000:3.0:1787826019.798026:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4712 00000100:00100000:3.0:1787826019.798036:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049144832:12345-0@lo:105: 00010000:00010000:3.0:1787826019.798050:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.798060:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.798070:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.798079:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.798088:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.798098:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.798114:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34bdcdc00) 00000100:00100000:3.0:1787826019.798150:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049144832:12345-0@lo:105: Request processed in 115us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.798155:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4712 00000100:00100000:3.0:1787826019.798183:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869789 gen 2 00000004:00080000:3.0:1787826019.798190:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869788 committed transno 17179869789 00000004:00080000:3.0:1787826019.798218:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869789 committed transno 17179869789 00000100:00100000:3.0:1787826019.798235:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049144576:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826019.798253:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826019.799046:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049144960:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1787826019.799119:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.799156:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.799195:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049144960 00000100:00100000:3.0:1787826019.799202:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049144960 00000100:00100000:3.0:1787826019.799245:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12307 00000100:00100000:3.0:1787826019.799254:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049144960:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1787826019.801511:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049144832:0@lo:105: 00010000:00010000:0.0:1787826019.801545:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826019.801624:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042906240:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 5978us (6200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826019.801637:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12137 00000100:00100000:3.0:1787826019.813892:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049144960:12345-0@lo:403:mdt00_003.0 Request processed in 14624us (14758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.813912:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12307 00000004:00080000:3.0:1787826019.815830:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 608 rpc_version 608 00000020:00100000:3.0:1787826019.815879:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826019.815893:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f6c0000 x1874663049145216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826019.815922:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049145216:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826019.816004:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826019.816051:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.822604:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049145216:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826019.823482:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826019.823490:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.823497:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcdc00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826019.823503:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826019.823511:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.823556:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.823564:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826019.823592:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.823600:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcdc00/0x878a5eea00ceb45d lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb464 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.823621:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826019.823623:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826019.823625:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826019.823645:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049145344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826019.825004:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826019.832481:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049145344 00000100:00100000:0.0:1787826019.832504:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049145344 00000100:00100000:0.0:1787826019.832616:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4179 00000100:00100000:0.0:1787826019.832630:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb449166c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049145344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826019.832653:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826019.832768:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb464 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb45d expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.832800:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x27:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:0.0:1787826019.832816:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826019.832923:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb449166c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049145344:12345-0@lo:103:ldlm_bl.0 Request processed in 297us (7927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826019.832942:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4179 00000100:00100000:3.0:1787826019.833542:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049145344:0@lo:103:ldlm_bl.0 00000001:02000400:3.0:1787826019.859478:0:188889:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 00000100:00100000:1.0:1787826019.876739:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826019.878086:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042906368 00000100:00100000:3.0:1787826019.878104:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042906368 00000100:00100000:3.0:1787826019.878202:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 645 00000100:00100000:3.0:1787826019.878215:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:155406:x1874663042906368:12345-192.168.203.47@tcp:101:lfs.0 00000100:00100000:0.0:1787826019.889716:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042906496 00000100:00100000:0.0:1787826019.889733:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042906496 00000100:00100000:0.0:1787826019.889817:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 646 00000100:00100000:0.0:1787826019.889830:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:155406:x1874663042906496:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826019.889859:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826019.889886:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb480 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ebf9 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.889968:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.889987:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.890000:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.890013:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.890021:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.890027:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.890078:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.890085:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.890093:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891401:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826019.891412:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891426:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891448:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826019.891452:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826019.891458:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891466:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb487 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891486:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891495:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891501:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891507:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826019.891510:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891516:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891524:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826019.891527:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826019.891531:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891537:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb48e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891584:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb480 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebf9 expref: 46 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891596:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826019.891599:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826019.891602:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb480 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ebf9 expref: 46 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.891613:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3600, rc 0) 00000100:00100000:0.0:1787826019.891718:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:155406:x1874663042906496:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1888us (2541us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826019.891856:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 646 00000100:00100000:3.0:1787826019.907228:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042906624 00000100:00100000:3.0:1787826019.907242:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042906624 00000100:00100000:3.0:1787826019.907363:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 647 00000100:00100000:3.0:1787826019.907385:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:155406:x1874663042906624:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826019.907413:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.907440:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec00 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.907532:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb49c lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.907552:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb49c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.907566:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb49c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826019.907630:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:3.0:1787826019.907635:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826019.907660:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb49c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.907705:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec00 expref: 47 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.907926:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb49c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec00 expref: 46 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.907937:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.907941:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826019.907947:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcdc00, rc 0) 00000100:00100000:3.0:1787826019.908075:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+46:155406:x1874663042906624:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 693us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.908084:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 647 00000100:00100000:3.0:1787826019.920847:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826019.920935:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042906880 00000100:00100000:1.0:1787826019.920949:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042906880 00000100:00100000:1.0:1787826019.921027:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 648 00000100:00100000:1.0:1787826019.921039:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+46:155406:x1874663042906880:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826019.921111:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826019.921147:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb49c lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec00 expref: 46 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.921167:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826019.921173:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826019.921248:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.921265:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.921276:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.921300:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.921312:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826019.921320:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826019.922606:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].420, 2152 off647496 00000040:00080000:1.0:1787826019.922708:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].291, 2352 off486096 00000004:00080000:1.0:1787826019.923114:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be53a80 with version 609 00000004:00080000:3.0:1787826019.925308:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 609 rpc_version 609 00000020:00100000:1.0:1787826019.925550:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826019.925569:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb348ffc000 x1874663049145600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826019.925603:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049145600:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826019.925710:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826019.925767:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826019.929968:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049145600:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826019.930775:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.930798:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.930812:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.930836:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.930843:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.930849:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.930896:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb4bf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.930904:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb4bf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.930915:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb4bf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826019.930943:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049145728:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826019.931027:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826019.931069:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826019.932003:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049145728 00000100:00100000:3.0:1787826019.932015:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049145728 00000100:00100000:3.0:1787826019.932092:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12310 00000100:00100000:3.0:1787826019.932104:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049145728:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826019.932132:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.932158:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb4c6 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb4bf expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.932190:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb4c6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb4bf expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.932206:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb4c6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb4bf expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.932215:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x28:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826019.932219:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.932223:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcc400, rc 0) 00000100:00100000:3.0:1787826019.932295:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049145728:12345-0@lo:101:mdt00_003.0 Request processed in 193us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.932302:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12310 00000100:00100000:0.0:1787826019.933050:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049145728:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826019.933074:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb4bf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb4c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933094:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb4bf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb4c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826019.933124:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071336633 reply state 00000000e16e716b transno 335007449164 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933140:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933147:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x28:0x0].0x0 (ffff8eb47f8fed00) 00010000:00010000:0.0:1787826019.933149:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826019.933153:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826019.933159:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb4bf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb4c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933167:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481ce3c00/0x878a5eea00ceb4bf lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb4c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826019.933186:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x28:0x0] 00000004:00010000:0.0:1787826019.933194:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071336633 reply state 00000000e16e716b transno 335007449164 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933202:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933207:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb4:0x0].0x0 (ffff8eb47f8fec00) 00010000:00010000:0.0:1787826019.933209:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826019.933211:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787826019.933217:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb4:0x0]: returning size 4096 00010000:00010000:0.0:1787826019.933229:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933236:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933243:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933250:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826019.933256:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933264:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933277:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826019.933279:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826019.933283:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933290:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00ceb4a3 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826019.933304:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071336633 reply state 00000000e16e716b transno 335007449164 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933315:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.933320:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826019.933351:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826019.933354:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787826019.933765:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155406:x1874663042906880:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 12724us (12928us total) trans 335007449164 rc 0/0 00000100:00100000:0.0:1787826019.933774:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 648 00000100:00100000:3.0:1787826019.964075:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042907008 00000100:00100000:3.0:1787826019.964089:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042907008 00000100:00100000:3.0:1787826019.964313:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 649 00000100:00100000:3.0:1787826019.964346:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155414:x1874663042907008:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826019.964389:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826019.964417:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb4cd lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec07 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964502:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964519:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964532:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964545:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964553:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964560:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964659:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb4e2 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964680:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb4e2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964687:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb4e2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826019.964811:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb4:0x0]: returning size 4096 00000004:00200000:3.0:1787826019.964817:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826019.964843:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb4e2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964858:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964864:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964871:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964877:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.964882:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964890:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964905:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826019.964908:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.964913:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964920:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb4d4 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964945:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964952:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964957:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964962:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826019.964965:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964970:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964976:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826019.964979:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826019.964982:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.964987:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb4db lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.965013:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb4cd lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec07 expref: 49 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.965028:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb4e2 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec07 expref: 48 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826019.965035:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb4:0x0].0x0 (ffff8eb47f8fec00) 00010000:00010000:3.0:1787826019.965037:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826019.965039:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdccc00, rc 0) 00000100:00100000:3.0:1787826019.965126:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+48:155414:x1874663042907008:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 801us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826019.973264:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 649 00000100:00100000:0.0:1787826019.984370:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042907136 00000100:00100000:0.0:1787826019.984383:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042907136 00000100:00100000:0.0:1787826019.984464:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 650 00000100:00100000:0.0:1787826019.984478:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+48:155414:x1874663042907136:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826019.984503:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826019.984527:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb4e9 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec0e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.984597:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb4f0 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.984615:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb4f0 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.984629:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb4f0 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826019.984710:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x28:0x0]: returning size 4096 00000004:00200000:0.0:1787826019.984717:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826019.984762:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb4e9 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec0e expref: 50 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.984784:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb4f0 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec0e expref: 49 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826019.984794:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x28:0x0].0x0 (ffff8eb47f8fed00) 00010000:00010000:0.0:1787826019.984798:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826019.984802:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fc00, rc 0) 00000100:00100000:0.0:1787826019.984873:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155414:x1874663042907136:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 398us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826019.984879:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 650 00000100:00100000:0.0:1787826020.005970:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:0.0:1787826020.009047:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:3.0:1787826020.012607:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869791 is committed 00010000:00010000:3.0:1787826020.013145:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb4fe lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.013155:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb4fe lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.013237:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x28:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.013244:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826020.013301:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb4f7 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec15 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.013321:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb4fe lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x28:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec15 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.013581:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049145984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.014479:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x28:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826020.014484:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826020.014489:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38400, rc 0) 00000100:00100000:3.0:1787826020.014582:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155414:x1874663042907264:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 8107us (8623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.014593:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 651 00000100:00100000:3.0:1787826020.022679:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826020.022733:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042907520 00000100:00100000:0.0:1787826020.022756:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042907520 00000100:00100000:0.0:1787826020.022854:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 652 00000100:00100000:0.0:1787826020.022870:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155414:x1874663042907520:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:0.0:1787826020.022942:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826020.022976:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb4e2 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec07 expref: 49 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.022997:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb4:0x0].0x0 (ffff8eb47f8fec00) 00010000:00010000:0.0:1787826020.023002:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826020.023031:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023048:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023059:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023070:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023082:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023089:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023183:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023191:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023196:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023216:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023226:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb4f0 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec0e expref: 48 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023236:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 4/0,1 mode: --/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023278:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb4f0 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec0e expref: 48 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.023294:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb4f0 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec0e expref: 48 pid: 187904 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.023310:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049146112:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826020.023444:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.032658:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:0.0:1787826020.034588:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb4f0 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec0e expref: 48 pid: 187904 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.034610:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049146112:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826020.034641:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.034650:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.034657:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.034732:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.034741:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.034752:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.034776:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049146240:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1787826020.034840:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.034885:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.034961:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049146240 00000100:00100000:3.0:1787826020.034977:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049146240 00000100:00100000:3.0:1787826020.035034:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12311 00000100:00100000:3.0:1787826020.035043:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049146240:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826020.035064:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.035093:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb528 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb521 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.035122:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb4fe lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec15 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.035132:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb528 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb521 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.035162:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb4fe lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec15 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.035176:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb4fe lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec15 expref: 6 pid: 187906 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.035188:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049146368:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826020.035253:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.038995:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:0.0:1787826020.039750:0:177390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb4fe lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec15 expref: 7 pid: 187906 timeout: 8186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.039767:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049146368:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826020.039802:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb528 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb521 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.039811:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x28:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:0.0:1787826020.039814:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826020.039817:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd000, rc 0) 00000100:00100000:0.0:1787826020.039876:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049146240:12345-0@lo:101:mdt00_000.0 Request processed in 4833us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.039886:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12311 00000100:00100000:3.0:1787826020.042090:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049146496 00000100:00100000:3.0:1787826020.042110:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049146496 00000100:00100000:3.0:1787826020.042262:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4714 00000100:00100000:3.0:1787826020.042276:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049146496:12345-0@lo:105: 00010000:00010000:3.0:1787826020.042298:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.042314:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.042351:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.042482:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.042493:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.042503:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.042525:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb479b3e800) 00000100:00100000:3.0:1787826020.042622:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049146496:12345-0@lo:105: Request processed in 349us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.042630:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4714 00000100:00100000:3.0:1787826020.042695:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049146496:0@lo:105: 00010000:00010000:3.0:1787826020.042724:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826020.042788:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042907776:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 3487us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.042797:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12140 00000100:00100000:2.0:1787826020.043591:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.043621:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.044068:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049146624 00000100:00100000:3.0:1787826020.044077:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049146624 00000100:00100000:3.0:1787826020.044131:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12312 00000100:00100000:3.0:1787826020.044140:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049146624:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787826020.051989:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049146624:12345-0@lo:403:mdt00_000.0 Request processed in 7836us (8384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.052009:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12312 00000100:00100000:2.0:1787826020.052106:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049146624:0@lo:403:mdt00_000.0 00000040:00080000:2.0:1787826020.053290:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].421, 656 off648152 00000040:00080000:2.0:1787826020.053555:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].292, 736 off486832 00000004:00080000:2.0:1787826020.053564:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be53a80 with version 610 00000004:00080000:3.0:1787826020.054142:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 610 rpc_version 610 00000020:00100000:3.0:1787826020.054190:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826020.054204:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f5f2d80 x1874663049146880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1696/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826020.054234:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049146880:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826020.054362:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.054401:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.054524:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049146880 00000100:00100000:0.0:1787826020.054535:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049146880 00000100:00100000:0.0:1787826020.054596:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12313 00000100:00100000:0.0:1787826020.054608:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049146880:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826020.054952:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049146880:12345-0@lo:1000:osp_up1-0.0 Request processed in 345us (628us total) trans 17179869792 rc 0/0 00000100:00100000:0.0:1787826020.054962:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12313 00000100:00100000:0.0:1787826020.055033:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049146880:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787826020.055259:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb4:0x0]: returning size 4096 00010000:00010000:0.0:1787826020.055285:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055297:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055306:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055313:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ec00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826020.055319:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055353:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055373:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x28:0x0].0x0 (ffff8eb47f8fed00) 00010000:00010000:0.0:1787826020.055377:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826020.055383:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 2/0,0 mode: --/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055390:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb51a lrc: 0/0,0 mode: --/EX res: [0x200026560:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055408:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055418:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055426:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055446:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826020.055456:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x28:0x0] 00010000:00010000:0.0:1787826020.055463:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055469:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055475:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055484:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ea00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826020.055487:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055493:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055502:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb4:0x0].0x0 (ffff8eb47f8fec00) 00010000:00010000:0.0:1787826020.055504:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826020.055508:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055514:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb513 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055529:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055536:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055542:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055547:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826020.055550:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055557:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055567:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826020.055570:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826020.055573:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055578:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb505 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826020.055587:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000311ecb54 reply state 000000007d4db359 transno 335007449165 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055599:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.055606:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826020.055609:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826020.055611:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826020.055824:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826020.055833:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.055841:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e800 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826020.055845:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826020.055854:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.055890:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.055899:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826020.055926:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.055934:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3e800/0x878a5eea00ceb521 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb528 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.055954:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826020.055956:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826020.055958:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826020.055968:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826020.055987:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049147008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826020.056043:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.056103:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049147008 00000100:00100000:3.0:1787826020.056111:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049147008 00000100:00100000:3.0:1787826020.056159:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4180 00000100:00100000:3.0:1787826020.056169:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3619:x1874663049147008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.056182:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.056203:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb528 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb521 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.056215:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x28:0x0].0x0 (ffff8eb476e51a00) 00010000:00010000:3.0:1787826020.056225:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826020.056253:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049147008:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.056260:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4180 00000100:00100000:3.0:1787826020.056292:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049147008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826020.056531:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155414:x1874663042907520:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 33662us (33878us total) trans 335007449165 rc 0/0 00000100:00100000:0.0:1787826020.056540:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 652 00000100:00100000:0.0:1787826020.083203:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.083369:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042907904 00000100:00100000:1.0:1787826020.083389:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042907904 00000100:00100000:1.0:1787826020.083463:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 653 00000100:00100000:1.0:1787826020.083477:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155433:x1874663042907904:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826020.083511:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826020.083540:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb52f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec1c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083633:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083652:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083682:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083696:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083705:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083713:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083768:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083777:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083785:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083791:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.083797:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083805:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083820:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.083824:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.083830:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083836:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb536 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083850:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083856:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083863:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083869:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.083872:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083878:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083885:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.083888:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.083891:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083897:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb53d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083930:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb52f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec1c expref: 50 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083941:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.083943:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.083947:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb52f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec1c expref: 50 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.083957:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356e00, rc 0) 00000100:00100000:1.0:1787826020.084037:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155433:x1874663042907904:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 563us (848us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826020.084045:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 653 00000100:00100000:1.0:1787826020.086876:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.086951:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042908032 00000100:00100000:3.0:1787826020.086963:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042908032 00000100:00100000:3.0:1787826020.087034:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 654 00000100:00100000:3.0:1787826020.087048:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155433:x1874663042908032:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826020.087144:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.087172:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb544 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec23 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087254:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087277:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087378:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087392:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087400:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087407:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087461:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087469:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087477:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087483:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.087488:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087497:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087511:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.087515:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.087520:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087527:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb54b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087540:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087546:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087552:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087558:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.087561:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087571:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087579:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826020.087581:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.087584:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087590:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb552 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087621:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb544 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec23 expref: 50 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087633:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.087635:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.087639:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb544 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec23 expref: 50 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.087649:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd000, rc 0) 00000100:00100000:3.0:1787826020.087795:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155433:x1874663042908032:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 751us (935us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826020.087803:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 654 00000100:00100000:1.0:1787826020.090563:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.090936:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042908160 00000100:00100000:3.0:1787826020.090948:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042908160 00000100:00100000:3.0:1787826020.091020:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 655 00000100:00100000:3.0:1787826020.091033:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155433:x1874663042908160:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826020.091130:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.091159:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec2a expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.091245:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb560 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.091263:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb560 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.091277:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb560 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.091367:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.091381:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826020.091408:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb560 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.091439:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec2a expref: 51 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.091459:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb560 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec2a expref: 50 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.091470:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.091474:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826020.091478:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd400, rc 0) 00000100:00100000:3.0:1787826020.091546:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+50:155433:x1874663042908160:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 516us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.091557:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 655 00000100:00100000:3.0:1787826020.095541:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.095594:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042908416 00000100:00100000:3.0:1787826020.095608:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042908416 00000100:00100000:3.0:1787826020.095696:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 656 00000100:00100000:3.0:1787826020.095709:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+50:155433:x1874663042908416:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:3.0:1787826020.095782:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.095815:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb560 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec2a expref: 50 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.095835:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.095841:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826020.095917:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.095934:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.095946:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.095960:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.095972:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.095980:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826020.099648:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].422, 2152 off650304 00000040:00080000:2.0:1787826020.099770:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].293, 2352 off489184 00000004:00080000:2.0:1787826020.099778:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be53900 with version 611 00000004:00080000:0.0:1787826020.099876:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 611 rpc_version 611 00000020:00100000:0.0:1787826020.099927:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826020.099942:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34bdf5500 x1874663049147264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826020.099970:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049147264:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826020.100139:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.100186:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.100198:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049147264 00000100:00100000:2.0:1787826020.100209:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049147264 00000100:00100000:2.0:1787826020.100279:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12314 00000100:00100000:2.0:1787826020.100290:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049147264:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826020.100985:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049147264:12345-0@lo:1000:osp_up1-0.0 Request processed in 694us (844us total) trans 17179869793 rc 0/0 00000100:00100000:2.0:1787826020.100995:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12314 00000100:00100000:0.0:1787826020.101076:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049147264:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787826020.101202:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.101221:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.101234:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.101255:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 3/0,1 mode: --/PW res: [0x200026560:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.101268:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.101274:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.101310:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.101318:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.101554:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.101575:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049147392:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787826020.101619:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.101639:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.101714:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049147392 00000100:00100000:0.0:1787826020.101723:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049147392 00000100:00100000:0.0:1787826020.101772:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12315 00000100:00100000:0.0:1787826020.101780:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049147392:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826020.101799:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826020.101821:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb58a lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb583 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.101845:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb58a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb583 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.101858:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb58a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb583 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.101868:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x29:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:0.0:1787826020.101871:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826020.101875:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ec00, rc 0) 00000100:00100000:0.0:1787826020.101922:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049147392:12345-0@lo:101:mdt00_003.0 Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.102608:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049147392:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826020.102631:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102645:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.102687:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f86f8704 reply state 000000008f1bbe30 transno 335007449166 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102703:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102712:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x29:0x0].0x0 (ffff8eb449aac000) 00010000:00010000:2.0:1787826020.102714:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826020.102717:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826020.102724:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102734:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826020.102746:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x29:0x0] 00000004:00010000:2.0:1787826020.102756:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f86f8704 reply state 000000008f1bbe30 transno 335007449166 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102764:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102770:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb5:0x0].0x0 (ffff8eb449aac100) 00010000:00010000:2.0:1787826020.102773:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826020.102775:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787826020.102782:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb5:0x0]: returning size 4096 00010000:00010000:2.0:1787826020.102793:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102800:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102808:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102815:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdccc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.102821:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102830:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102843:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.102845:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.102849:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102856:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb567 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.102870:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f86f8704 reply state 000000008f1bbe30 transno 335007449166 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102879:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.102885:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826020.102888:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826020.102890:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787826020.102999:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155433:x1874663042908416:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 7290us (7468us total) trans 335007449166 rc 0/0 00000100:00100000:2.0:1787826020.103008:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 656 00000100:00100000:0.0:1787826020.103080:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12315 00000100:00100000:1.0:1787826020.132772:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.135450:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042908544 00000100:00100000:3.0:1787826020.135473:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042908544 00000100:00100000:3.0:1787826020.135577:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 657 00000100:00100000:3.0:1787826020.135589:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155445:x1874663042908544:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826020.135623:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.135651:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb591 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec31 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135754:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135772:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135786:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135798:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135806:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135812:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135919:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb5a6 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135928:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb5a6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.135935:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb5a6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.136048:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb5:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.136066:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826020.136094:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb5a6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136107:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136114:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136121:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136128:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.136133:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136140:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136154:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.136158:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.136163:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136168:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb598 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136187:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136194:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136200:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136205:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.136208:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136213:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136220:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826020.136223:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.136226:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136231:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb59f lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136260:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb591 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec31 expref: 53 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136273:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb5a6 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec31 expref: 52 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.136547:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb5:0x0].0x0 (ffff8eb449aac100) 00010000:00010000:3.0:1787826020.136550:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826020.136554:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd800, rc 0) 00000100:00100000:3.0:1787826020.136659:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+52:155445:x1874663042908544:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1069us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.136676:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 657 00000100:00100000:1.0:1787826020.144613:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.146107:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042908672 00000100:00100000:2.0:1787826020.146126:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042908672 00000100:00100000:2.0:1787826020.146217:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 658 00000100:00100000:2.0:1787826020.146230:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+52:155445:x1874663042908672:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826020.146258:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.146550:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5ad lrc: 2/0,0 mode: --/CR res: [0x200026560:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec38 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.146629:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.146645:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.146671:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826020.146749:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x29:0x0]: returning size 4096 00000004:00200000:2.0:1787826020.146755:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826020.146800:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5ad lrc: 0/0,0 mode: --/CR res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 54 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.146823:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 53 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.146833:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x29:0x0].0x0 (ffff8eb449aac000) 00010000:00010000:2.0:1787826020.146837:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826020.146841:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39600, rc 0) 00000100:00100000:2.0:1787826020.146932:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155445:x1874663042908672:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 703us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.146941:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 658 00000100:00100000:2.0:1787826020.161138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.161253:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042908800 00000100:00100000:3.0:1787826020.161268:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042908800 00000100:00100000:3.0:1787826020.161382:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 659 00000100:00100000:3.0:1787826020.161393:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155445:x1874663042908800:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826020.161413:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.161432:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb5bb lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec3f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.166545:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.166587:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb58a lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb583 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.166597:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.166673:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb58a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb583 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.166696:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049147520:0@lo:104: 00000100:00100000:2.0:1787826020.166855:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.166933:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.167039:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049147520 00000100:00100000:3.0:1787826020.167119:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049147520 00000100:00100000:3.0:1787826020.167194:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4715 00000100:00100000:3.0:1787826020.167205:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049147520:12345-0@lo:104: 00010000:00010000:3.0:1787826020.167221:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.167519:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049147520:0@lo:104: 00010000:00010000:2.0:1787826020.167556:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.167823:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826020.167831:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049147520:12345-0@lo:104: Request processed in 628us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.167841:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4715 00010000:00010000:2.0:1787826020.168140:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826020.168148:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.168159:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826020.168167:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.168177:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.168216:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.168224:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826020.168254:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.168263:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38000/0x878a5eea00ceb583 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb58a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.168537:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049147648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826020.168537:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.168540:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.168542:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826020.168597:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.168807:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049147648 00000100:00100000:2.0:1787826020.168815:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049147648 00010000:00010000:2.0:1787826020.168850:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb58a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ceb583 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.168893:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12141 00000100:00100000:2.0:1787826020.168903:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3617:x1874663049147648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826020.168918:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787826020.174884:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869793 is committed 00010000:00010000:2.0:1787826020.175068:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb58a lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb583 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.175096:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x29:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:2.0:1787826020.175104:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.175116:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.175130:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.175174:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826020.175306:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049147648:12345-0@lo:103:ldlm_bl.0 Request processed in 6403us (6706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.175317:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12141 00000100:00100000:3.0:1787826020.175491:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049147648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826020.175634:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.175645:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826020.175736:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x29:0x0]: returning size 4096 00000004:00200000:1.0:1787826020.175744:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826020.175801:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb5bb lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.175820:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.175829:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x29:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:1.0:1787826020.175832:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826020.175835:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39400, rc 0) 00000100:00100000:1.0:1787826020.175905:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155445:x1874663042908800:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 14514us (14782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.175913:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 659 00000100:00100000:1.0:1787826020.178840:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.178927:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042909056 00000100:00100000:3.0:1787826020.178939:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042909056 00000100:00100000:3.0:1787826020.179010:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 660 00000100:00100000:3.0:1787826020.179022:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155445:x1874663042909056:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:3.0:1787826020.179137:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.179174:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb5a6 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec31 expref: 53 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179198:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb5:0x0].0x0 (ffff8eb449aac100) 00010000:00010000:3.0:1787826020.179204:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826020.179233:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179248:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179259:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179272:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179297:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179304:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179437:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179446:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179452:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179473:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,1 mode: --/EX res: [0x200026560:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179484:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 52 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179492:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 4/0,1 mode: --/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179531:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 52 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.179546:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 52 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.179564:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049147776:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826020.179677:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787826020.182834:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826020.182975:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.183046:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042909184 00000100:00100000:2.0:1787826020.183068:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042909184 00010000:00010000:2.0:1787826020.183122:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 53 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.183170:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12142 00000100:00100000:2.0:1787826020.183181:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:2392:x1874663042909184:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826020.183199:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826020.183206:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 53 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.183221:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 53 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.183247:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x29:0x0].0x0 (ffff8eb449aac000) 00010000:00010000:2.0:1787826020.183254:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,1 mode: --/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.183265:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.183277:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.183306:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826020.183460:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:2392:x1874663042909184:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 279us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.183468:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12142 00010000:00010000:3.0:1787826020.184252:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb5b4 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec38 expref: 52 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.184278:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049147776:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826020.184318:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.184344:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.184350:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.185145:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.185158:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.185175:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.185209:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049147904:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826020.185859:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.185915:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.186167:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049147904 00000100:00100000:2.0:1787826020.186177:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049147904 00000100:00100000:2.0:1787826020.186252:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12316 00000100:00100000:2.0:1787826020.186263:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049147904:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826020.189100:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.189151:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5ec lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb5e5 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.189203:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.189215:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5ec lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb5e5 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.189268:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.189290:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 6 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.189316:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049148032:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826020.189460:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.206503:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.206927:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042909312 00000100:00100000:3.0:1787826020.206940:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042909312 00010000:00010000:3.0:1787826020.206998:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.207062:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12143 00000100:00100000:3.0:1787826020.207074:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb449167c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2391:x1874663042909312:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.207093:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.207103:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.207119:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.207147:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x29:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:3.0:1787826020.207155:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5ec lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb5e5 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.207167:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5ec lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00ceb5e5 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.207176:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5ec lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00ceb5e5 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.207222:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5ec lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb5e5 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.207239:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049148160:0@lo:105: 00000100:00100000:3.0:1787826020.207309:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.207365:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049148160 00000100:00100000:0.0:1787826020.207370:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049148160 00000100:00100000:3.0:1787826020.207392:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.207413:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4716 00000100:00100000:0.0:1787826020.207421:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049148160:12345-0@lo:105: 00010000:00010000:0.0:1787826020.207433:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.207448:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.207457:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.207465:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.207474:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.207482:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.207498:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34bdcce00) 00000100:00100000:0.0:1787826020.207550:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049148160:12345-0@lo:105: Request processed in 129us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.207558:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4716 00010000:00010000:2.0:1787826020.207847:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5c2 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec3f expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.207867:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049148032:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826020.207899:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5ec lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb5e5 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.207907:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x29:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:2.0:1787826020.207910:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826020.207913:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38000, rc 0) 00000100:00100000:2.0:1787826020.207967:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049147904:12345-0@lo:101:mdt00_003.0 Request processed in 21706us (22109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.207975:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12316 00000100:00100000:0.0:1787826020.208031:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869793 gen 2 00000004:00080000:0.0:1787826020.208038:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869792 committed transno 17179869793 00000004:00080000:0.0:1787826020.208067:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869793 committed transno 17179869793 00000100:00100000:0.0:1787826020.208085:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049147904:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826020.208113:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.209433:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049148160:0@lo:105: 00010000:00010000:3.0:1787826020.209455:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826020.209527:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb449167c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042909312:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 2453us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.209541:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12143 00000100:00100000:1.0:1787826020.209792:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049148288:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787826020.209850:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.209884:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.210458:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049148288 00000100:00100000:3.0:1787826020.210467:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049148288 00000100:00100000:3.0:1787826020.210516:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12317 00000100:00100000:3.0:1787826020.210524:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049148288:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1787826020.214413:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049148288:12345-0@lo:403:mdt00_003.0 Request processed in 3875us (4549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.214430:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12317 00000100:00100000:1.0:1787826020.216256:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049148288:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1787826020.218137:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].423, 656 off650960 00000040:00080000:1.0:1787826020.218449:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].294, 736 off489920 00000004:00080000:1.0:1787826020.218458:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34896bb40 with version 612 00000004:00080000:0.0:1787826020.218515:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 612 rpc_version 612 00000020:00100000:0.0:1787826020.218559:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826020.218570:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34bdf5500 x1874663049148544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826020.218598:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049148544:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826020.218700:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.218799:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.218903:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049148544 00000100:00100000:2.0:1787826020.218912:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049148544 00000100:00100000:2.0:1787826020.218973:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12318 00000100:00100000:2.0:1787826020.218982:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049148544:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826020.219310:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049148544:12345-0@lo:1000:osp_up1-0.0 Request processed in 329us (610us total) trans 17179869794 rc 0/0 00000100:00100000:2.0:1787826020.219317:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12318 00000100:00100000:0.0:1787826020.219552:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049148544:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826020.220760:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb5:0x0]: returning size 4096 00010000:00010000:1.0:1787826020.220798:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220811:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220820:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220827:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcdc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.220834:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220843:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220866:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x29:0x0].0x0 (ffff8eb449aac000) 00010000:00010000:1.0:1787826020.220869:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826020.220877:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 2/0,0 mode: --/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220886:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb5de lrc: 0/0,0 mode: --/EX res: [0x200026560:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220904:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220913:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220921:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220954:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826020.220966:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x29:0x0] 00010000:00010000:1.0:1787826020.220974:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220981:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220988:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.220994:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.220997:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221004:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221018:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb5:0x0].0x0 (ffff8eb449aac100) 00010000:00010000:1.0:1787826020.221020:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826020.221024:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221030:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb5d7 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221048:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221066:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221072:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221078:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.221081:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221088:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221097:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.221099:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.221102:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221109:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb5c9 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.221124:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd9c8c2d reply state 0000000047e9fe06 transno 335007449167 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221139:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.221147:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.221149:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.221153:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826020.221265:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155445:x1874663042909056:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 42239us (42435us total) trans 335007449167 rc 0/0 00000100:00100000:1.0:1787826020.221277:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 660 00010000:00010000:2.0:1787826020.222197:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826020.222208:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.222225:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcce00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826020.222231:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.222241:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.222304:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.222312:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826020.222371:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.222379:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb5e5 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb5ec expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.222405:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.222406:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.222408:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826020.222467:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049148672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826020.222535:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.222683:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049148672 00000100:00100000:2.0:1787826020.222692:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049148672 00000100:00100000:2.0:1787826020.222764:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4181 00000100:00100000:2.0:1787826020.222775:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049148672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826020.222790:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826020.222812:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5ec lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb5e5 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.222833:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x29:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:2.0:1787826020.222845:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826020.222892:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049148672:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.222900:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4181 00000100:00100000:0.0:1787826020.223675:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049148672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826020.248209:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.248519:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042909440 00000100:00100000:2.0:1787826020.248534:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042909440 00000100:00100000:2.0:1787826020.248621:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 661 00000100:00100000:2.0:1787826020.248634:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155458:x1874663042909440:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826020.248674:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.248702:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5f3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec46 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248801:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248821:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248834:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248847:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 24 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248856:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248864:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248926:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248934:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248942:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248949:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.248955:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248964:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248979:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.248982:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.248987:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.248994:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb5fa lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249010:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249016:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249022:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249027:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.249031:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249036:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249043:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826020.249046:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.249177:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249186:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb601 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249223:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5f3 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec46 expref: 54 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249234:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.249237:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.249240:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb5f3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec46 expref: 54 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.249250:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38000, rc 0) 00000100:00100000:2.0:1787826020.249672:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155458:x1874663042909440:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1027us (1467us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826020.249682:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 661 00000100:00100000:3.0:1787826020.267030:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.269255:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042909568 00000100:00100000:2.0:1787826020.269351:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042909568 00000100:00100000:2.0:1787826020.269624:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 662 00000100:00100000:2.0:1787826020.269638:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155458:x1874663042909568:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826020.269676:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.269709:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb608 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec4d expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269807:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269825:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269839:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269852:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 24 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269861:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269868:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269921:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269928:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269936:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269943:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.269949:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269957:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269970:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.269973:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.269979:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.269986:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb60f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270001:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270008:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270015:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270020:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.270023:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270029:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270041:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826020.270044:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.270047:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270066:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb616 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270100:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb608 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec4d expref: 54 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270111:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.270113:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.270117:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb608 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec4d expref: 54 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.270128:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38000, rc 0) 00000100:00100000:2.0:1787826020.270560:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155458:x1874663042909568:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 921us (3541us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826020.270571:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 662 00000100:00100000:3.0:1787826020.273476:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.273613:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042909696 00000100:00100000:1.0:1787826020.273627:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042909696 00000100:00100000:1.0:1787826020.273709:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 663 00000100:00100000:1.0:1787826020.273733:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155458:x1874663042909696:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826020.273761:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826020.273787:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb61d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec54 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.273875:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb624 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.273891:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb624 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.273904:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb624 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826020.273969:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:1.0:1787826020.273974:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826020.274000:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb624 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.274033:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb61d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec54 expref: 55 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.274737:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb624 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec54 expref: 54 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.274751:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.274755:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826020.274759:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356000, rc 0) 00000100:00100000:1.0:1787826020.276812:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+54:155458:x1874663042909696:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 3064us (3337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.276829:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 663 00000100:00100000:0.0:1787826020.290174:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.290912:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042909952 00000100:00100000:1.0:1787826020.290932:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042909952 00000100:00100000:1.0:1787826020.291019:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 664 00000100:00100000:1.0:1787826020.291032:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+54:155458:x1874663042909952:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826020.291115:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826020.291151:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb624 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec54 expref: 54 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.291183:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.291190:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826020.291275:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.291292:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.291304:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.291315:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 24 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.292152:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.292169:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826020.297087:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].424, 2152 off653112 00000040:00080000:1.0:1787826020.297197:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].296, 2352 off493872 00000004:00080000:1.0:1787826020.297204:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34896bd80 with version 613 00000004:00080000:0.0:1787826020.300568:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 613 rpc_version 613 00000020:00100000:0.0:1787826020.300652:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826020.300676:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34bdf5c00 x1874663049148928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826020.300708:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049148928:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826020.301036:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.301135:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.303864:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049148928 00000100:00100000:2.0:1787826020.303888:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049148928 00000100:00100000:2.0:1787826020.304064:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12319 00000100:00100000:2.0:1787826020.304079:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049148928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826020.305874:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049148928:12345-0@lo:1000:osp_up1-0.0 Request processed in 1788us (4827us total) trans 17179869795 rc 0/0 00000100:00100000:2.0:1787826020.305888:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12319 00000100:00100000:1.0:1787826020.315649:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049148928:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826020.316073:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316093:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316108:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316134:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316142:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316149:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316201:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316209:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316220:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.316246:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049149056:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826020.316368:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.316536:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413749c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.316586:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049149056 00000100:00100000:3.0:1787826020.316594:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049149056 00000100:00100000:3.0:1787826020.316668:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12320 00000100:00100000:3.0:1787826020.316683:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049149056:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826020.316708:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.316782:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb64e lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb647 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316813:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb64e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb647 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316827:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb64e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb647 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.316837:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2a:0x0].0x0 (ffff8eb472727400) 00010000:00010000:3.0:1787826020.316841:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.316846:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd000, rc 0) 00000100:00100000:3.0:1787826020.316899:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049149056:12345-0@lo:101:mdt00_003.0 Request processed in 220us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.316908:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12320 00000100:00100000:2.0:1787826020.316945:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049149056:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826020.316967:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.316980:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.317017:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057b28ae4 reply state 000000000dc2e42e transno 335007449168 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.317032:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.317040:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2a:0x0].0x0 (ffff8eb472727600) 00010000:00010000:2.0:1787826020.317043:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826020.317047:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826020.317614:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.317628:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826020.317646:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2a:0x0] 00000004:00010000:3.0:1787826020.318224:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057b28ae4 reply state 000000000dc2e42e transno 335007449168 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318244:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318254:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb6:0x0].0x0 (ffff8eb472727000) 00010000:00010000:3.0:1787826020.318256:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826020.318260:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826020.318269:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb6:0x0]: returning size 4096 00010000:00010000:3.0:1787826020.318280:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318288:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318295:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318302:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.318307:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318315:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318366:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.318376:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.318387:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318393:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb62b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826020.318413:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057b28ae4 reply state 000000000dc2e42e transno 335007449168 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318423:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.318430:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826020.318432:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826020.318435:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826020.318558:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155458:x1874663042909952:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 27523us (28394us total) trans 335007449168 rc 0/0 00000100:00100000:3.0:1787826020.318568:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 664 00000100:00100000:3.0:1787826020.329311:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.330027:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042910080 00000100:00100000:2.0:1787826020.330042:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042910080 00000100:00100000:2.0:1787826020.330142:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 665 00000100:00100000:2.0:1787826020.330154:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155469:x1874663042910080:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826020.330186:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.330217:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb655 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec5b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.332881:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.332909:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.332923:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.332934:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.332941:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.332947:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.333102:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb66a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.333110:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb66a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.333116:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb66a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826020.333253:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb6:0x0]: returning size 4096 00000004:00200000:2.0:1787826020.333260:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826020.334194:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb66a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.334224:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.334232:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.334240:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.334246:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.334251:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.334260:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336364:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.336379:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.336392:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336404:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb65c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336433:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336440:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336448:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336456:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.336461:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336469:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336486:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826020.336489:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.336493:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336499:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb663 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336552:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb655 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec5b expref: 57 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336569:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb66a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec5b expref: 56 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.336576:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb6:0x0].0x0 (ffff8eb472727000) 00010000:00010000:2.0:1787826020.336578:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826020.336581:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39c00, rc 0) 00000100:00100000:3.0:1787826020.338806:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+56:155469:x1874663042910080:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 8636us (9506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.338823:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 665 00000100:00100000:1.0:1787826020.348389:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.348498:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042910208 00000100:00100000:2.0:1787826020.348511:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042910208 00000100:00100000:2.0:1787826020.348588:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 666 00000100:00100000:2.0:1787826020.348599:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+56:155469:x1874663042910208:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826020.348626:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.348650:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb671 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec62 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.348749:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.348767:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.348780:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826020.348856:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x2a:0x0]: returning size 4096 00000004:00200000:2.0:1787826020.348862:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826020.348908:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb671 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 58 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.348930:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 57 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.348940:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2a:0x0].0x0 (ffff8eb472727600) 00010000:00010000:2.0:1787826020.348943:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826020.348949:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38200, rc 0) 00000100:00100000:2.0:1787826020.349034:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155469:x1874663042910208:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 436us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.349041:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 666 00000100:00100000:1.0:1787826020.357946:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.358067:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042910336 00000100:00100000:2.0:1787826020.358081:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042910336 00000100:00100000:2.0:1787826020.358165:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 667 00000100:00100000:2.0:1787826020.358177:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155469:x1874663042910336:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826020.358217:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.358248:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb67f lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec69 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.358385:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.358403:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb64e lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb647 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.358413:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.358468:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb64e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb647 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.358488:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049149184:0@lo:104: 00000100:00100000:2.0:1787826020.358558:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.358604:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.358974:0:9494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787826020.358992:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049149184 00000100:00100000:0.0:1787826020.358997:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049149184 00000100:00100000:0.0:1787826020.359048:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4717 00000100:00100000:0.0:1787826020.359058:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345760c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049149184:12345-0@lo:104: 00010000:00010000:0.0:1787826020.359073:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.359149:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826020.359155:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345760c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049149184:12345-0@lo:104: Request processed in 100us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.359163:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4717 00010000:00010000:0.0:1787826020.359264:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826020.359271:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.359281:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcce00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826020.359288:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826020.359298:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.359353:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.359360:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826020.359385:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.359393:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcce00/0x878a5eea00ceb647 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb64e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.359417:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826020.359419:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826020.359421:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826020.359435:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049149312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826020.359480:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.359527:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049149312 00000100:00100000:0.0:1787826020.359532:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049149312 00010000:00010000:0.0:1787826020.359553:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb64e lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ceb647 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.359577:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12144 00000100:00100000:0.0:1787826020.359585:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3619:x1874663049149312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826020.359596:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826020.360957:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049149184:0@lo:104: 00010000:00010000:1.0:1787826020.360994:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826020.375552:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869795 is committed 00010000:00010000:0.0:1787826020.375805:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb64e lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb647 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.375832:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2a:0x0].0x0 (ffff8eb472727400) 00010000:00010000:0.0:1787826020.375838:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.375850:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.375859:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.375902:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826020.376016:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049149312:12345-0@lo:103:ldlm_bl.0 Request processed in 16430us (16533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.376029:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12144 00010000:00010000:1.0:1787826020.376316:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.376364:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826020.376443:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x2a:0x0]: returning size 4096 00000004:00200000:1.0:1787826020.376460:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826020.376519:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb67f lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.376537:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.376545:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2a:0x0].0x0 (ffff8eb472727400) 00010000:00010000:1.0:1787826020.376548:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826020.376551:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39200, rc 0) 00000100:00100000:1.0:1787826020.376621:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155469:x1874663042910336:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 18446us (18691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.376629:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 667 00000100:00100000:3.0:1787826020.377010:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049149312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826020.382478:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.382627:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042910592 00000100:00100000:2.0:1787826020.382641:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042910592 00000100:00100000:2.0:1787826020.382739:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 668 00000100:00100000:2.0:1787826020.382751:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155469:x1874663042910592:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:2.0:1787826020.382825:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826020.382860:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb66a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec5b expref: 57 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.382890:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb6:0x0].0x0 (ffff8eb472727000) 00010000:00010000:2.0:1787826020.382896:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826020.382924:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.382940:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.382952:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.382963:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.382975:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.382981:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.383090:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.383098:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.383104:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.383123:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.383134:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 56 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.383142:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.383182:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 56 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.383199:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 56 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.383216:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049149440:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826020.386675:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.396077:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.396258:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042910720 00000100:00100000:1.0:1787826020.396272:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042910720 00010000:00010000:1.0:1787826020.396396:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 57 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.396675:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049149440:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826020.396718:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.396866:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12145 00000100:00100000:1.0:1787826020.396880:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:2390:x1874663042910720:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826020.396899:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826020.396908:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 57 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.396922:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 57 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.396950:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb678 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec62 expref: 57 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.396968:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2a:0x0].0x0 (ffff8eb472727600) 00010000:00010000:1.0:1787826020.396973:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.396985:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.396993:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.397024:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826020.397097:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+56:2390:x1874663042910720:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 220us (1036us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826020.397141:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.397150:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.397207:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.397227:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.397240:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.397263:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049149568:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787826020.397318:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.397389:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049149568 00000100:00100000:3.0:1787826020.397394:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049149568 00000100:00100000:3.0:1787826020.397438:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12321 00000100:00100000:3.0:1787826020.397458:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049149568:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826020.397477:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.397495:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb6a9 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.397519:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.397529:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.397561:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.397576:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 6 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.397589:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049149696:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826020.397640:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413749c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.397656:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.399523:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12145 00000100:00100000:1.0:1787826020.404319:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.404742:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049149696:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826020.404789:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.404806:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2a:0x0].0x0 (ffff8eb472727400) 00010000:00010000:3.0:1787826020.404809:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826020.404814:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.404827:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.404834:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcdc00, rc 0) 00000100:00100000:3.0:1787826020.404910:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049149568:12345-0@lo:101:mdt00_000.0 Request processed in 7464us (7590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.404920:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12321 00000100:00100000:0.0:1787826020.405149:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869795 gen 2 00000004:00080000:0.0:1787826020.405157:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869794 committed transno 17179869795 00000004:00080000:0.0:1787826020.405183:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869795 committed transno 17179869795 00000100:00100000:0.0:1787826020.405209:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049149568:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787826020.405241:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.405253:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.410163:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042910848 00000100:00100000:2.0:1787826020.410183:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042910848 00010000:00010000:3.0:1787826020.419875:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 7 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.419950:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12146 00000100:00100000:3.0:1787826020.419963:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342777800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042910848:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.419983:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.419991:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 7 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.420006:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 7 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.420035:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb686 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec69 expref: 7 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.421856:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2a:0x0].0x0 (ffff8eb472727400) 00010000:00010000:3.0:1787826020.421877:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.421895:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.421906:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.421975:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.422002:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049149824:0@lo:105: 00000100:00100000:3.0:1787826020.422203:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.422386:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413749c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.422600:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049149824 00000100:00100000:0.0:1787826020.422613:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049149824 00000100:00100000:0.0:1787826020.423892:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4718 00000100:00100000:0.0:1787826020.423917:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049149824:12345-0@lo:105: 00010000:00010000:0.0:1787826020.423938:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.423951:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.423962:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.423973:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.423982:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.423998:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.424038:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34bdcc600) 00000100:00100000:0.0:1787826020.424219:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049149824:12345-0@lo:105: Request processed in 313us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.424228:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4718 00010000:00010000:1.0:1787826020.424313:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.424341:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.425173:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049149952:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787826020.425257:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.425306:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.425455:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049149952 00000100:00100000:3.0:1787826020.425465:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049149952 00000100:00100000:3.0:1787826020.425516:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12322 00000100:00100000:3.0:1787826020.425526:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049149952:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787826020.426540:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049149824:0@lo:105: 00010000:00010000:2.0:1787826020.426572:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826020.426656:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342777800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042910848:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 6693us (22349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.426684:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12146 00000100:00100000:0.0:1787826020.430300:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049149952:12345-0@lo:403:mdt00_000.0 Request processed in 4759us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.430320:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12322 00000100:00100000:1.0:1787826020.433627:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049149952:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1787826020.438089:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].425, 656 off653768 00000040:00080000:1.0:1787826020.439970:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].297, 736 off494608 00000004:00080000:1.0:1787826020.439982:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34896b840 with version 614 00000004:00080000:0.0:1787826020.443907:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 614 rpc_version 614 00000020:00100000:0.0:1787826020.443978:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826020.443993:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34bdf5c00 x1874663049150208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826020.444025:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049150208:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826020.444236:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.444391:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.444592:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049150208 00000100:00100000:3.0:1787826020.444603:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049150208 00000100:00100000:2.0:1787826020.444982:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12323 00000100:00100000:2.0:1787826020.444998:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049150208:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826020.448617:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049150208:12345-0@lo:1000:osp_up1-0.0 Request processed in 3606us (4367us total) trans 17179869796 rc 0/0 00000100:00100000:2.0:1787826020.448639:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12323 00000100:00100000:3.0:1787826020.448895:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049150208:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826020.449159:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb6:0x0]: returning size 4096 00010000:00010000:1.0:1787826020.449198:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449211:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449220:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449227:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.449233:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449246:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449268:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2a:0x0].0x0 (ffff8eb472727600) 00010000:00010000:1.0:1787826020.449272:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826020.449278:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449290:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb6a2 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449310:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449319:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449364:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449463:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826020.449475:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2a:0x0] 00010000:00010000:1.0:1787826020.449488:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449495:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449500:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449506:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.449509:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449516:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449530:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb6:0x0].0x0 (ffff8eb472727000) 00010000:00010000:1.0:1787826020.449533:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826020.449537:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449543:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb69b lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449561:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449568:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449574:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449579:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.449582:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449588:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449596:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.449599:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.449602:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449607:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb68d lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.449621:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d665ef0 reply state 000000001484ae01 transno 335007449169 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449637:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.449646:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.449648:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.449652:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826020.449862:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155469:x1874663042910592:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 67108us (67393us total) trans 335007449169 rc 0/0 00000100:00100000:1.0:1787826020.449872:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 668 00010000:00010000:2.0:1787826020.450202:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826020.450212:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.450221:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc600 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826020.450226:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.450236:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.450283:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.450290:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826020.450348:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.450356:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcc600/0x878a5eea00ceb6a9 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb6b0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.450547:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049150336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826020.450621:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.450649:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049150336 00000100:00100000:1.0:1787826020.450667:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049150336 00000100:00100000:1.0:1787826020.450740:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4182 00000100:00100000:1.0:1787826020.450752:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049150336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826020.450767:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826020.450790:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6b0 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb6a9 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.450802:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2a:0x0].0x0 (ffff8eb472727400) 00010000:00010000:2.0:1787826020.450805:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.450807:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.450808:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826020.450811:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826020.450853:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049150336:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.450859:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4182 00000100:00100000:2.0:1787826020.450904:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049150336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826020.481151:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.481374:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042910976 00000100:00100000:3.0:1787826020.481388:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042910976 00000100:00100000:3.0:1787826020.481467:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 669 00000100:00100000:3.0:1787826020.481481:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155492:x1874663042910976:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826020.481517:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.481548:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb6b7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec70 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481643:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481675:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481692:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481705:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 26 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481713:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481719:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481771:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481778:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481786:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481793:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdccc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.481798:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481807:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481820:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.481824:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.481830:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481837:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb6be lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481851:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481857:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481862:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481866:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.481869:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481874:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481880:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826020.481882:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.481885:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481891:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6c5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481919:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb6b7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec70 expref: 58 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481935:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.481937:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.481940:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb6b7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec70 expref: 58 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.481949:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd400, rc 0) 00000100:00100000:3.0:1787826020.482023:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155492:x1874663042910976:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 545us (888us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826020.482030:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 669 00000100:00100000:0.0:1787826020.485704:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.486073:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042911104 00000100:00100000:3.0:1787826020.486087:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042911104 00000100:00100000:3.0:1787826020.486291:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 670 00000100:00100000:3.0:1787826020.486303:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155492:x1874663042911104:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826020.486362:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.486402:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6cc lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec77 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486485:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486503:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486517:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486529:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 26 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486538:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486548:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486606:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486613:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486620:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486626:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.486631:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486639:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486652:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.486655:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.486673:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486681:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb6d3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486697:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486704:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486810:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486816:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcce00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.486819:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486826:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486835:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826020.486838:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.486841:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486847:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb6da lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486882:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6cc lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec77 expref: 58 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486893:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.486895:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.486899:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb6cc lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec77 expref: 58 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.486914:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcdc00, rc 0) 00000100:00100000:3.0:1787826020.487005:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155492:x1874663042911104:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 699us (1311us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826020.487014:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 670 00000100:00100000:0.0:1787826020.489909:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.490069:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042911232 00000100:00100000:3.0:1787826020.490082:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042911232 00000100:00100000:3.0:1787826020.490173:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 671 00000100:00100000:3.0:1787826020.490185:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155492:x1874663042911232:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826020.490210:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.490237:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb6e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec7e expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.490354:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6e8 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.490382:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6e8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.490396:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6e8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.490456:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.490460:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826020.490486:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6e8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.490514:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb6e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec7e expref: 59 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.490542:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6e8 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec7e expref: 58 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.490552:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.490556:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826020.490561:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcc600, rc 0) 00000100:00100000:3.0:1787826020.490640:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+58:155492:x1874663042911232:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 456us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.490648:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 671 00000100:00100000:1.0:1787826020.496237:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826020.497907:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042911488 00000100:00100000:0.0:1787826020.497925:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042911488 00000100:00100000:1.0:1787826020.498115:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 672 00000100:00100000:1.0:1787826020.498128:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+58:155492:x1874663042911488:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826020.498205:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826020.498244:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb6e8 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec7e expref: 58 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.498270:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.498277:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826020.499631:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.499656:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.499680:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.499692:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 26 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.499706:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.499770:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826020.501580:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].427, 2152 off657512 00000040:00080000:1.0:1787826020.501865:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].298, 2352 off496960 00000004:00080000:1.0:1787826020.501873:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34896bb40 with version 615 00000004:00080000:3.0:1787826020.502109:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 615 rpc_version 615 00000020:00100000:3.0:1787826020.502162:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826020.502174:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477dd5500 x1874663049150592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826020.502202:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049150592:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826020.502308:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.502386:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.502457:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049150592 00000100:00100000:0.0:1787826020.502466:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049150592 00000100:00100000:0.0:1787826020.502540:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12324 00000100:00100000:0.0:1787826020.502552:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049150592:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826020.504184:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049150592:12345-0@lo:1000:osp_up1-0.0 Request processed in 1626us (1868us total) trans 17179869797 rc 0/0 00000100:00100000:0.0:1787826020.504200:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12324 00000100:00100000:3.0:1787826020.505924:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049150592:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787826020.506819:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.506842:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.506904:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.506934:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.506942:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.506949:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.506996:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.507003:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.507014:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.507041:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049150720:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787826020.507124:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.507228:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4774226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.513956:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049150720 00000100:00100000:3.0:1787826020.513980:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049150720 00000100:00100000:2.0:1787826020.514207:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12325 00000100:00100000:2.0:1787826020.514222:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187904:x1874663049150720:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787826020.514257:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.514304:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb712 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb70b expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.514379:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb712 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb70b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.514397:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb712 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb70b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.514406:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2b:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826020.514410:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.514415:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39c00, rc 0) 00000100:00100000:2.0:1787826020.514520:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187904:x1874663049150720:12345-0@lo:101:mdt00_000.0 Request processed in 301us (7395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.514528:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12325 00000100:00100000:1.0:1787826020.514655:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049150720:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787826020.514692:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514719:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.514758:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b07b965 reply state 000000005f3d62e9 transno 335007449170 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514774:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514782:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2b:0x0].0x0 (ffff8eb47f8fd000) 00010000:00010000:1.0:1787826020.514784:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.514789:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826020.514795:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514804:0:187904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826020.514819:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2b:0x0] 00000004:00010000:1.0:1787826020.514827:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b07b965 reply state 000000005f3d62e9 transno 335007449170 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514836:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514844:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb7:0x0].0x0 (ffff8eb47f8fde00) 00010000:00010000:1.0:1787826020.514846:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.514848:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826020.514855:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb7:0x0]: returning size 4096 00010000:00010000:1.0:1787826020.514868:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514875:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514881:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514887:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.514892:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514900:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514913:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.514915:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.514918:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514924:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb6ef lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.514941:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b07b965 reply state 000000005f3d62e9 transno 335007449170 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514951:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.514957:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.514960:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.514963:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826020.515067:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+59:155492:x1874663042911488:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 16939us (18843us total) trans 335007449170 rc 0/0 00000100:00100000:1.0:1787826020.515075:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 672 00000100:00100000:0.0:1787826020.540608:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.540737:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042911616 00000100:00100000:3.0:1787826020.540753:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042911616 00000100:00100000:3.0:1787826020.540830:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 673 00000100:00100000:3.0:1787826020.540843:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+59:155507:x1874663042911616:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826020.540879:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.540905:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb719 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec85 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.540990:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.541009:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.541022:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.541035:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 27 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.541043:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.541050:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.541144:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb72e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.541153:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb72e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.541160:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb72e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.541268:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb7:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.541274:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826020.541694:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb72e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541719:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541727:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541734:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541741:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcdc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.541746:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541758:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541775:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.541778:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.541783:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541789:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb720 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541805:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541812:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541817:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541822:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcce00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.541825:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541830:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541838:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826020.541841:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.541843:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541849:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb727 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541885:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb719 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec85 expref: 61 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541900:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb72e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec85 expref: 60 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.541907:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb7:0x0].0x0 (ffff8eb47f8fde00) 00010000:00010000:2.0:1787826020.541909:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826020.541912:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd000, rc 0) 00000100:00100000:2.0:1787826020.542049:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+60:155507:x1874663042911616:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1208us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.542059:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 673 00000100:00100000:2.0:1787826020.550427:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.550556:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042911744 00000100:00100000:3.0:1787826020.550571:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042911744 00000100:00100000:3.0:1787826020.550647:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 674 00000100:00100000:3.0:1787826020.550670:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+60:155507:x1874663042911744:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826020.550699:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.550740:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb735 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec8c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.550826:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 3/1,0 mode: --/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.550843:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.550856:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.550922:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x2b:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.550928:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826020.550969:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb735 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 62 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.550992:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 61 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.551001:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2b:0x0].0x0 (ffff8eb47f8fd000) 00010000:00010000:3.0:1787826020.551005:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826020.551009:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcd400, rc 0) 00000100:00100000:3.0:1787826020.551091:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:155507:x1874663042911744:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 434us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.551099:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 674 00000100:00100000:1.0:1787826020.554933:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.555057:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042911872 00000100:00100000:2.0:1787826020.555070:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042911872 00000100:00100000:2.0:1787826020.555152:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 675 00000100:00100000:2.0:1787826020.555165:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155507:x1874663042911872:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826020.555195:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.555224:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb743 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec93 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.555542:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.555566:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb712 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb70b expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.555576:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.555622:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb712 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb70b expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.555643:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049150848:0@lo:104: 00000100:00100000:2.0:1787826020.555801:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.555859:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.556071:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049150848 00000100:00100000:3.0:1787826020.556079:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049150848 00000100:00100000:3.0:1787826020.556126:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4719 00000100:00100000:3.0:1787826020.556135:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049150848:12345-0@lo:104: 00010000:00010000:3.0:1787826020.556151:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.556228:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826020.556235:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049150848:12345-0@lo:104: Request processed in 102us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.556242:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4719 00010000:00010000:3.0:1787826020.556264:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826020.556271:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.556291:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826020.556298:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826020.556308:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.556358:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.556365:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826020.556580:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049150848:0@lo:104: 00010000:00010000:1.0:1787826020.556608:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.556852:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.556867:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00ceb70b lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb712 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.556893:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826020.556895:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826020.556897:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826020.556936:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826020.556954:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049150976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826020.557001:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.557077:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049150976 00000100:00100000:3.0:1787826020.557083:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049150976 00010000:00010000:3.0:1787826020.557109:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb712 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ceb70b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.557144:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12147 00000100:00100000:3.0:1787826020.557153:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3618:x1874663049150976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.557166:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787826020.560740:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869797 is committed 00010000:00010000:3.0:1787826020.561011:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb712 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb70b expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.561039:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2b:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:3.0:1787826020.561046:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.561057:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.561066:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.561256:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826020.563841:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049150976:12345-0@lo:103:ldlm_bl.0 Request processed in 6676us (6825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.563862:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12147 00000100:00100000:0.0:1787826020.564058:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049150976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826020.567092:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.567116:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826020.567676:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x2b:0x0]: returning size 4096 00000004:00200000:2.0:1787826020.567685:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826020.567837:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb743 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.567867:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.567878:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2b:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826020.567882:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826020.567886:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39800, rc 0) 00000100:00100000:2.0:1787826020.568054:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155507:x1874663042911872:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 12889us (13133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.568068:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 675 00000100:00100000:0.0:1787826020.576700:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.576900:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042912128 00000100:00100000:3.0:1787826020.576916:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042912128 00000100:00100000:3.0:1787826020.576997:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 676 00000100:00100000:3.0:1787826020.577011:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:155507:x1874663042912128:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:3.0:1787826020.577085:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.577125:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd000/0x878a5eea00ceb72e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec85 expref: 61 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.577150:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb7:0x0].0x0 (ffff8eb47f8fde00) 00010000:00010000:3.0:1787826020.577156:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826020.577187:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.577206:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.577218:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.577232:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 27 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.577247:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.577254:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.581656:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.581702:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.581715:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.581744:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.581760:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 60 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.581769:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.581830:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 60 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.581850:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 60 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.581867:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049151104:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826020.581990:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.585869:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.586117:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049151104:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826020.586159:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.586356:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042912256 00000100:00100000:3.0:1787826020.586366:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042912256 00010000:00010000:3.0:1787826020.586417:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 61 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.586522:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12148 00000100:00100000:2.0:1787826020.586536:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4537c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:2391:x1874663042912256:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826020.586555:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826020.586564:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 61 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.586579:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 61 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.586606:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb73c lrc: 0/0,0 mode: --/PR res: [0x200026560:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec8c expref: 61 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.586625:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2b:0x0].0x0 (ffff8eb47f8fd000) 00010000:00010000:2.0:1787826020.586631:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.586642:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.586651:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.586689:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826020.586805:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4537c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+60:2391:x1874663042912256:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 273us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.586814:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12148 00010000:00010000:3.0:1787826020.588173:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.588191:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.588264:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.588273:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.588286:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.588315:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049151232:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826020.588406:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.588477:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049151232 00000100:00100000:2.0:1787826020.588487:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049151232 00000100:00100000:2.0:1787826020.588554:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12326 00000100:00100000:2.0:1787826020.588566:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049151232:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826020.588588:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.588608:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb76d expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.588641:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.588652:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.588696:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.588719:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 6 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.588733:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049151360:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826020.588828:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.588847:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4413740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.594638:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.594765:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049151360:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826020.594820:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.594840:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2b:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826020.594844:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826020.594848:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.594860:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.594868:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38200, rc 0) 00000100:00100000:2.0:1787826020.594948:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049151232:12345-0@lo:101:mdt00_003.0 Request processed in 6385us (6542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.594958:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12326 00000100:00100000:0.0:1787826020.595114:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869797 gen 2 00000004:00080000:0.0:1787826020.595122:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869796 committed transno 17179869797 00000004:00080000:0.0:1787826020.595148:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869797 committed transno 17179869797 00000100:00100000:0.0:1787826020.595166:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049151232:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826020.595185:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.595198:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.595561:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042912384 00000100:00100000:3.0:1787826020.595572:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042912384 00010000:00010000:3.0:1787826020.595616:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 7 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.595667:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12149 00000100:00100000:3.0:1787826020.595679:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042912384:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.595696:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.595704:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 7 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.595784:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 7 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.595810:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb74a lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec93 expref: 7 pid: 187906 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.595828:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2b:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:3.0:1787826020.595834:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.595845:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.595855:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.595895:0:9496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.595913:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9496:1874663049151488:0@lo:105: 00000100:00100000:3.0:1787826020.595969:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.596066:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.597590:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049151488 00000100:00100000:0.0:1787826020.597607:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049151488 00000100:00100000:0.0:1787826020.597688:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4720 00000100:00100000:0.0:1787826020.597701:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9496:x1874663049151488:12345-0@lo:105: 00010000:00010000:0.0:1787826020.597730:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.597750:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.597760:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.597771:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.597780:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.597790:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.597828:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34bdcd000) 00000100:00100000:0.0:1787826020.597919:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9496:x1874663049151488:12345-0@lo:105: Request processed in 221us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.597927:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4720 00000100:00100000:1.0:1787826020.598070:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9496:1874663049151488:0@lo:105: 00010000:00010000:1.0:1787826020.598096:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826020.598160:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042912384:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 2482us (3534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.598170:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12149 00010000:00010000:2.0:1787826020.598468:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.598480:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.599495:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049151616:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787826020.599588:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.599874:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.603959:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049151616 00000100:00100000:3.0:1787826020.603981:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049151616 00000100:00100000:2.0:1787826020.604155:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12327 00000100:00100000:2.0:1787826020.604169:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049151616:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787826020.607787:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049151616:12345-0@lo:403:mdt00_003.0 Request processed in 3606us (8184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.607810:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12327 00000100:00100000:0.0:1787826020.607823:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049151616:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1787826020.610732:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].428, 656 off658168 00000040:00080000:0.0:1787826020.611572:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].299, 736 off497696 00000004:00080000:0.0:1787826020.611583:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb443e5be40 with version 616 00000004:00080000:3.0:1787826020.611664:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 616 rpc_version 616 00000020:00100000:3.0:1787826020.611713:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826020.611728:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477dd6d80 x1874663049151872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826020.611757:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049151872:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826020.611852:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.611924:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.611985:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049151872 00000100:00100000:0.0:1787826020.611993:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049151872 00000100:00100000:0.0:1787826020.612063:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12328 00000100:00100000:0.0:1787826020.612075:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a7ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049151872:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826020.612464:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a7ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049151872:12345-0@lo:1000:osp_up1-0.0 Request processed in 389us (610us total) trans 17179869798 rc 0/0 00000100:00100000:0.0:1787826020.612473:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12328 00000100:00100000:1.0:1787826020.612572:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049151872:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826020.612607:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb7:0x0]: returning size 4096 00010000:00010000:1.0:1787826020.612634:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612646:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612654:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612671:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.612677:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612686:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612706:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2b:0x0].0x0 (ffff8eb47f8fd000) 00010000:00010000:1.0:1787826020.612719:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826020.612726:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612732:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb766 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612750:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612759:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612767:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612793:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826020.612802:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2b:0x0] 00010000:00010000:1.0:1787826020.612810:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612816:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612822:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612827:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.612830:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612836:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612844:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb7:0x0].0x0 (ffff8eb47f8fde00) 00010000:00010000:1.0:1787826020.612846:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826020.612849:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612854:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb75f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612870:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612875:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612881:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612886:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdccc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.612888:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612899:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612907:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.612909:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.612912:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612918:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdccc00/0x878a5eea00ceb751 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.612929:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035a8848d reply state 000000009dd305bd transno 335007449171 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612943:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.612951:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.612953:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.612957:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826020.613043:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:155507:x1874663042912128:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 36032us (36359us total) trans 335007449171 rc 0/0 00000100:00100000:1.0:1787826020.613051:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 676 00010000:00010000:2.0:1787826020.613118:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826020.613127:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.613135:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826020.613140:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.613149:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.613183:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.613190:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826020.613227:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.613234:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bdcd000/0x878a5eea00ceb76d lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb774 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.613255:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.613257:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.613259:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826020.614295:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826020.615536:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049152000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826020.615649:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.622020:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049152000 00000100:00100000:2.0:1787826020.622042:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049152000 00000100:00100000:2.0:1787826020.622195:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4183 00000100:00100000:2.0:1787826020.622208:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049152000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826020.622233:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826020.622270:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb774 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb76d expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.622307:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2b:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826020.622322:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826020.622466:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049152000:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (6818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.622475:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4183 00000100:00100000:3.0:1787826020.622586:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049152000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826020.626624:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.626926:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042912512 00000100:00100000:3.0:1787826020.626940:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042912512 00000100:00100000:3.0:1787826020.627013:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 677 00000100:00100000:3.0:1787826020.627023:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:155520:x1874663042912512:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826020.627053:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.627080:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb77b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ec9a expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627158:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627175:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627188:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627200:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 28 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627208:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627215:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627262:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627269:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627286:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627292:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.627297:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627305:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627319:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.627353:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.627359:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627366:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc600/0x878a5eea00ceb782 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627390:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627398:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627404:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627411:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.627414:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627420:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627426:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826020.627428:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.627431:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627436:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd400/0x878a5eea00ceb789 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627466:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb77b lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec9a expref: 62 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627477:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.627479:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.627483:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcdc00/0x878a5eea00ceb77b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ec9a expref: 62 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.627493:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bdcdc00, rc 0) 00000100:00100000:3.0:1787826020.627562:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:155520:x1874663042912512:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 540us (951us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826020.627569:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 677 00000100:00100000:0.0:1787826020.634989:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.637174:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042912640 00000100:00100000:1.0:1787826020.637197:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042912640 00000100:00100000:1.0:1787826020.637402:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 678 00000100:00100000:1.0:1787826020.637419:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:155520:x1874663042912640:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826020.637449:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826020.637478:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb790 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eca1 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.637568:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.637587:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.637601:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.637615:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 28 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.637624:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.637630:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640777:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640802:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640812:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640824:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.640831:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640841:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640863:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.640867:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.640873:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640880:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00ceb797 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640908:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640915:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640922:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640927:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.640930:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640937:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640951:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.640953:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.640957:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.640963:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb79e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.641022:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb790 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eca1 expref: 62 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.641034:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.641036:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.641040:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb790 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eca1 expref: 62 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.641051:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357200, rc 0) 00000100:00100000:1.0:1787826020.641154:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:155520:x1874663042912640:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 3737us (6176us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826020.641166:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 678 00000100:00100000:0.0:1787826020.649799:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.650034:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042912768 00000100:00100000:2.0:1787826020.650050:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042912768 00000100:00100000:2.0:1787826020.650135:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 679 00000100:00100000:2.0:1787826020.650148:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+61:155520:x1874663042912768:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826020.650181:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.650208:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb7a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eca8 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.650316:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb7ac lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.650607:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb7ac lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.650625:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb7ac lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826020.650718:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826020.650723:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826020.650750:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb7ac lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.650783:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb7a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eca8 expref: 63 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.650806:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb7ac lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eca8 expref: 62 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.650816:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.650820:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826020.650824:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38200, rc 0) 00000100:00100000:2.0:1787826020.650902:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+62:155520:x1874663042912768:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 756us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.650912:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 679 00000100:00100000:2.0:1787826020.662185:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826020.662299:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042913024 00000100:00100000:0.0:1787826020.662314:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042913024 00000100:00100000:0.0:1787826020.662561:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 680 00000100:00100000:0.0:1787826020.662576:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+62:155520:x1874663042913024:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826020.662666:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826020.662705:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb7ac lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eca8 expref: 62 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.662736:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826020.662743:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826020.662837:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.662855:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.662866:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.662878:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 28 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.662896:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.662902:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826020.663910:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].429, 2152 off660320 00000040:00080000:0.0:1787826020.664000:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].300, 2352 off500048 00000004:00080000:0.0:1787826020.664007:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a7b3240 with version 617 00000004:00080000:0.0:1787826020.667527:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 617 rpc_version 617 00000020:00100000:0.0:1787826020.667599:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826020.667616:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb348fff800 x1874663049152256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826020.667649:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049152256:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826020.668108:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.668430:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3491729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.668546:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049152256 00000100:00100000:2.0:1787826020.668557:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049152256 00000100:00100000:2.0:1787826020.668667:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12329 00000100:00100000:2.0:1787826020.668680:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049152256:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826020.669776:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049152256:12345-0@lo:1000:osp_up1-0.0 Request processed in 1095us (1670us total) trans 17179869799 rc 0/0 00000100:00100000:2.0:1787826020.669788:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12329 00000100:00100000:1.0:1787826020.677469:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049152256:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787826020.677640:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.677669:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.677683:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.677705:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.677713:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.677719:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.677758:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.677765:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.677775:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.677795:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049152384:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787826020.677882:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.677926:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049152384 00000100:00100000:1.0:1787826020.677933:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049152384 00000100:00100000:1.0:1787826020.677979:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12330 00000100:00100000:1.0:1787826020.677987:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049152384:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826020.678007:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826020.678022:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb7d6 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb7cf expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678042:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb7d6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb7cf expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678053:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb7d6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb7cf expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678060:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2c:0x0].0x0 (ffff8eb47f8fd900) 00010000:00010000:1.0:1787826020.678063:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.678066:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357800, rc 0) 00000100:00100000:1.0:1787826020.678114:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049152384:12345-0@lo:101:mdt00_003.0 Request processed in 126us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.678121:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12330 00000100:00100000:1.0:1787826020.678383:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.678406:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049152384:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826020.678420:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678432:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.678457:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b429f6c5 reply state 00000000b3213916 transno 335007449172 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678469:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678477:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2c:0x0].0x0 (ffff8eb47f8fd500) 00010000:00010000:1.0:1787826020.678479:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.678483:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826020.678489:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678498:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826020.678510:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2c:0x0] 00000004:00010000:1.0:1787826020.678518:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b429f6c5 reply state 00000000b3213916 transno 335007449172 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678527:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678533:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb8:0x0].0x0 (ffff8eb47f8fd700) 00010000:00010000:1.0:1787826020.678536:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.678537:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826020.678542:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb8:0x0]: returning size 4096 00010000:00010000:1.0:1787826020.678550:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678555:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678561:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678567:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.678571:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678577:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678590:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.678592:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.678596:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678601:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb7b3 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.678616:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b429f6c5 reply state 00000000b3213916 transno 335007449172 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678624:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.678630:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.678632:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.678634:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826020.678721:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+63:155520:x1874663042913024:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 16146us (16550us total) trans 335007449172 rc 0/0 00000100:00100000:1.0:1787826020.678728:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 680 00000100:00100000:0.0:1787826020.693719:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826020.693745:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049152512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826020.693823:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.693908:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049152512 00000100:00100000:0.0:1787826020.693916:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049152512 00000100:00100000:0.0:1787826020.693973:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12331 00000100:00100000:0.0:1787826020.693983:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049152512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826020.694015:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1787826020.694060:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049152512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.694067:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12331 00000100:00100000:0.0:1787826020.694114:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049152512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826020.701143:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.701261:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042913152 00000100:00100000:1.0:1787826020.701278:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042913152 00000100:00100000:1.0:1787826020.701393:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 681 00000100:00100000:1.0:1787826020.701407:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+63:155528:x1874663042913152:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826020.701440:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826020.701468:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb7dd lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecaf expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701576:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701594:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701607:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701620:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 29 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701628:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701635:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701753:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb7f2 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701763:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb7f2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701771:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb7f2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826020.701879:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb8:0x0]: returning size 4096 00000004:00200000:1.0:1787826020.701886:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787826020.701913:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb7f2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701940:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701948:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701957:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701964:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.701970:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701979:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.701996:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.702001:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.702006:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702013:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb7e4 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702029:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702036:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702043:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702049:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.702053:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702059:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702067:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.702070:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.702074:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702080:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb7eb lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702114:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb7dd lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecaf expref: 65 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702708:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb7f2 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecaf expref: 64 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.702719:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb8:0x0].0x0 (ffff8eb47f8fd700) 00010000:00010000:1.0:1787826020.702723:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826020.702727:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356000, rc 0) 00000100:00100000:1.0:1787826020.702821:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+64:155528:x1874663042913152:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1415us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.702831:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 681 00000100:00100000:1.0:1787826020.714011:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.714209:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042913280 00000100:00100000:3.0:1787826020.714223:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042913280 00000100:00100000:3.0:1787826020.714450:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 682 00000100:00100000:3.0:1787826020.714462:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+64:155528:x1874663042913280:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826020.715204:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.715244:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb7f9 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecb6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.715456:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.715473:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.715488:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.715554:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x2c:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.715561:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826020.715608:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb7f9 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 66 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.715629:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 65 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.715639:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2c:0x0].0x0 (ffff8eb47f8fd500) 00010000:00010000:3.0:1787826020.715642:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826020.715646:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462a200, rc 0) 00000100:00100000:3.0:1787826020.715860:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:155528:x1874663042913280:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1399us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.715874:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 682 00000100:00100000:1.0:1787826020.736167:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.736298:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042913408 00000100:00100000:2.0:1787826020.736312:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042913408 00000100:00100000:2.0:1787826020.736922:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 683 00000100:00100000:2.0:1787826020.736938:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155528:x1874663042913408:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826020.736970:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.737002:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb807 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecbd expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.737084:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.737101:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb7d6 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb7cf expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.737120:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.737164:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb7d6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb7cf expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.737184:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049152640:0@lo:104: 00000100:00100000:2.0:1787826020.737251:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.737300:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826020.737429:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049152640 00000100:00100000:3.0:1787826020.737437:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049152640 00000100:00100000:3.0:1787826020.738017:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4721 00000100:00100000:3.0:1787826020.738031:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049152640:12345-0@lo:104: 00010000:00010000:3.0:1787826020.738047:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.738158:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826020.738165:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049152640:12345-0@lo:104: Request processed in 139us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.738172:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4721 00010000:00010000:0.0:1787826020.738728:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826020.738737:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.738748:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826020.738755:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826020.738766:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.738807:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.738814:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826020.738840:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.738848:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb7cf lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb7d6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.738874:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826020.738876:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826020.738877:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826020.738886:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826020.738902:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049152768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826020.738955:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.739004:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049152768 00000100:00100000:0.0:1787826020.739010:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049152768 00010000:00010000:0.0:1787826020.739040:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb7d6 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ceb7cf expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.739141:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12150 00000100:00100000:0.0:1787826020.739150:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3619:x1874663049152768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826020.739736:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826020.742446:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049152640:0@lo:104: 00010000:00010000:3.0:1787826020.742492:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826020.744211:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869799 is committed 00010000:00010000:1.0:1787826020.744559:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb7d6 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb7cf expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.744587:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2c:0x0].0x0 (ffff8eb47f8fd900) 00010000:00010000:1.0:1787826020.744594:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.744606:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.744616:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.744669:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826020.744806:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.744816:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.744890:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x2c:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.744897:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826020.744953:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb807 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.744970:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.744978:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2c:0x0].0x0 (ffff8eb47f8fd900) 00010000:00010000:3.0:1787826020.744981:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826020.744984:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39600, rc 0) 00000100:00100000:3.0:1787826020.745107:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155528:x1874663042913408:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 8173us (9012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.745118:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 683 00000100:00100000:1.0:1787826020.745854:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049152768:12345-0@lo:103:ldlm_bl.0 Request processed in 6700us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.745867:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12150 00000100:00100000:3.0:1787826020.747482:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049152768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826020.750398:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.750696:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042913664 00000100:00100000:1.0:1787826020.750709:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042913664 00000100:00100000:1.0:1787826020.750790:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 684 00000100:00100000:1.0:1787826020.750804:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:155528:x1874663042913664:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:1.0:1787826020.750894:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826020.750928:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceb7f2 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecaf expref: 65 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.750955:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb8:0x0].0x0 (ffff8eb47f8fd700) 00010000:00010000:1.0:1787826020.750962:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826020.750990:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751008:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751019:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751032:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 29 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751047:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751054:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751169:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751178:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751184:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751206:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751216:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 64 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751224:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 4/0,1 mode: --/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751266:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 64 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.751283:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 64 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.751300:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049152896:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826020.753450:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.765478:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.765692:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042913792 00000100:00100000:3.0:1787826020.765714:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042913792 00010000:00010000:3.0:1787826020.765768:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 65 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.765817:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12151 00000100:00100000:3.0:1787826020.765830:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:2389:x1874663042913792:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.765847:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.765857:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 65 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.765873:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 65 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.765902:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2c:0x0].0x0 (ffff8eb47f8fd500) 00010000:00010000:3.0:1787826020.765908:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.765924:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.765933:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.765956:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826020.766027:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:2389:x1874663042913792:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 199us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.766036:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12151 00010000:00010000:2.0:1787826020.771213:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb800 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecb6 expref: 64 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.771263:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049152896:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826020.771299:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.771312:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.771318:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.771481:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.771492:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.771507:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.771535:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049153024:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826020.771619:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.771674:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.771827:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049153024 00000100:00100000:1.0:1787826020.771837:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049153024 00000100:00100000:1.0:1787826020.771918:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12332 00000100:00100000:1.0:1787826020.771929:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049153024:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826020.771949:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826020.771968:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb831 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.772001:0:177386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.772011:0:177386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.772042:0:177386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.772063:0:177386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 6 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.772076:0:177386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049153152:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826020.774889:0:177386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.787758:0:177386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049153152:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826020.787813:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.787828:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2c:0x0].0x0 (ffff8eb47f8fd900) 00010000:00010000:0.0:1787826020.787831:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826020.787836:0:177386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.787847:0:177386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.787855:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357800, rc 0) 00000100:00100000:0.0:1787826020.787942:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049153024:12345-0@lo:101:mdt00_003.0 Request processed in 16013us (16322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.787952:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12332 00000100:00100000:2.0:1787826020.788076:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869799 gen 2 00000004:00080000:2.0:1787826020.788083:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869798 committed transno 17179869799 00000004:00080000:2.0:1787826020.788110:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869799 committed transno 17179869799 00000100:00100000:2.0:1787826020.788129:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049153024:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826020.788151:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.788164:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.799489:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.799533:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042913920 00000100:00100000:1.0:1787826020.799555:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042913920 00010000:00010000:1.0:1787826020.799597:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.799632:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12152 00000100:00100000:1.0:1787826020.799641:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2390:x1874663042913920:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826020.799666:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826020.799673:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799685:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799706:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb80e lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecbd expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799721:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2c:0x0].0x0 (ffff8eb47f8fd900) 00010000:00010000:1.0:1787826020.799727:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799738:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799747:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799782:0:6476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.799796:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6476:1874663049153280:0@lo:105: 00000100:00100000:1.0:1787826020.799840:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.799877:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.799892:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049153280 00000100:00100000:1.0:1787826020.799896:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049153280 00000100:00100000:1.0:1787826020.799921:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4722 00000100:00100000:1.0:1787826020.799927:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6476:x1874663049153280:12345-0@lo:105: 00010000:00010000:1.0:1787826020.799936:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799945:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799953:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799959:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799966:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799973:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.799987:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34462b200) 00000100:00100000:1.0:1787826020.800017:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6476:x1874663049153280:12345-0@lo:105: Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.800023:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4722 00000100:00100000:1.0:1787826020.800060:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6476:1874663049153280:0@lo:105: 00010000:00010000:1.0:1787826020.800075:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826020.800111:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042913920:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 471us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.800118:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12152 00010000:00010000:2.0:1787826020.800276:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.800288:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.800934:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049153408:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787826020.800981:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.801008:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.801255:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049153408 00000100:00100000:1.0:1787826020.801261:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049153408 00000100:00100000:1.0:1787826020.801373:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12333 00000100:00100000:1.0:1787826020.801383:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049153408:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787826020.804198:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049153408:12345-0@lo:403:mdt00_003.0 Request processed in 2808us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.804212:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12333 00000100:00100000:2.0:1787826020.804455:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049153408:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1787826020.806321:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].430, 944 off661264 00000040:00080000:2.0:1787826020.806900:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].301, 1024 off501072 00000004:00080000:2.0:1787826020.806907:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3436b2540 with version 618 00000004:00080000:1.0:1787826020.806988:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 618 rpc_version 618 00000020:00100000:1.0:1787826020.807021:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826020.807032:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66df80 x1874663049153664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826020.807501:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049153664:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826020.807709:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.807793:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.807894:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049153664 00000100:00100000:2.0:1787826020.807902:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049153664 00000100:00100000:2.0:1787826020.807997:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12334 00000100:00100000:2.0:1787826020.808009:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049153664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826020.808300:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049153664:12345-0@lo:1000:osp_up1-0.0 Request processed in 290us (725us total) trans 17179869800 rc 0/0 00000100:00100000:2.0:1787826020.808310:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12334 00000100:00100000:3.0:1787826020.808460:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049153664:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826020.808768:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb8:0x0]: returning size 4096 00010000:00010000:2.0:1787826020.808852:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808862:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808870:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808875:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.808879:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808887:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808903:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2c:0x0].0x0 (ffff8eb47f8fd500) 00010000:00010000:2.0:1787826020.808906:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826020.808911:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 2/0,0 mode: --/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808916:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00ceb82a lrc: 0/0,0 mode: --/EX res: [0x200026560:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808933:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808945:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808952:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.808977:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826020.808985:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2c:0x0] 00010000:00010000:2.0:1787826020.808994:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809000:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809006:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809011:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.809014:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809020:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809026:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb8:0x0].0x0 (ffff8eb47f8fd700) 00010000:00010000:2.0:1787826020.809029:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826020.809031:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809036:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00ceb823 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809053:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.809079:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826020.809091:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.809112:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462b200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826020.809120:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826020.809130:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809172:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809179:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.809182:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809187:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.809195:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.809199:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826020.809210:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809223:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.809233:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.809239:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.809242:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809246:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00ceb815 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.809264:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34462b200/0x878a5eea00ceb831 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb838 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.809275:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbf13e13 reply state 00000000791a48d8 transno 335007449173 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.809291:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.809296:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.809300:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826020.809301:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826020.809305:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826020.809307:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826020.809313:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826020.809317:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826020.809383:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049153792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826020.809478:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.809706:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:155528:x1874663042913664:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 58770us (59186us total) trans 335007449173 rc 0/0 00000100:00100000:2.0:1787826020.809719:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 684 00000100:00100000:3.0:1787826020.809775:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049153792 00000100:00100000:3.0:1787826020.809784:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049153792 00000100:00100000:3.0:1787826020.809857:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4184 00000100:00100000:3.0:1787826020.809868:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049153792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.809883:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.809908:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb838 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb831 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.809932:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2c:0x0].0x0 (ffff8eb47f8fd900) 00010000:00010000:3.0:1787826020.809944:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826020.811311:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049153792:12345-0@lo:103:ldlm_bl.0 Request processed in 1436us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.811828:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049153792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826020.812968:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4184 00000100:00100000:1.0:1787826020.837596:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826020.837717:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042914048 00000100:00100000:2.0:1787826020.837731:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042914048 00000100:00100000:2.0:1787826020.837819:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 685 00000100:00100000:2.0:1787826020.837833:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:155535:x1874663042914048:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826020.837870:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.837901:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb83f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecc4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.837995:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838016:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838029:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838042:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 30 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838050:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838056:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838130:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838139:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838146:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838152:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.838158:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838166:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838181:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.838184:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.838190:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838195:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb846 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838212:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838219:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838224:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838232:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.838235:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838241:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838248:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826020.838251:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.838254:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838260:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb84d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838303:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb83f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecc4 expref: 66 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838315:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.838318:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.838367:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb83f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecc4 expref: 66 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.838380:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38a00, rc 0) 00000100:00100000:2.0:1787826020.838461:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:155535:x1874663042914048:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 630us (882us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826020.838468:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 685 00000100:00100000:0.0:1787826020.851045:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.851205:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042914176 00000100:00100000:3.0:1787826020.851218:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042914176 00000100:00100000:3.0:1787826020.851304:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 686 00000100:00100000:3.0:1787826020.851317:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:155535:x1874663042914176:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826020.851379:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.851408:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb854 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eccb expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851495:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851627:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851642:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851667:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 30 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851677:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851684:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851740:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851748:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851756:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851762:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462ac00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.851768:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851776:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851792:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.851795:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.851800:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851806:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb85b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851821:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851827:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851832:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851837:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462bc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826020.851840:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851845:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851852:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826020.851855:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.851858:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851865:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb862 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851899:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb854 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eccb expref: 66 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851910:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.851912:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826020.851916:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb854 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eccb expref: 66 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.851927:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462b200, rc 0) 00000100:00100000:3.0:1787826020.852013:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:155535:x1874663042914176:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 697us (982us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826020.852021:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 686 00000100:00100000:0.0:1787826020.855840:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.855953:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042914304 00000100:00100000:3.0:1787826020.855968:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042914304 00000100:00100000:3.0:1787826020.856046:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 687 00000100:00100000:3.0:1787826020.856061:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+65:155535:x1874663042914304:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826020.856088:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.856125:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecd2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.856224:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb870 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.856241:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb870 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.856253:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb870 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.856352:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.856356:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826020.856382:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb870 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.856412:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecd2 expref: 67 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.856434:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb870 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecd2 expref: 66 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.856443:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.856446:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826020.856451:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462a400, rc 0) 00000100:00100000:3.0:1787826020.857295:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+66:155535:x1874663042914304:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1232us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.857306:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 687 00000100:00100000:2.0:1787826020.867711:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.868236:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042914560 00000100:00100000:3.0:1787826020.868251:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042914560 00000100:00100000:3.0:1787826020.868415:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 688 00000100:00100000:3.0:1787826020.868428:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+66:155535:x1874663042914560:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:3.0:1787826020.868835:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.868872:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb870 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecd2 expref: 66 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.868898:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826020.868905:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826020.868990:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.869007:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.869018:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.869032:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 30 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.869046:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.869053:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826020.872965:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].431, 2152 off663416 00000040:00080000:2.0:1787826020.873064:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].302, 2352 off503424 00000004:00080000:2.0:1787826020.873071:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb443e5bcc0 with version 619 00000004:00080000:3.0:1787826020.875925:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 619 rpc_version 619 00000020:00100000:3.0:1787826020.875991:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826020.876006:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477dd7480 x1874663049154048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826020.876035:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049154048:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826020.876128:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.876179:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.877651:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049154048 00000100:00100000:2.0:1787826020.877676:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049154048 00000100:00100000:2.0:1787826020.877758:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12335 00000100:00100000:2.0:1787826020.877771:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049154048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826020.878691:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049154048:12345-0@lo:1000:osp_up1-0.0 Request processed in 919us (2559us total) trans 17179869801 rc 0/0 00000100:00100000:2.0:1787826020.878703:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12335 00000100:00100000:3.0:1787826020.878853:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049154048:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787826020.879051:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.879072:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.879088:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.879113:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 3/0,1 mode: --/PW res: [0x200026560:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.879122:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.879129:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.879178:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.879192:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.879204:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.879228:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049154176:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787826020.879561:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.879635:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.889915:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049154176 00000100:00100000:0.0:1787826020.889937:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049154176 00000100:00100000:2.0:1787826020.890269:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12336 00000100:00100000:2.0:1787826020.890291:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187904:x1874663049154176:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787826020.890359:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826020.890405:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb89a lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb893 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.890445:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb89a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb893 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.890463:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb89a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb893 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.890473:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:2.0:1787826020.890477:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.890482:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39600, rc 0) 00000100:00100000:2.0:1787826020.890596:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187904:x1874663049154176:12345-0@lo:101:mdt00_000.0 Request processed in 308us (11316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.890603:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12336 00000100:00100000:1.0:1787826020.890890:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049154176:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787826020.890914:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.890927:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.890957:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5a02d91 reply state 0000000079d76225 transno 335007449174 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.890972:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.890979:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2d:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:1.0:1787826020.890981:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.890985:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826020.890992:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891000:0:187904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826020.891013:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2d:0x0] 00000004:00010000:1.0:1787826020.891023:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5a02d91 reply state 0000000079d76225 transno 335007449174 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891032:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891037:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb9:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:1.0:1787826020.891040:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.891042:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826020.891049:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb9:0x0]: returning size 4096 00010000:00010000:1.0:1787826020.891061:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891067:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891074:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891080:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462be00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826020.891086:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891094:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891107:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826020.891110:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826020.891114:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891120:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb877 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826020.891142:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5a02d91 reply state 0000000079d76225 transno 335007449174 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891152:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.891159:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826020.891161:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826020.891163:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787826020.897623:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+67:155535:x1874663042914560:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 29181us (29910us total) trans 335007449174 rc 0/0 00000100:00100000:2.0:1787826020.897638:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 688 00000100:00100000:0.0:1787826020.917547:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826020.917597:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042914688 00000100:00100000:0.0:1787826020.917611:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042914688 00000100:00100000:0.0:1787826020.917697:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 689 00000100:00100000:0.0:1787826020.917710:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+67:155537:x1874663042914688:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826020.917745:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826020.917775:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceb8a1 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecd9 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.917861:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.917878:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.917891:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.917904:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 31 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.917912:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.917918:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918021:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb8b6 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918035:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb8b6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918042:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb8b6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826020.918150:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb9:0x0]: returning size 4096 00000004:00200000:0.0:1787826020.918156:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787826020.918182:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb8b6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918196:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918203:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918211:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918217:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fe00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826020.918222:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918231:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918246:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826020.918250:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826020.918256:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918268:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb8a8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918282:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918289:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918295:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918301:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826020.918303:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918309:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918317:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826020.918319:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826020.918322:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918358:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceb8af lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918389:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceb8a1 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecd9 expref: 69 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918413:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb8b6 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecd9 expref: 68 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.918421:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb9:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:0.0:1787826020.918424:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826020.918427:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fc00, rc 0) 00000100:00100000:0.0:1787826020.918516:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+68:155537:x1874663042914688:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 808us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.918524:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 689 00000100:00100000:1.0:1787826020.927541:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.928156:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042914816 00000100:00100000:3.0:1787826020.928181:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042914816 00000100:00100000:3.0:1787826020.928263:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 690 00000100:00100000:3.0:1787826020.928276:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+68:155537:x1874663042914816:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826020.928302:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826020.928350:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8bd lrc: 2/0,0 mode: --/CR res: [0x200026560:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ece0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.928426:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.928444:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.928457:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.928519:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x2d:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.928525:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826020.928570:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8bd lrc: 0/0,0 mode: --/CR res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 70 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.928590:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 69 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.928599:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2d:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:3.0:1787826020.928603:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826020.928607:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462ba00, rc 0) 00000100:00100000:3.0:1787826020.928703:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:155537:x1874663042914816:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 429us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.928712:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 690 00000100:00100000:0.0:1787826020.931634:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826020.931760:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042914944 00000100:00100000:1.0:1787826020.931773:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042914944 00000100:00100000:1.0:1787826020.931849:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 691 00000100:00100000:1.0:1787826020.931861:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155537:x1874663042914944:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826020.931888:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826020.931913:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8cb lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ece7 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.931984:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.931999:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb89a lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb893 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.932008:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.932051:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb89a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb893 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.932075:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049154304:0@lo:104: 00000100:00100000:1.0:1787826020.932137:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.932203:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.932434:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049154304 00000100:00100000:0.0:1787826020.932439:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049154304 00000100:00100000:0.0:1787826020.932483:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4723 00000100:00100000:0.0:1787826020.932492:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049154304:12345-0@lo:104: 00010000:00010000:0.0:1787826020.932506:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.932581:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826020.932588:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049154304:12345-0@lo:104: Request processed in 97us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.932596:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4723 00010000:00010000:0.0:1787826020.932624:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826020.932631:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.932640:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826020.932647:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826020.932665:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.932696:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.932703:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826020.932731:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.932738:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39c00/0x878a5eea00ceb893 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb89a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.932760:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826020.932762:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826020.932764:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826020.932778:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049154432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826020.932814:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826020.932905:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049154304:0@lo:104: 00010000:00010000:3.0:1787826020.932928:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.932995:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049154432 00000100:00100000:1.0:1787826020.933001:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049154432 00010000:00010000:1.0:1787826020.933025:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb89a lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ceb893 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.933057:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12153 00000100:00100000:1.0:1787826020.933064:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448074850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3618:x1874663049154432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826020.933075:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787826020.939912:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869801 is committed 00010000:00010000:1.0:1787826020.940078:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb89a lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb893 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.940103:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:1.0:1787826020.940110:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.940121:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.940130:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.940167:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826020.940282:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448074850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049154432:12345-0@lo:103:ldlm_bl.0 Request processed in 7209us (7458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.940294:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12153 00000100:00100000:0.0:1787826020.940484:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049154432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826020.940566:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.940576:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826020.940668:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x2d:0x0]: returning size 4096 00000004:00200000:3.0:1787826020.940675:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826020.940737:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8cb lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.940759:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.940773:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:3.0:1787826020.940776:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826020.940779:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357600, rc 0) 00000100:00100000:3.0:1787826020.940851:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155537:x1874663042914944:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 8992us (9230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826020.940860:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 691 00000100:00100000:1.0:1787826020.947679:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.947863:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042915200 00000100:00100000:3.0:1787826020.947878:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042915200 00000100:00100000:3.0:1787826020.947954:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 692 00000100:00100000:3.0:1787826020.947966:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:155537:x1874663042915200:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:3.0:1787826020.948035:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826020.948073:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceb8b6 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecd9 expref: 69 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948094:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb9:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:3.0:1787826020.948101:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826020.948131:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948147:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948159:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948171:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 31 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948191:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948199:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948453:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948464:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948472:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948495:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948505:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 68 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948514:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 4/0,1 mode: --/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948558:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 68 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.948576:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 68 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826020.948599:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049154560:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826020.948821:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.965792:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826020.965900:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049154560:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826020.965935:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.969246:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042915328 00000100:00100000:0.0:1787826020.969463:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042915328 00010000:00010000:0.0:1787826020.969536:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 69 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.969640:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12154 00000100:00100000:0.0:1787826020.969663:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:2392:x1874663042915328:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826020.969683:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826020.969691:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 69 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.970393:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 69 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.970426:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb8c4 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece0 expref: 69 pid: 188682 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.970450:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2d:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:0.0:1787826020.970456:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.970466:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.970475:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.970510:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826020.970591:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+68:2392:x1874663042915328:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 938us (4811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.970599:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12154 00010000:00010000:1.0:1787826020.970849:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.970860:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.970919:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.970928:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.970939:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.970962:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049154688:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787826020.971025:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.971058:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4774229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.972947:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049154688 00000100:00100000:1.0:1787826020.972966:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049154688 00000100:00100000:1.0:1787826020.973043:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12337 00000100:00100000:1.0:1787826020.973056:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049154688:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826020.973082:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826020.973111:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb8f5 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.973152:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.973519:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.973568:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.973585:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 6 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.973601:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8414:1874663049154816:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826020.973798:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826020.975785:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8414:1874663049154816:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826020.975838:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.975859:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:0.0:1787826020.975862:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826020.975867:0:8414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.975877:0:8414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.975885:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356400, rc 0) 00000100:00100000:0.0:1787826020.975958:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049154688:12345-0@lo:101:mdt00_003.0 Request processed in 2903us (4931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.975967:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12337 00000100:00100000:1.0:1787826020.976070:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869801 gen 2 00000004:00080000:1.0:1787826020.976078:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869800 committed transno 17179869801 00000004:00080000:1.0:1787826020.976099:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869801 committed transno 17179869801 00000100:00100000:1.0:1787826020.976116:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049154688:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826020.976136:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.976148:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826020.976825:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826020.976901:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042915456 00000100:00100000:0.0:1787826020.976911:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042915456 00010000:00010000:0.0:1787826020.976958:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.977003:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12155 00000100:00100000:0.0:1787826020.977015:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2391:x1874663042915456:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826020.977033:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826020.977041:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.977054:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.977084:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb8d2 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ece7 expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.977103:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:0.0:1787826020.977109:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.977121:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.977129:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.977180:0:8420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826020.977197:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8420:1874663049154944:0@lo:105: 00000100:00100000:0.0:1787826020.977250:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.977307:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.977801:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787826020.977816:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049154944 00000100:00100000:1.0:1787826020.977820:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049154944 00000100:00100000:1.0:1787826020.977871:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4724 00000100:00100000:1.0:1787826020.977882:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477446050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:8420:x1874663049154944:12345-0@lo:105: 00010000:00010000:1.0:1787826020.977896:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.977907:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.977917:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.977926:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.977934:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.977943:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826020.977974:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb441357000) 00000100:00100000:1.0:1787826020.978035:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477446050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:8420:x1874663049154944:12345-0@lo:105: Request processed in 155us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.978042:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4724 00000100:00100000:2.0:1787826020.978441:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8420:1874663049154944:0@lo:105: 00010000:00010000:2.0:1787826020.978464:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826020.978518:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042915456:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1503us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826020.978526:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12155 00010000:00010000:3.0:1787826020.978967:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826020.978982:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826020.980095:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049155072:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787826020.980185:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826020.980221:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826020.980597:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049155072 00000100:00100000:1.0:1787826020.980608:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049155072 00000100:00100000:1.0:1787826020.980677:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12338 00000100:00100000:1.0:1787826020.980688:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049155072:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787826020.986202:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049155072:12345-0@lo:403:mdt00_003.0 Request processed in 5500us (6001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826020.986222:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12338 00000100:00100000:2.0:1787826020.988482:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049155072:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1787826020.991769:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].432, 656 off664072 00000040:00080000:2.0:1787826020.992010:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].303, 736 off504160 00000004:00080000:2.0:1787826020.992017:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3436a50c0 with version 620 00000004:00080000:1.0:1787826020.992492:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 620 rpc_version 620 00000020:00100000:1.0:1787826020.992541:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826020.992557:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479bf6a00 x1874663049155328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826020.992586:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049155328:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826020.992683:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826020.992723:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826020.994411:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049155328 00000100:00100000:2.0:1787826020.994429:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049155328 00000100:00100000:2.0:1787826020.994519:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12339 00000100:00100000:2.0:1787826020.994531:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049155328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826020.995051:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049155328:12345-0@lo:1000:osp_up1-0.0 Request processed in 521us (2366us total) trans 17179869802 rc 0/0 00000100:00100000:2.0:1787826020.995060:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12339 00000100:00100000:2.0:1787826020.995148:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049155328:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826020.995189:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bb9:0x0]: returning size 4096 00010000:00010000:2.0:1787826020.995224:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.995243:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.995252:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.995259:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462ac00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.995265:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.995274:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996592:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2d:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:2.0:1787826020.996596:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826020.996603:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 2/0,0 mode: --/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996612:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb8ee lrc: 0/0,0 mode: --/EX res: [0x200026560:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996633:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996643:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996650:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996699:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826020.996711:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2d:0x0] 00010000:00010000:2.0:1787826020.996719:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996726:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996732:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996738:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462bc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.996742:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996748:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996757:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb9:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826020.996759:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826020.996762:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996767:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb8e7 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996786:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996794:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996801:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996805:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826020.996808:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996815:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996822:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826020.996825:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826020.996828:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996834:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb8d9 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826020.996847:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c3bda54 reply state 000000009a182264 transno 335007449175 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996861:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826020.996870:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826020.996873:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826020.996877:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826020.997027:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:155537:x1874663042915200:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 49058us (49374us total) trans 335007449175 rc 0/0 00000100:00100000:2.0:1787826020.997037:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 692 00010000:00010000:0.0:1787826020.997106:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826020.997115:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.997124:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826020.997128:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826020.997141:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.997182:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.997190:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826020.997226:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.997234:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00ceb8f5 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb8fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.997257:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826020.997259:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826020.997270:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826020.997286:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826020.997306:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049155456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826020.997402:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826020.997458:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049155456 00000100:00100000:0.0:1787826020.997465:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049155456 00000100:00100000:0.0:1787826020.997520:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4185 00000100:00100000:0.0:1787826020.997530:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049155456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826020.997545:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826020.997567:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceb8fc lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb8f5 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826020.997588:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:0.0:1787826020.997598:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826020.997636:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049155456:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826020.997643:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4185 00000100:00100000:0.0:1787826020.997703:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049155456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826021.031204:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.031311:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042915584 00000100:00100000:2.0:1787826021.031362:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042915584 00000100:00100000:2.0:1787826021.031430:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 693 00000100:00100000:2.0:1787826021.031442:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47fb0b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:155545:x1874663042915584:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826021.031476:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.031506:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb903 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecee expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031595:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031613:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031626:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031639:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 32 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031648:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031667:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031735:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031744:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031756:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031763:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.031768:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031776:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031790:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.031794:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.031798:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031805:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb90a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031819:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031825:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031832:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031837:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.031840:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031849:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031857:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.031860:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.031863:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031869:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb911 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031902:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb903 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecee expref: 70 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031913:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.031916:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.031919:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb903 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecee expref: 70 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.031929:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39200, rc 0) 00000100:00100000:2.0:1787826021.032014:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47fb0b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:155545:x1874663042915584:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 573us (823us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826021.032022:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 693 00000100:00100000:3.0:1787826021.036478:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.036727:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042915712 00000100:00100000:0.0:1787826021.036739:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042915712 00000100:00100000:0.0:1787826021.036818:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 694 00000100:00100000:0.0:1787826021.036831:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:155545:x1874663042915712:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826021.036859:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.036888:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb918 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecf5 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.036972:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.036990:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037003:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037016:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 32 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037023:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037031:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037096:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037104:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037111:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037118:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.037123:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037131:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037145:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.037148:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.037155:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037162:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb91f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037179:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037185:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037191:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037196:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.037198:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037204:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037211:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826021.037214:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.037217:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037223:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb926 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037254:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb918 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecf5 expref: 70 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037570:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.037573:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.037577:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb918 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecf5 expref: 70 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.037589:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fe00, rc 0) 00000100:00100000:0.0:1787826021.037683:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:155545:x1874663042915712:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 853us (1219us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826021.037692:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 694 00000100:00100000:1.0:1787826021.050804:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.050977:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042915840 00000100:00100000:3.0:1787826021.050991:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042915840 00000100:00100000:3.0:1787826021.051075:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 695 00000100:00100000:3.0:1787826021.051087:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+69:155545:x1874663042915840:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826021.051113:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.051141:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb92d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ecfc expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.051230:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb934 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.051246:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb934 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.051612:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb934 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826021.051682:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:3.0:1787826021.051687:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826021.051712:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb934 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.051746:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb92d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecfc expref: 71 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.051767:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb934 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecfc expref: 70 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.051778:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.051782:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826021.051786:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462bc00, rc 0) 00000100:00100000:3.0:1787826021.051867:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+70:155545:x1874663042915840:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 782us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.051876:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 695 00000100:00100000:3.0:1787826021.063619:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.064112:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042916096 00000100:00100000:0.0:1787826021.064127:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042916096 00000100:00100000:0.0:1787826021.064222:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 696 00000100:00100000:0.0:1787826021.064237:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+70:155545:x1874663042916096:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826021.064314:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826021.064366:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb934 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ecfc expref: 70 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.064387:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.064394:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826021.064469:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.064487:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.064499:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.064511:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 32 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.064522:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.064527:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826021.065564:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].433, 2152 off666224 00000040:00080000:0.0:1787826021.065678:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].304, 2352 off506512 00000004:00080000:0.0:1787826021.065687:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172180 with version 621 00000004:00080000:1.0:1787826021.066530:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 621 rpc_version 621 00000020:00100000:1.0:1787826021.066582:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826021.066595:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479bf5180 x1874663049155712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826021.066625:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049155712:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826021.066723:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.066767:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.066771:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049155712 00000100:00100000:0.0:1787826021.066782:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049155712 00000100:00100000:0.0:1787826021.066849:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12340 00000100:00100000:0.0:1787826021.066861:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049155712:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826021.067429:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049155712:12345-0@lo:1000:osp_up1-0.0 Request processed in 569us (705us total) trans 17179869803 rc 0/0 00000100:00100000:0.0:1787826021.067439:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12340 00000100:00100000:1.0:1787826021.067557:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049155712:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826021.067707:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.067725:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.067740:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.067763:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.067771:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.067779:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.067818:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.067827:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.067838:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.067857:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049155840:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826021.067894:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.067929:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4812c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.068340:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049155840 00000100:00100000:1.0:1787826021.068347:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049155840 00000100:00100000:1.0:1787826021.068401:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12341 00000100:00100000:1.0:1787826021.068412:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049155840:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826021.068438:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.068460:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb95e lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb957 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.068489:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb95e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb957 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.068503:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb95e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb957 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.068512:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2e:0x0].0x0 (ffff8eb47f8fdb00) 00010000:00010000:1.0:1787826021.068515:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.068518:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357800, rc 0) 00000100:00100000:1.0:1787826021.068566:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049155840:12345-0@lo:101:mdt00_003.0 Request processed in 156us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.068575:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12341 00000100:00100000:0.0:1787826021.068595:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049155840:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826021.068615:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068627:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.068650:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c5deacd reply state 000000001266bf4f transno 335007449176 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068678:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068685:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2e:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:0.0:1787826021.068688:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826021.068692:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826021.068699:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068707:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826021.068719:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2e:0x0] 00000004:00010000:0.0:1787826021.068726:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c5deacd reply state 000000001266bf4f transno 335007449176 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068735:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068741:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bba:0x0].0x0 (ffff8eb47f8fe000) 00010000:00010000:0.0:1787826021.068743:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826021.068745:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787826021.068751:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bba:0x0]: returning size 4096 00010000:00010000:0.0:1787826021.068761:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068767:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068773:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068779:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fe00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.068783:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068791:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068803:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.068806:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.068810:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068816:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceb93b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.068828:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c5deacd reply state 000000001266bf4f transno 335007449176 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068837:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.068843:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826021.068846:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826021.068848:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787826021.068960:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+71:155545:x1874663042916096:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 4723us (5353us total) trans 335007449176 rc 0/0 00000100:00100000:0.0:1787826021.068970:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 696 00000100:00100000:3.0:1787826021.085873:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.085969:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042916224 00000100:00100000:2.0:1787826021.085983:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042916224 00000100:00100000:2.0:1787826021.088497:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 697 00000100:00100000:2.0:1787826021.088522:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+71:155550:x1874663042916224:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826021.088559:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.088586:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb965 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed03 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088683:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088700:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088714:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088726:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 33 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088734:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088741:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088843:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb97a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088852:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb97a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.088860:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb97a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826021.088971:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bba:0x0]: returning size 4096 00000004:00200000:2.0:1787826021.088977:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826021.089002:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb97a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089016:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089022:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089030:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089037:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.089041:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089049:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089064:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.089068:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.089073:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089080:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb96c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089093:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089100:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089112:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089117:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.089120:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089126:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089133:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.089136:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.089139:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089144:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb973 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089174:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb965 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed03 expref: 73 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089189:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb97a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed03 expref: 72 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.089196:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bba:0x0].0x0 (ffff8eb47f8fe000) 00010000:00010000:2.0:1787826021.089198:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826021.089201:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39c00, rc 0) 00000100:00100000:2.0:1787826021.089299:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+72:155550:x1874663042916224:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 785us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.089309:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 697 00000100:00100000:0.0:1787826021.098917:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.099023:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042916352 00000100:00100000:3.0:1787826021.099036:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042916352 00000100:00100000:3.0:1787826021.099112:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 698 00000100:00100000:3.0:1787826021.099125:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+72:155550:x1874663042916352:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826021.099151:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.099181:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb981 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed0a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.099508:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.099529:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.099545:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826021.099608:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x2e:0x0]: returning size 4096 00000004:00200000:3.0:1787826021.099615:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826021.099673:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb981 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 74 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.099693:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 73 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.099703:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2e:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:3.0:1787826021.099706:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826021.099711:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34462ac00, rc 0) 00000100:00100000:3.0:1787826021.099787:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:155550:x1874663042916352:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 665us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.099796:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 698 00000100:00100000:3.0:1787826021.102069:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.102176:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042916480 00000100:00100000:1.0:1787826021.102188:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042916480 00000100:00100000:1.0:1787826021.102255:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 699 00000100:00100000:1.0:1787826021.102278:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155550:x1874663042916480:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826021.102310:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.102369:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceb98f lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed11 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102453:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102469:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb95e lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb957 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102479:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102523:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb95e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceb957 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.102543:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049155968:0@lo:104: 00000100:00100000:1.0:1787826021.102604:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.102647:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.102679:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049155968 00000100:00100000:1.0:1787826021.102684:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049155968 00000100:00100000:1.0:1787826021.102715:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4725 00000100:00100000:1.0:1787826021.102722:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049155968:12345-0@lo:104: 00010000:00010000:1.0:1787826021.102736:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102792:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826021.102799:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049155968:12345-0@lo:104: Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.102806:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4725 00010000:00010000:1.0:1787826021.102838:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826021.102845:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102854:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826021.102860:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826021.102871:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102906:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102913:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826021.102939:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102946:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceb957 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceb95e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.102980:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826021.102982:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826021.102983:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826021.102996:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049156096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826021.103031:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.103068:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049156096 00000100:00100000:1.0:1787826021.103072:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049156096 00010000:00010000:1.0:1787826021.103092:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb95e lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ceb957 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.103116:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12156 00000100:00100000:1.0:1787826021.103123:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049156096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.103133:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826021.103231:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049155968:0@lo:104: 00010000:00010000:1.0:1787826021.103256:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826021.114233:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869803 is committed 00010000:00010000:1.0:1787826021.117104:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceb95e lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceb957 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.117134:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2e:0x0].0x0 (ffff8eb47f8fdb00) 00010000:00010000:1.0:1787826021.117140:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.117151:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.117159:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.117202:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826021.117547:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049156096:12345-0@lo:103:ldlm_bl.0 Request processed in 14197us (14288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.117562:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12156 00000100:00100000:1.0:1787826021.117648:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049156096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826021.118665:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.118686:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826021.118758:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x2e:0x0]: returning size 4096 00000004:00200000:3.0:1787826021.118765:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826021.118823:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceb98f lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.118845:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.118857:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2e:0x0].0x0 (ffff8eb47f8fdb00) 00010000:00010000:3.0:1787826021.118861:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826021.118865:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357600, rc 0) 00000100:00100000:3.0:1787826021.118940:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155550:x1874663042916480:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 16664us (16879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.118949:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 699 00000100:00100000:0.0:1787826021.124543:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.124699:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042916736 00000100:00100000:3.0:1787826021.124713:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042916736 00000100:00100000:3.0:1787826021.124812:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 700 00000100:00100000:3.0:1787826021.124826:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:155550:x1874663042916736:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:3.0:1787826021.124899:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826021.124935:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb97a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed03 expref: 73 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.124957:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bba:0x0].0x0 (ffff8eb47f8fe000) 00010000:00010000:3.0:1787826021.124966:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826021.124997:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125015:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125027:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125038:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 33 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125052:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125059:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125160:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125170:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125178:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125201:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125211:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 72 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125226:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125282:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 72 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.125300:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 72 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.125317:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049156224:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826021.125528:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.142281:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.142665:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049156224:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826021.142702:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.143251:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042916864 00000100:00100000:1.0:1787826021.143261:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042916864 00010000:00010000:1.0:1787826021.143315:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 73 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.143490:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12157 00000100:00100000:1.0:1787826021.143503:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:2392:x1874663042916864:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.143524:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826021.143533:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 73 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.143549:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 73 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.143575:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ac00/0x878a5eea00ceb988 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed0a expref: 73 pid: 187904 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.143591:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2e:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:1.0:1787826021.143597:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.143609:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.143618:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.143646:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826021.143742:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+72:2392:x1874663042916864:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 241us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.143751:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12157 00010000:00010000:3.0:1787826021.144614:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.144630:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.144720:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.144730:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.144742:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.145430:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049156352:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787826021.145516:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826021.145563:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.145625:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049156352 00000100:00100000:0.0:1787826021.145634:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049156352 00000100:00100000:0.0:1787826021.146830:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12342 00000100:00100000:0.0:1787826021.146851:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049156352:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787826021.146878:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.146906:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceb9c0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceb9b9 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.146946:0:177386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.146959:0:177386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceb9c0 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb9b9 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.147002:0:177386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.147018:0:177386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 6 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.147033:0:177386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049156480:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826021.147141:0:177386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4812c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.153604:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.154087:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042916992 00000100:00100000:3.0:1787826021.154103:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042916992 00010000:00010000:3.0:1787826021.154166:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.154226:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12158 00000100:00100000:3.0:1787826021.154238:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042916992:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826021.154257:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826021.154282:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.154298:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.154352:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2e:0x0].0x0 (ffff8eb47f8fdb00) 00010000:00010000:3.0:1787826021.154361:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceb9c0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceb9b9 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.154374:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceb9c0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00ceb9b9 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.154383:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceb9c0 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00ceb9b9 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.154784:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceb9c0 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb9b9 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.154803:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049156608:0@lo:105: 00000100:00100000:3.0:1787826021.154882:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826021.154974:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896bb40 going to sleep for 11 seconds 00010000:00010000:1.0:1787826021.160018:0:177386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceb996 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed11 expref: 7 pid: 187905 timeout: 8187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.160052:0:177386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049156480:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826021.160095:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceb9c0 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceb9b9 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.160112:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2e:0x0].0x0 (ffff8eb47f8fdb00) 00010000:00010000:1.0:1787826021.160117:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826021.160121:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f800, rc 0) 00000100:00100000:1.0:1787826021.160304:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049156352:12345-0@lo:101:mdt00_000.0 Request processed in 13459us (14787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.160314:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12342 00000100:00100000:0.0:1787826021.160725:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049156608 00000100:00100000:0.0:1787826021.160735:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049156608 00000100:00100000:0.0:1787826021.160799:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4726 00000100:00100000:0.0:1787826021.160810:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049156608:12345-0@lo:105: 00010000:00010000:0.0:1787826021.160827:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.160839:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.160850:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.160861:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.160872:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.160882:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.160900:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab19800) 00000100:00100000:0.0:1787826021.160956:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049156608:12345-0@lo:105: Request processed in 148us (6075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.160962:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4726 00000100:00100000:0.0:1787826021.160999:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049156608:0@lo:105: 00010000:00010000:0.0:1787826021.161018:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826021.161071:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042916992:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 6835us (7480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.161082:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12158 00000100:00100000:3.0:1787826021.167896:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869803 gen 2 00000004:00080000:3.0:1787826021.167912:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869802 committed transno 17179869803 00000004:00080000:3.0:1787826021.167943:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869803 committed transno 17179869803 00000100:00100000:3.0:1787826021.167967:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049156352:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826021.168000:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.169675:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049156736:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1787826021.169779:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826021.169828:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826021.170170:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049156736 00000100:00100000:2.0:1787826021.170180:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049156736 00000100:00100000:2.0:1787826021.170250:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12343 00000100:00100000:2.0:1787826021.170261:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049156736:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787826021.172316:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049156736:12345-0@lo:403:mdt00_000.0 Request processed in 2044us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.172358:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12343 00000100:00100000:0.0:1787826021.172389:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049156736:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1787826021.173441:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].434, 656 off666880 00000040:00080000:0.0:1787826021.173638:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].305, 736 off507248 00000004:00080000:0.0:1787826021.173645:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4812c1240 with version 622 00000004:00080000:1.0:1787826021.173754:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 622 rpc_version 622 00000020:00100000:1.0:1787826021.173794:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826021.173804:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66ed80 x1874663049156992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826021.173829:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049156992:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826021.173893:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.173930:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.173936:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049156992 00000100:00100000:0.0:1787826021.173945:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049156992 00000100:00100000:0.0:1787826021.174005:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12344 00000100:00100000:0.0:1787826021.174015:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049156992:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826021.174242:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049156992:12345-0@lo:1000:osp_up1-0.0 Request processed in 227us (349us total) trans 17179869804 rc 0/0 00000100:00100000:1.0:1787826021.174293:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049156992:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826021.174300:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12344 00000004:00200000:1.0:1787826021.174365:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bba:0x0]: returning size 4096 00010000:00010000:0.0:1787826021.174602:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174615:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174623:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174629:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462bc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.174634:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174642:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174676:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2e:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:0.0:1787826021.174679:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826021.174685:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174691:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462bc00/0x878a5eea00ceb9b2 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174706:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174714:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174725:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174751:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826021.174759:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2e:0x0] 00010000:00010000:0.0:1787826021.174765:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174771:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174776:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174780:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462be00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.174783:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174788:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174795:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bba:0x0].0x0 (ffff8eb47f8fe000) 00010000:00010000:0.0:1787826021.174798:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826021.174800:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174805:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462be00/0x878a5eea00ceb9ab lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174818:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174823:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174828:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174832:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462ba00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.174835:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174839:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174846:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.174848:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.174850:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174855:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ba00/0x878a5eea00ceb99d lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.174863:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4612746 reply state 0000000068ffc66d transno 335007449177 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174876:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.174882:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826021.174885:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826021.174887:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826021.174963:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:155550:x1874663042916736:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 50139us (50433us total) trans 335007449177 rc 0/0 00000100:00100000:0.0:1787826021.174971:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 700 00010000:00010000:2.0:1787826021.175718:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826021.175729:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.175740:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19800 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826021.175747:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826021.175757:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.175798:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.175806:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826021.175835:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.175843:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19800/0x878a5eea00ceb9b9 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceb9c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.175856:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049157120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826021.175868:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826021.175871:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826021.175874:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826021.175912:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826021.175974:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049157120 00000100:00100000:2.0:1787826021.175981:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049157120 00000100:00100000:2.0:1787826021.176043:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4186 00000100:00100000:2.0:1787826021.176053:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4502d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049157120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826021.176068:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826021.176092:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceb9c0 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceb9b9 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.176106:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2e:0x0].0x0 (ffff8eb47f8fdb00) 00010000:00010000:2.0:1787826021.176116:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826021.176158:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4502d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049157120:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.176165:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4186 00000100:00100000:2.0:1787826021.176238:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049157120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826021.206039:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826021.233499:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.233703:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042917120 00000100:00100000:2.0:1787826021.233726:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042917120 00000100:00100000:2.0:1787826021.233800:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 701 00000100:00100000:2.0:1787826021.233812:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:155563:x1874663042917120:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826021.233844:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.233870:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb9c7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed18 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.233951:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.233969:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.233982:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.233996:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 34 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234005:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234018:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234068:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234077:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234084:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234091:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.234096:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234105:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234123:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.234126:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.234132:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234138:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceb9ce lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234152:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234159:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234166:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234171:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.234174:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234180:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234187:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.234190:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.234192:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234198:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceb9d5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234230:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb9c7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed18 expref: 74 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234242:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.234245:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.234249:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00ceb9c7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed18 expref: 74 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.234259:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38200, rc 0) 00000100:00100000:2.0:1787826021.234603:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:155563:x1874663042917120:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 791us (1117us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826021.234612:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 701 00000100:00100000:0.0:1787826021.244986:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.245063:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042917248 00000100:00100000:2.0:1787826021.245076:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042917248 00000100:00100000:2.0:1787826021.245156:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 702 00000100:00100000:2.0:1787826021.245169:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:155563:x1874663042917248:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826021.245198:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.245224:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb9dc lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed1f expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245319:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245372:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245385:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245401:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 34 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245410:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245427:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245477:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245485:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245492:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245499:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.245504:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245512:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245527:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.245530:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.245536:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245542:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceb9e3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245559:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245566:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245572:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245577:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.245580:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245587:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245594:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.245596:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.245600:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245606:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceb9ea lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245638:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb9dc lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed1f expref: 74 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245649:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.245661:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.245666:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceb9dc lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed1f expref: 74 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.245676:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39200, rc 0) 00000100:00100000:2.0:1787826021.245755:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:155563:x1874663042917248:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 589us (784us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826021.245762:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 702 00000100:00100000:3.0:1787826021.249252:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.249557:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042917376 00000100:00100000:2.0:1787826021.249570:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042917376 00000100:00100000:2.0:1787826021.249639:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 703 00000100:00100000:2.0:1787826021.249651:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+73:155563:x1874663042917376:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826021.249683:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.249722:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceb9f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed26 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.249805:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb9f8 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.249820:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb9f8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.249832:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb9f8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826021.249887:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826021.249892:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826021.249914:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb9f8 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.249940:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceb9f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed26 expref: 75 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.249963:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb9f8 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed26 expref: 74 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.249973:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.249977:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826021.249981:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4429cb000, rc 0) 00000100:00100000:2.0:1787826021.250168:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+74:155563:x1874663042917376:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 518us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.250176:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 703 00000100:00100000:2.0:1787826021.271935:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.272431:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042917632 00000100:00100000:0.0:1787826021.272448:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042917632 00000100:00100000:0.0:1787826021.272531:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 704 00000100:00100000:0.0:1787826021.272545:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+74:155563:x1874663042917632:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826021.272636:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826021.272686:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceb9f8 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed26 expref: 74 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.272711:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.272717:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826021.272808:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.272825:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.272836:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.272849:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 34 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.272864:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.272872:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826021.273924:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].435, 2152 off669032 00000040:00080000:0.0:1787826021.274023:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].306, 2352 off509600 00000004:00080000:0.0:1787826021.274031:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fbb40 with version 623 00000004:00080000:2.0:1787826021.274844:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 623 rpc_version 623 00000020:00100000:2.0:1787826021.274898:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826021.274912:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34bdf6d80 x1874663049157376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826021.274941:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049157376:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826021.275032:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826021.275082:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.275686:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049157376 00000100:00100000:0.0:1787826021.275698:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049157376 00000100:00100000:0.0:1787826021.275762:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12345 00000100:00100000:0.0:1787826021.275774:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a7ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049157376:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826021.276958:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a7ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049157376:12345-0@lo:1000:osp_up1-0.0 Request processed in 1180us (1919us total) trans 17179869805 rc 0/0 00000100:00100000:0.0:1787826021.276973:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12345 00000100:00100000:2.0:1787826021.277281:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049157376:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826021.281200:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.281228:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.281243:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.281269:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.282664:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.282686:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.282763:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.282772:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.282785:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.282820:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049157504:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826021.282908:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.282957:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.283084:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049157504 00000100:00100000:1.0:1787826021.283094:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049157504 00000100:00100000:1.0:1787826021.283161:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12346 00000100:00100000:1.0:1787826021.283173:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049157504:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826021.283198:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.283219:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceba22 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceba1b expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.283249:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceba22 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceba1b expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.283267:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceba22 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceba1b expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.283284:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2f:0x0].0x0 (ffff8eb45edbdd00) 00010000:00010000:1.0:1787826021.283288:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.283292:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356000, rc 0) 00000100:00100000:1.0:1787826021.283365:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049157504:12345-0@lo:101:mdt00_003.0 Request processed in 193us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.283388:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12346 00000100:00100000:2.0:1787826021.283425:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049157504:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826021.283447:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283458:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826021.283492:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029d46236 reply state 0000000082e3acdf transno 335007449178 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283507:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283513:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2f:0x0].0x0 (ffff8eb47f8fee00) 00010000:00010000:2.0:1787826021.283516:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826021.283520:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826021.283527:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283536:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826021.283550:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2f:0x0] 00000004:00010000:2.0:1787826021.283558:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029d46236 reply state 0000000082e3acdf transno 335007449178 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283566:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283573:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbb:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:2.0:1787826021.283575:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826021.283577:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787826021.283584:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbb:0x0]: returning size 4096 00010000:00010000:2.0:1787826021.283595:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283602:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283610:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283616:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.283621:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283630:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283662:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.283665:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.283669:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283676:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00ceb9ff lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826021.283693:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029d46236 reply state 0000000082e3acdf transno 335007449178 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283703:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.283709:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.283712:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826021.283714:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787826021.283818:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+75:155563:x1874663042917632:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 11274us (11895us total) trans 335007449178 rc 0/0 00000100:00100000:2.0:1787826021.283826:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 704 00000100:00100000:0.0:1787826021.299173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.299294:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042917760 00000100:00100000:3.0:1787826021.299307:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042917760 00000100:00100000:3.0:1787826021.299427:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 705 00000100:00100000:3.0:1787826021.299439:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+75:155570:x1874663042917760:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826021.299472:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.299498:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00ceba29 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed2d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299599:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299617:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299630:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299645:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 35 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299665:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299673:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299768:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00ceba3e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299777:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00ceba3e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299784:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00ceba3e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826021.299894:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbb:0x0]: returning size 4096 00000004:00200000:3.0:1787826021.299901:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826021.299926:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00ceba3e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299944:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299951:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299958:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299964:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826021.299968:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299976:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.299990:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.299993:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.299999:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300005:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00ceba30 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300020:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300026:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300032:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300037:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826021.300041:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300047:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300483:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826021.300486:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.300490:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300497:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00ceba37 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300531:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00ceba29 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed2d expref: 77 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300598:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00ceba3e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed2d expref: 76 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.300607:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbb:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:3.0:1787826021.300609:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826021.300612:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18400, rc 0) 00000100:00100000:3.0:1787826021.300708:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+76:155570:x1874663042917760:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1270us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.300717:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 705 00000100:00100000:3.0:1787826021.312381:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.314706:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042917888 00000100:00100000:2.0:1787826021.314724:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042917888 00000100:00100000:2.0:1787826021.314797:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 706 00000100:00100000:2.0:1787826021.314810:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+76:155570:x1874663042917888:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826021.314837:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.314867:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba45 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed34 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.314948:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 3/1,0 mode: --/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.314965:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.314978:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826021.315048:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x2f:0x0]: returning size 4096 00000004:00200000:2.0:1787826021.315053:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826021.315096:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba45 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 78 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.315114:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 77 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.315123:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2f:0x0].0x0 (ffff8eb47f8fee00) 00010000:00010000:2.0:1787826021.315126:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826021.315130:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4429cb000, rc 0) 00000100:00100000:2.0:1787826021.315223:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:155570:x1874663042917888:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 416us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.315232:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 706 00000100:00100000:3.0:1787826021.328074:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.328175:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042918016 00000100:00100000:0.0:1787826021.328188:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042918016 00000100:00100000:0.0:1787826021.328267:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 707 00000100:00100000:0.0:1787826021.328288:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155570:x1874663042918016:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826021.328315:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.328382:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceba53 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed3b expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.328474:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.328493:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceba22 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceba1b expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.328505:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.328554:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceba22 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ceba1b expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.328574:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049157632:0@lo:104: 00000100:00100000:0.0:1787826021.328642:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.328703:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.328724:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049157632 00000100:00100000:1.0:1787826021.328730:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049157632 00000100:00100000:1.0:1787826021.328771:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4727 00000100:00100000:1.0:1787826021.328779:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049157632:12345-0@lo:104: 00010000:00010000:1.0:1787826021.328793:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.328856:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826021.328863:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049157632:12345-0@lo:104: Request processed in 86us (221us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826021.328868:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787826021.328869:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4727 00010000:00010000:0.0:1787826021.328875:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.328883:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826021.328889:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.328899:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.328930:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.328938:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826021.328969:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.328977:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00ceba1b lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ceba22 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.329001:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826021.329003:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826021.329005:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826021.329013:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826021.329026:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049157760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826021.329059:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.329120:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049157632:0@lo:104: 00010000:00010000:0.0:1787826021.329145:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.329147:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049157760 00000100:00100000:1.0:1787826021.329151:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049157760 00010000:00010000:1.0:1787826021.329171:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceba22 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ceba1b expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.329202:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12159 00000100:00100000:1.0:1787826021.329209:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3617:x1874663049157760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.329221:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787826021.333938:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869805 is committed 00010000:00010000:1.0:1787826021.338667:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceba22 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ceba1b expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.338696:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2f:0x0].0x0 (ffff8eb45edbdd00) 00010000:00010000:1.0:1787826021.338703:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.338715:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.338724:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.338764:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826021.338859:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.338871:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.338874:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049157760:12345-0@lo:103:ldlm_bl.0 Request processed in 9662us (9810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.338889:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12159 00000004:00200000:2.0:1787826021.338962:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x2f:0x0]: returning size 4096 00000004:00200000:2.0:1787826021.338969:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826021.339025:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceba53 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.339045:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.339053:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2f:0x0].0x0 (ffff8eb45edbdd00) 00010000:00010000:2.0:1787826021.339056:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826021.339059:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f400, rc 0) 00000100:00100000:2.0:1787826021.339132:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155570:x1874663042918016:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 10848us (11072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.339140:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 707 00000100:00100000:3.0:1787826021.339523:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049157760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826021.342993:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.343095:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042918272 00000100:00100000:2.0:1787826021.343108:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042918272 00000100:00100000:2.0:1787826021.343183:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 708 00000100:00100000:2.0:1787826021.343195:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:155570:x1874663042918272:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:2.0:1787826021.343269:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826021.343467:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00ceba3e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed2d expref: 77 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.343494:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbb:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:2.0:1787826021.343500:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826021.343534:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.343625:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.343639:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.343666:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 35 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.343681:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.343688:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.343992:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.344001:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.344009:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.344036:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.344047:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 76 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.344056:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.344099:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 76 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.344117:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 76 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826021.344135:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049157888:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826021.344299:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.346371:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049157888:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826021.346409:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.348913:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.349624:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042918400 00000100:00100000:1.0:1787826021.349638:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042918400 00010000:00010000:1.0:1787826021.349707:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 77 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.349756:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12160 00000100:00100000:1.0:1787826021.349769:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:2391:x1874663042918400:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.349786:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826021.349794:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 77 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.349815:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 77 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.349844:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cb000/0x878a5eea00ceba4c lrc: 0/0,0 mode: --/PR res: [0x200026560:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed34 expref: 77 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.349861:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2f:0x0].0x0 (ffff8eb47f8fee00) 00010000:00010000:1.0:1787826021.349867:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.349878:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.349887:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.349927:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826021.349938:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.349946:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.349999:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+76:2391:x1874663042918400:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 233us (1100us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826021.350004:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.350007:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12160 00010000:00010000:3.0:1787826021.350012:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.350022:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.350043:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049158016:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826021.350100:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826021.350135:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.350378:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049158016 00000100:00100000:1.0:1787826021.350384:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049158016 00000100:00100000:1.0:1787826021.350417:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12347 00000100:00100000:1.0:1787826021.350423:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049158016:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826021.350441:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.350459:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceba7d expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.350491:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.350502:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.350528:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.350543:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 6 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.350555:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049158144:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826021.350609:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.361695:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049158144:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826021.361757:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.361772:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2f:0x0].0x0 (ffff8eb45edbdd00) 00010000:00010000:1.0:1787826021.361776:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826021.361781:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.361792:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.361806:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357600, rc 0) 00000100:00100000:3.0:1787826021.364755:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.364855:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042918528 00000100:00100000:2.0:1787826021.364867:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042918528 00010000:00010000:2.0:1787826021.364922:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826021.364980:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12161 00000100:00100000:2.0:1787826021.364991:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042918528:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826021.365009:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826021.365017:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.365037:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.365065:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceba5a lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed3b expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.365083:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2f:0x0].0x0 (ffff8eb45edbdd00) 00010000:00010000:2.0:1787826021.365091:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.365103:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.365113:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.365154:0:6476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826021.365170:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6476:1874663049158272:0@lo:105: 00000100:00100000:2.0:1787826021.365236:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826021.365516:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.370983:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049158016:12345-0@lo:101:mdt00_003.0 Request processed in 20541us (20865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.371001:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12347 00000100:00100000:1.0:1787826021.371110:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869805 gen 2 00000004:00080000:1.0:1787826021.371118:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869804 committed transno 17179869805 00000004:00080000:1.0:1787826021.371150:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869805 committed transno 17179869805 00000100:00100000:1.0:1787826021.371171:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049158016:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826021.371202:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.371216:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.372449:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049158272 00000100:00100000:3.0:1787826021.372465:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049158272 00000100:00100000:3.0:1787826021.372548:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4728 00000100:00100000:3.0:1787826021.372561:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6476:x1874663049158272:12345-0@lo:105: 00010000:00010000:3.0:1787826021.372580:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.372595:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.372606:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.372617:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.372626:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.372636:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.372680:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab18a00) 00000100:00100000:3.0:1787826021.372758:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6476:x1874663049158272:12345-0@lo:105: Request processed in 199us (7520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.372767:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4728 00010000:00010000:1.0:1787826021.372812:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.372821:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6476:1874663049158272:0@lo:105: 00010000:00010000:1.0:1787826021.372826:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.372845:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826021.372912:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042918528:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 7920us (8170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.372927:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12161 00000100:00100000:1.0:1787826021.374159:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049158400:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787826021.374235:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.374279:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826021.374314:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049158400 00000100:00100000:2.0:1787826021.374322:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049158400 00000100:00100000:2.0:1787826021.374397:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12348 00000100:00100000:2.0:1787826021.374408:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049158400:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787826021.376391:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049158400:12345-0@lo:403:mdt00_003.0 Request processed in 1974us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.376407:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12348 00000100:00100000:1.0:1787826021.376769:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049158400:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1787826021.379294:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].436, 656 off669688 00000040:00080000:1.0:1787826021.381716:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].307, 736 off510336 00000004:00080000:1.0:1787826021.381735:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925e600 with version 624 00000004:00080000:3.0:1787826021.381917:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 624 rpc_version 624 00000020:00100000:3.0:1787826021.381964:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826021.381977:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47f995180 x1874663049158656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826021.382006:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049158656:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826021.382095:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826021.382140:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.382148:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049158656 00000100:00100000:1.0:1787826021.382157:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049158656 00000100:00100000:1.0:1787826021.382276:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12349 00000100:00100000:1.0:1787826021.382289:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049158656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826021.382637:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049158656:12345-0@lo:1000:osp_up1-0.0 Request processed in 349us (541us total) trans 17179869806 rc 0/0 00000100:00100000:1.0:1787826021.382647:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12349 00000100:00100000:0.0:1787826021.383678:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049158656:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826021.383929:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbb:0x0]: returning size 4096 00010000:00010000:1.0:1787826021.383959:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.383971:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.383979:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.383986:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.383992:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384000:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384019:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2f:0x0].0x0 (ffff8eb47f8fee00) 00010000:00010000:1.0:1787826021.384022:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826021.384026:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384036:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba76 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384109:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384118:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384126:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384190:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826021.384202:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x2f:0x0] 00010000:00010000:1.0:1787826021.384211:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384218:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384224:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384230:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.384233:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384240:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384254:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbb:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:1.0:1787826021.384257:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826021.384269:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384276:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba6f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384293:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384299:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384305:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384310:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4429cba00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.384314:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384319:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384352:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826021.384354:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.384358:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384363:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cba00/0x878a5eea00ceba61 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826021.384379:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070ad41a7 reply state 00000000aa9fc41e transno 335007449179 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384393:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.384400:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826021.384403:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826021.384406:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826021.384502:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:155570:x1874663042918272:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 41306us (41518us total) trans 335007449179 rc 0/0 00000100:00100000:1.0:1787826021.384511:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 708 00010000:00010000:0.0:1787826021.386482:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826021.386497:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.386510:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826021.386518:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.386528:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.386842:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.386850:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787826021.386918:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049158784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826021.387000:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.387138:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049158784 00000100:00100000:1.0:1787826021.387147:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049158784 00000100:00100000:1.0:1787826021.387214:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4187 00000100:00100000:1.0:1787826021.387224:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3619:x1874663049158784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.387239:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826021.387276:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357600/0x878a5eea00ceba84 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceba7d expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.387295:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x2f:0x0].0x0 (ffff8eb45edbdd00) 00010000:00010000:1.0:1787826021.387309:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826021.387463:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.387472:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18a00/0x878a5eea00ceba7d lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceba84 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.387493:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826021.387495:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826021.387497:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826021.390198:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049158784:12345-0@lo:103:ldlm_bl.0 Request processed in 2874us (3098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.390213:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4187 00000100:00100000:2.0:1787826021.395825:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049158784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826021.428901:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.428992:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042918656 00000100:00100000:2.0:1787826021.429007:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042918656 00000100:00100000:2.0:1787826021.429085:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 709 00000100:00100000:2.0:1787826021.429098:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:155574:x1874663042918656:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826021.429131:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.429158:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceba8b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed42 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429249:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429267:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429292:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429306:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 36 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429315:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429321:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429438:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429445:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429452:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429459:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.429464:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429473:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429487:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.429491:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.429496:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429504:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00ceba92 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429515:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429521:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429528:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429534:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.429537:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429544:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429551:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.429554:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.429557:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429562:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00ceba99 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429595:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceba8b lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed42 expref: 78 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429607:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.429609:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.429613:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ceba8b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed42 expref: 78 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.429623:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38000, rc 0) 00000100:00100000:2.0:1787826021.429907:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:155574:x1874663042918656:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 809us (1019us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826021.429917:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 709 00000100:00100000:2.0:1787826021.438605:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.441929:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042918784 00000100:00100000:0.0:1787826021.441950:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042918784 00000100:00100000:0.0:1787826021.442112:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 710 00000100:00100000:0.0:1787826021.442125:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:155574:x1874663042918784:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826021.442153:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.442181:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebaa0 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed49 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442265:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442294:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442309:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442345:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 36 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442354:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442361:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442430:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442437:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442444:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442450:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.442454:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442461:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442474:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.442477:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.442480:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442486:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebaa7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442499:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442505:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442510:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442516:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.442519:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442525:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442531:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826021.442533:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.442536:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442541:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebaae lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442572:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebaa0 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed49 expref: 78 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442583:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.442586:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.442589:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebaa0 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed49 expref: 78 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.442598:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fa00, rc 0) 00000100:00100000:0.0:1787826021.442700:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:155574:x1874663042918784:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 577us (4112us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826021.444152:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 710 00000100:00100000:1.0:1787826021.449197:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.449604:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042918912 00000100:00100000:3.0:1787826021.449617:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042918912 00000100:00100000:3.0:1787826021.449699:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 711 00000100:00100000:3.0:1787826021.449711:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+77:155574:x1874663042918912:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826021.449737:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.449765:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed50 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.449853:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cebabc lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.449871:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cebabc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.449884:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cebabc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826021.449944:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:3.0:1787826021.449949:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826021.449973:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cebabc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.450002:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed50 expref: 79 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.450022:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cebabc lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed50 expref: 78 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.450032:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.450035:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826021.450040:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19c00, rc 0) 00000100:00100000:3.0:1787826021.450117:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+78:155574:x1874663042918912:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 407us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.450125:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 711 00000100:00100000:3.0:1787826021.456742:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.456821:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042919168 00000100:00100000:2.0:1787826021.456834:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042919168 00000100:00100000:2.0:1787826021.456912:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 712 00000100:00100000:2.0:1787826021.456927:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+78:155574:x1874663042919168:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:2.0:1787826021.457006:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826021.457043:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cebabc lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed50 expref: 78 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.457066:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.457072:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826021.457152:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.457169:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.457181:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.457194:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 36 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.457210:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.457217:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826021.459019:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].437, 2152 off671840 00000040:00080000:2.0:1787826021.459121:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].308, 2352 off512688 00000004:00080000:2.0:1787826021.459129:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3436b26c0 with version 625 00000004:00080000:0.0:1787826021.466020:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 625 rpc_version 625 00000020:00100000:0.0:1787826021.466099:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826021.466114:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a428380 x1874663049159040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826021.466145:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049159040:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826021.466235:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.466288:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.466348:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049159040 00000100:00100000:0.0:1787826021.466358:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049159040 00000100:00100000:0.0:1787826021.467208:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12350 00000100:00100000:0.0:1787826021.467223:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049159040:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826021.468044:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049159040:12345-0@lo:1000:osp_up1-0.0 Request processed in 822us (1805us total) trans 17179869807 rc 0/0 00000100:00100000:0.0:1787826021.468065:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12350 00000100:00100000:0.0:1787826021.468944:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049159040:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826021.469270:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.469290:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.469305:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.469353:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.469363:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.469371:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.469419:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.469427:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.469438:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.469461:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f994a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049159168:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826021.469525:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826021.469558:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.470917:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049159168 00000100:00100000:0.0:1787826021.470938:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049159168 00000100:00100000:0.0:1787826021.471013:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12351 00000100:00100000:0.0:1787826021.471024:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049159168:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826021.471054:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.471080:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebae6 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebadf expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471114:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebae6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebadf expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471128:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebae6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebadf expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471141:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x30:0x0].0x0 (ffff8eb480de3e00) 00010000:00010000:0.0:1787826021.471144:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.471148:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fa00, rc 0) 00000100:00100000:0.0:1787826021.471228:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049159168:12345-0@lo:101:mdt00_003.0 Request processed in 205us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.471235:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12351 00000100:00100000:0.0:1787826021.471292:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f994a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049159168:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826021.471313:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471353:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.471384:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000070ca843 reply state 00000000d3a03094 transno 335007449180 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471396:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471403:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x30:0x0].0x0 (ffff8eb472727300) 00010000:00010000:0.0:1787826021.471406:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826021.471410:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826021.471416:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471424:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826021.471442:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x30:0x0] 00000004:00010000:0.0:1787826021.471448:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000070ca843 reply state 00000000d3a03094 transno 335007449180 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471456:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471463:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbc:0x0].0x0 (ffff8eb472727a00) 00010000:00010000:0.0:1787826021.471465:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826021.471467:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787826021.471474:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbc:0x0]: returning size 4096 00010000:00010000:0.0:1787826021.471483:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471489:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471495:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471502:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.471506:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471515:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471526:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.471528:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.471531:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471538:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00cebac3 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.471548:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000070ca843 reply state 00000000d3a03094 transno 335007449180 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471557:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.471563:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826021.471565:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826021.471567:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787826021.471979:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+79:155574:x1874663042919168:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 15053us (15249us total) trans 335007449180 rc 0/0 00000100:00100000:0.0:1787826021.471988:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 712 00000100:00100000:2.0:1787826021.481491:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.481626:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042919296 00000100:00100000:1.0:1787826021.481639:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042919296 00000100:00100000:1.0:1787826021.481756:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 713 00000100:00100000:1.0:1787826021.481768:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+79:155581:x1874663042919296:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826021.481798:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.481823:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebaed lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed57 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.481906:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.481923:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.481936:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.481949:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 37 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.481957:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.481964:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482078:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebb02 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482087:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebb02 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482099:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebb02 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826021.482199:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbc:0x0]: returning size 4096 00000004:00200000:1.0:1787826021.482205:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787826021.482229:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebb02 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482244:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482250:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482257:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482263:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.482268:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482276:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482290:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826021.482294:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.482299:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482306:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebaf4 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482348:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482355:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482362:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482367:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.482370:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482376:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482384:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826021.482387:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.482390:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482396:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebafb lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482430:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebaed lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed57 expref: 81 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482444:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebb02 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed57 expref: 80 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.482457:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbc:0x0].0x0 (ffff8eb472727a00) 00010000:00010000:1.0:1787826021.482459:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826021.482462:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:1.0:1787826021.482544:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+80:155581:x1874663042919296:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 777us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.482552:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 713 00000100:00100000:3.0:1787826021.488214:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.489878:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042919424 00000100:00100000:0.0:1787826021.489898:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042919424 00000100:00100000:0.0:1787826021.489985:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 714 00000100:00100000:0.0:1787826021.489998:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+80:155581:x1874663042919424:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826021.490023:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.490050:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb09 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed5e expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.490125:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.490142:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.490161:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826021.490227:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x30:0x0]: returning size 4096 00000004:00200000:0.0:1787826021.490234:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826021.490276:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb09 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 82 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.490294:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 81 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.490304:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x30:0x0].0x0 (ffff8eb472727300) 00010000:00010000:0.0:1787826021.490308:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826021.490312:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fc00, rc 0) 00000100:00100000:0.0:1787826021.490422:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:155581:x1874663042919424:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 427us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.490430:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 714 00000100:00100000:1.0:1787826021.496679:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.496810:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042919552 00000100:00100000:0.0:1787826021.496825:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042919552 00000100:00100000:0.0:1787826021.496900:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 715 00000100:00100000:0.0:1787826021.496914:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155581:x1874663042919552:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826021.496941:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.496969:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cebb17 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed65 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.497052:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.497076:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebae6 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebadf expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.497087:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.497130:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebae6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cebadf expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.497149:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049159296:0@lo:104: 00000100:00100000:0.0:1787826021.497210:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.497269:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.497876:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049159296 00000100:00100000:3.0:1787826021.497884:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049159296 00000100:00100000:3.0:1787826021.497926:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4729 00000100:00100000:3.0:1787826021.497936:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049159296:12345-0@lo:104: 00010000:00010000:3.0:1787826021.497952:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.498022:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826021.498029:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049159296:12345-0@lo:104: Request processed in 96us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.498040:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4729 00010000:00010000:3.0:1787826021.498065:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826021.498072:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.498081:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19a00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826021.498088:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826021.498099:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.498132:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.498140:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826021.498165:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.498173:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19a00/0x878a5eea00cebadf lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebae6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.498196:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826021.498198:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826021.498200:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826021.498213:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049159424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826021.498253:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.498382:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049159296:0@lo:104: 00010000:00010000:0.0:1787826021.498407:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.498846:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049159424 00000100:00100000:1.0:1787826021.498854:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049159424 00010000:00010000:1.0:1787826021.498886:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebae6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cebadf expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.498912:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12162 00000100:00100000:1.0:1787826021.498920:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049159424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.498934:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787826021.502067:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869807 is committed 00010000:00010000:0.0:1787826021.502281:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebae6 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cebadf expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.502306:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x30:0x0].0x0 (ffff8eb480de3e00) 00010000:00010000:0.0:1787826021.502311:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.502355:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.502366:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.502411:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826021.502460:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.502473:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.502514:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049159424:12345-0@lo:103:ldlm_bl.0 Request processed in 3591us (4256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.502527:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12162 00000004:00200000:2.0:1787826021.502547:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x30:0x0]: returning size 4096 00000004:00200000:2.0:1787826021.502554:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826021.502609:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cebb17 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.502631:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.502640:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x30:0x0].0x0 (ffff8eb480de3e00) 00010000:00010000:2.0:1787826021.502643:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826021.502646:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f400, rc 0) 00000100:00100000:2.0:1787826021.502732:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155581:x1874663042919552:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 5814us (6072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.502741:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 715 00000100:00100000:3.0:1787826021.503566:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049159424:0@lo:103:ldlm_bl.0 00000001:02000400:1.0:1787826021.508486:0:188937:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1787826021.523689:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.523774:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042919808 00000100:00100000:0.0:1787826021.523788:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042919808 00000100:00100000:0.0:1787826021.523883:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 716 00000100:00100000:0.0:1787826021.523896:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:155581:x1874663042919808:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:0.0:1787826021.523970:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826021.524006:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebb02 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed57 expref: 81 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524033:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbc:0x0].0x0 (ffff8eb472727a00) 00010000:00010000:0.0:1787826021.524040:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826021.524070:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524086:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524098:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524110:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 37 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524126:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524398:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524515:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524525:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524533:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524678:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524691:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 80 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524700:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 4/0,1 mode: --/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524921:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 80 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.524943:0:187905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 80 pid: 187905 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.524962:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049159552:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826021.525153:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.542986:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.543102:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049159552:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826021.543147:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.543495:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042919936 00000100:00100000:3.0:1787826021.543506:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042919936 00010000:00010000:3.0:1787826021.543554:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 81 pid: 187905 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.543595:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12163 00000100:00100000:3.0:1787826021.543611:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:2391:x1874663042919936:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826021.543629:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826021.543638:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 81 pid: 187905 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.543666:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 81 pid: 187905 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.543695:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebb10 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x30:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed5e expref: 81 pid: 187905 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.543712:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x30:0x0].0x0 (ffff8eb472727300) 00010000:00010000:3.0:1787826021.543717:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.543729:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.543737:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.543763:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826021.543830:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+80:2391:x1874663042919936:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 225us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.543839:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12163 00010000:00010000:1.0:1787826021.544111:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.544121:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.544178:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.544187:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.544197:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.544220:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049159680:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787826021.544271:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.544311:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.546037:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049159680 00000100:00100000:3.0:1787826021.546054:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049159680 00000100:00100000:3.0:1787826021.546121:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12352 00000100:00100000:3.0:1787826021.546135:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187905:x1874663049159680:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787826021.546160:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.546187:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cebb48 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebb41 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.546225:0:177386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.546236:0:177386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cebb48 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebb41 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.546278:0:177386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.546290:0:177386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 6 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.546302:0:177386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a424380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049159808:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826021.546410:0:177386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.550575:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.550622:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042920064 00000100:00100000:0.0:1787826021.550635:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042920064 00010000:00010000:0.0:1787826021.550705:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.550750:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12164 00000100:00100000:0.0:1787826021.550762:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44528e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2390:x1874663042920064:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826021.550781:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826021.550790:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.550806:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.550833:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x30:0x0].0x0 (ffff8eb480de3e00) 00010000:00010000:0.0:1787826021.550841:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cebb48 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebb41 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.550853:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cebb48 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cebb41 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.550863:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cebb48 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cebb41 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.550915:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cebb48 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebb41 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.550937:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049159936:0@lo:105: 00000100:00100000:0.0:1787826021.551011:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.551055:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.551082:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049159936 00000100:00100000:0.0:1787826021.551086:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049159936 00000100:00100000:0.0:1787826021.551119:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4730 00000100:00100000:0.0:1787826021.551127:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049159936:12345-0@lo:105: 00010000:00010000:0.0:1787826021.551139:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.551150:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.551160:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.551168:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.551175:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.551184:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.551200:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb441356000) 00000100:00100000:0.0:1787826021.551241:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049159936:12345-0@lo:105: Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.551248:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4730 00000100:00100000:0.0:1787826021.551296:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049159936:0@lo:105: 00010000:00010000:0.0:1787826021.551316:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826021.551399:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44528e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2390:x1874663042920064:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 639us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.551406:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12164 00010000:00010000:3.0:1787826021.551838:0:177386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cebb1e lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed65 expref: 6 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.551863:0:177386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a424380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049159808:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826021.551889:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cebb48 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebb41 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.551955:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x30:0x0].0x0 (ffff8eb480de3e00) 00010000:00010000:3.0:1787826021.551959:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826021.551961:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18000, rc 0) 00000100:00100000:3.0:1787826021.552014:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049159680:12345-0@lo:101:mdt00_001.0 Request processed in 5883us (7742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.552022:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12352 00000100:00100000:0.0:1787826021.553763:0:187905:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869807 gen 2 00000004:00080000:0.0:1787826021.553777:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869806 committed transno 17179869807 00000004:00080000:0.0:1787826021.553809:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869807 committed transno 17179869807 00000100:00100000:0.0:1787826021.553838:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049159680:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787826021.553869:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.555912:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049160064:0@lo:403:mdt00_001.0 00000100:00100000:1.0:1787826021.556015:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.556068:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.556702:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049160064 00000100:00100000:3.0:1787826021.556712:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049160064 00000100:00100000:3.0:1787826021.556796:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12353 00000100:00100000:3.0:1787826021.556809:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049160064:12345-0@lo:403:mdt00_001.0 00000100:00100000:3.0:1787826021.566814:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049160064:12345-0@lo:403:mdt00_001.0 Request processed in 9992us (10784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.566835:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12353 00000100:00100000:0.0:1787826021.567576:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049160064:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1787826021.569265:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].438, 656 off672496 00000040:00080000:0.0:1787826021.569529:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].309, 736 off513424 00000004:00080000:0.0:1787826021.569536:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fb480 with version 626 00000004:00080000:1.0:1787826021.572035:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 626 rpc_version 626 00000020:00100000:1.0:1787826021.572107:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826021.572120:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66ce00 x1874663049160320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826021.572148:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049160320:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826021.572268:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.572315:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.573850:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049160320 00000100:00100000:0.0:1787826021.573866:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049160320 00000100:00100000:0.0:1787826021.573938:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12354 00000100:00100000:0.0:1787826021.573949:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049160320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826021.574350:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049160320:12345-0@lo:1000:osp_up1-0.0 Request processed in 401us (2081us total) trans 17179869808 rc 0/0 00000100:00100000:0.0:1787826021.574359:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12354 00000100:00100000:0.0:1787826021.574443:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049160320:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826021.576518:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbc:0x0]: returning size 4096 00010000:00010000:1.0:1787826021.576623:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576636:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576660:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576668:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.576673:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576682:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576704:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x30:0x0].0x0 (ffff8eb472727300) 00010000:00010000:1.0:1787826021.576708:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826021.576714:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 2/0,0 mode: --/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576721:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebb3a lrc: 0/0,0 mode: --/EX res: [0x200026560:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576739:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576748:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576755:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576823:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826021.576835:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x30:0x0] 00010000:00010000:1.0:1787826021.576846:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576852:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576859:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576864:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.576866:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576872:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576880:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbc:0x0].0x0 (ffff8eb472727a00) 00010000:00010000:1.0:1787826021.576882:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826021.576886:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576891:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebb33 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576908:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576914:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576920:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576929:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.576932:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576937:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576945:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826021.576947:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.576951:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576961:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebb25 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826021.576973:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057b28ae4 reply state 00000000d4e11915 transno 335007449181 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576987:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.576994:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826021.576996:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826021.577000:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826021.577129:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:155581:x1874663042919808:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 53231us (53450us total) trans 335007449181 rc 0/0 00000100:00100000:1.0:1787826021.577138:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 716 00010000:00010000:3.0:1787826021.578460:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826021.578475:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.578486:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826021.578493:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826021.578508:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.578626:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.578634:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787826021.578701:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049160448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826021.578778:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.578856:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049160448 00000100:00100000:1.0:1787826021.578865:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049160448 00000100:00100000:1.0:1787826021.578926:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4188 00000100:00100000:1.0:1787826021.578936:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049160448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.578949:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826021.578971:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cebb48 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cebb41 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.578988:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x30:0x0].0x0 (ffff8eb480de3e00) 00010000:00010000:1.0:1787826021.579001:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826021.579174:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.579183:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356000/0x878a5eea00cebb41 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebb48 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.579207:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826021.579209:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826021.579210:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826021.579680:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049160448:12345-0@lo:103:ldlm_bl.0 Request processed in 743us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.579691:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4188 00000100:00100000:0.0:1787826021.580143:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049160448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826021.609675:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.613429:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042920192 00000100:00100000:1.0:1787826021.613453:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042920192 00000100:00100000:1.0:1787826021.613583:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 717 00000100:00100000:1.0:1787826021.613597:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:155589:x1874663042920192:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826021.613629:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.613669:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebb4f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed6c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613755:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613774:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613787:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613799:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 38 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613808:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613814:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613872:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613880:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613887:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613894:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.613899:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613908:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613921:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826021.613924:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.613930:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613936:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebb56 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613950:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613957:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613962:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613968:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.613971:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613977:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613984:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826021.613987:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.613990:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.613995:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebb5d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.614028:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebb4f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed6c expref: 82 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.614039:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826021.614042:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.614045:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebb4f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed6c expref: 82 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.614061:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357600, rc 0) 00000100:00100000:1.0:1787826021.614152:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:155589:x1874663042920192:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 558us (4503us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826021.614160:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 717 00000100:00100000:3.0:1787826021.627060:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.627205:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042920320 00000100:00100000:2.0:1787826021.627218:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042920320 00000100:00100000:3.0:1787826021.627813:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 718 00000100:00100000:3.0:1787826021.627830:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:155589:x1874663042920320:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826021.627857:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.627884:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb64 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed73 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.627960:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.627976:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.627990:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628002:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 38 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628010:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628017:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628065:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628073:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628081:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628087:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826021.628093:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628101:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628116:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.628120:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.628126:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628133:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb6b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628145:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628152:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628158:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628163:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826021.628166:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628172:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628179:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826021.628182:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.628185:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628191:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb72 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628221:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb64 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed73 expref: 82 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628237:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.628240:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.628243:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb64 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed73 expref: 82 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.628253:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18200, rc 0) 00000100:00100000:3.0:1787826021.628366:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:155589:x1874663042920320:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 540us (1319us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826021.628374:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 718 00000100:00100000:3.0:1787826021.633525:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.634093:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042920448 00000100:00100000:2.0:1787826021.634108:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042920448 00000100:00100000:2.0:1787826021.635082:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 719 00000100:00100000:2.0:1787826021.635104:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+81:155589:x1874663042920448:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826021.635138:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.635360:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebb79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed7a expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.635453:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebb80 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.635472:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebb80 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.635486:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebb80 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826021.635555:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826021.635560:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826021.635584:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebb80 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.635616:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebb79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed7a expref: 83 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.635635:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebb80 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed7a expref: 82 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.635646:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.635661:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826021.635665:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39c00, rc 0) 00000100:00100000:2.0:1787826021.635768:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+82:155589:x1874663042920448:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 672us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.635779:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 719 00000100:00100000:2.0:1787826021.643930:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.644026:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042920704 00000100:00100000:3.0:1787826021.644041:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042920704 00000100:00100000:3.0:1787826021.644115:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 720 00000100:00100000:3.0:1787826021.644127:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+82:155589:x1874663042920704:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:3.0:1787826021.644206:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826021.644243:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebb80 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed7a expref: 82 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.644264:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.644271:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826021.644495:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.644512:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.644528:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.644541:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 38 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.644558:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.644566:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826021.650743:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].439, 2152 off674648 00000040:00080000:3.0:1787826021.650855:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].310, 2352 off515776 00000004:00080000:3.0:1787826021.650862:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34896bd80 with version 627 00000004:00080000:1.0:1787826021.651435:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 627 rpc_version 627 00000020:00100000:1.0:1787826021.651488:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826021.651502:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66df80 x1874663049160704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826021.651532:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049160704:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826021.651623:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.651680:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826021.652119:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049160704 00000100:00100000:2.0:1787826021.652129:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049160704 00000100:00100000:2.0:1787826021.652196:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12355 00000100:00100000:2.0:1787826021.652208:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049160704:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826021.654395:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049160704:12345-0@lo:1000:osp_up1-0.0 Request processed in 2176us (2758us total) trans 17179869809 rc 0/0 00000100:00100000:2.0:1787826021.654412:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12355 00000100:00100000:1.0:1787826021.659553:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049160704:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826021.659819:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.659839:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.659852:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.659877:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 3/0,1 mode: --/PW res: [0x200026560:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.659897:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.659906:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.659951:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.659960:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.659971:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.660008:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049160832:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787826021.660088:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826021.660127:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.660155:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049160832 00000100:00100000:0.0:1787826021.660170:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049160832 00000100:00100000:0.0:1787826021.660229:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12356 00000100:00100000:0.0:1787826021.660239:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187905:x1874663049160832:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787826021.660261:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.660284:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebbaa lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebba3 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.660311:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebbaa lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebba3 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.660358:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebbaa lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebba3 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.660367:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x31:0x0].0x0 (ffff8eb480de3400) 00010000:00010000:0.0:1787826021.660372:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.660376:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fc00, rc 0) 00000100:00100000:0.0:1787826021.660458:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187905:x1874663049160832:12345-0@lo:101:mdt00_001.0 Request processed in 220us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.660466:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12356 00000100:00100000:2.0:1787826021.660624:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049160832:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826021.660646:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660670:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826021.660697:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c5db28e reply state 00000000f907a32b transno 335007449182 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660712:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660719:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x31:0x0].0x0 (ffff8eb46268af00) 00010000:00010000:2.0:1787826021.660723:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826021.660726:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826021.660734:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660746:0:187905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826021.660757:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x31:0x0] 00000004:00010000:2.0:1787826021.660764:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c5db28e reply state 00000000f907a32b transno 335007449182 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660773:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660778:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbd:0x0].0x0 (ffff8eb46268a100) 00010000:00010000:2.0:1787826021.660781:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826021.660783:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787826021.660790:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbd:0x0]: returning size 4096 00010000:00010000:2.0:1787826021.660799:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660805:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660811:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660818:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.660823:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660831:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660847:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.660850:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.660854:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660860:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebb87 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826021.660873:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c5db28e reply state 00000000f907a32b transno 335007449182 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660882:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.660888:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.660890:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826021.660892:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787826021.661072:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+83:155589:x1874663042920704:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 16943us (17150us total) trans 335007449182 rc 0/0 00000100:00100000:2.0:1787826021.661081:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 720 00000100:00100000:1.0:1787826021.675811:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.677871:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042920832 00000100:00100000:1.0:1787826021.677887:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042920832 00000100:00100000:1.0:1787826021.677976:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 721 00000100:00100000:1.0:1787826021.677988:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+83:155598:x1874663042920832:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826021.678022:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.678050:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebbb1 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed81 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678151:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678169:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678184:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678198:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 39 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678206:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678213:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678315:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebbc6 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678351:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebbc6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678360:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebbc6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826021.678466:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbd:0x0]: returning size 4096 00000004:00200000:1.0:1787826021.678473:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787826021.678499:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebbc6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678512:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678518:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678528:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678536:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.678540:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678548:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678561:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826021.678565:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.678570:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678575:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbb8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678590:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678595:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678601:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678605:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826021.678608:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678618:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678625:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826021.678627:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826021.678630:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678636:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbbf lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678678:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebbb1 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed81 expref: 85 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678694:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebbc6 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed81 expref: 84 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.678701:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbd:0x0].0x0 (ffff8eb46268a100) 00010000:00010000:1.0:1787826021.678704:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826021.678707:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356a00, rc 0) 00000100:00100000:1.0:1787826021.678795:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+84:155598:x1874663042920832:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 808us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.678804:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 721 00000100:00100000:1.0:1787826021.692096:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.692155:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042920960 00000100:00100000:1.0:1787826021.692168:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042920960 00000100:00100000:1.0:1787826021.692238:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 722 00000100:00100000:1.0:1787826021.692250:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+84:155598:x1874663042920960:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826021.692280:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.692309:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebbcd lrc: 2/0,0 mode: --/CR res: [0x200026560:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed88 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.692406:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.692424:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.692439:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826021.692502:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x31:0x0]: returning size 4096 00000004:00200000:1.0:1787826021.692509:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826021.692553:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebbcd lrc: 0/0,0 mode: --/CR res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 86 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.692574:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 85 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.692584:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x31:0x0].0x0 (ffff8eb46268af00) 00010000:00010000:1.0:1787826021.692588:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826021.692593:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356200, rc 0) 00000100:00100000:1.0:1787826021.692680:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:155598:x1874663042920960:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 430us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.692689:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 722 00000100:00100000:2.0:1787826021.708535:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.708592:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042921088 00000100:00100000:2.0:1787826021.708606:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042921088 00000100:00100000:2.0:1787826021.710043:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 723 00000100:00100000:2.0:1787826021.710062:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155598:x1874663042921088:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826021.710088:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.710196:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00cebbdb lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed8f expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.710292:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.710311:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebbaa lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebba3 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.710344:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.710391:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebbaa lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cebba3 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826021.710409:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:187904:1874663049160960:0@lo:104: 00000100:00100000:2.0:1787826021.710489:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826021.710544:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.710715:0:9494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787826021.710731:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049160960 00000100:00100000:0.0:1787826021.710739:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049160960 00000100:00100000:0.0:1787826021.710822:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4731 00000100:00100000:0.0:1787826021.710831:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345762850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187904:x1874663049160960:12345-0@lo:104: 00010000:00010000:0.0:1787826021.710847:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.710914:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826021.710921:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345762850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187904:x1874663049160960:12345-0@lo:104: Request processed in 92us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.710928:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4731 00000100:00100000:2.0:1787826021.711018:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:187904:1874663049160960:0@lo:104: 00010000:00010000:2.0:1787826021.711041:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.711189:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826021.711197:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.711206:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826021.711212:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.711222:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.711253:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.711261:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826021.711311:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049161088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826021.711371:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826021.711447:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.711456:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18800/0x878a5eea00cebba3 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebbaa expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.711477:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826021.711479:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826021.711481:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826021.714464:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049161088 00000100:00100000:3.0:1787826021.714485:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049161088 00010000:00010000:3.0:1787826021.714539:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebbaa lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cebba3 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.714584:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12165 00000100:00100000:3.0:1787826021.714596:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3618:x1874663049161088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826021.714615:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787826021.726530:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869809 is committed 00010000:00010000:3.0:1787826021.726644:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebbaa lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cebba3 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.726686:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x31:0x0].0x0 (ffff8eb480de3400) 00010000:00010000:3.0:1787826021.726692:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.726706:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.726714:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.726750:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826021.726842:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049161088:12345-0@lo:103:ldlm_bl.0 Request processed in 12245us (15468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.726865:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12165 00010000:00010000:3.0:1787826021.727218:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.727231:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826021.727290:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x31:0x0]: returning size 4096 00000004:00200000:3.0:1787826021.727296:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826021.727386:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39200/0x878a5eea00cebbdb lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.727411:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 7 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.727419:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x31:0x0].0x0 (ffff8eb480de3400) 00010000:00010000:3.0:1787826021.727422:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826021.727427:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38000, rc 0) 00000100:00100000:3.0:1787826021.727503:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155598:x1874663042921088:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 17447us (18984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.727515:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 723 00000100:00100000:2.0:1787826021.730908:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049161088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826021.735051:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.735126:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042921344 00000100:00100000:1.0:1787826021.735140:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042921344 00000100:00100000:1.0:1787826021.735218:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 724 00000100:00100000:1.0:1787826021.735230:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:155598:x1874663042921344:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:1.0:1787826021.735309:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826021.735366:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebbc6 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed81 expref: 85 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735388:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbd:0x0].0x0 (ffff8eb46268a100) 00010000:00010000:1.0:1787826021.735393:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826021.735418:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735435:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735445:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735455:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 39 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735470:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735476:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735582:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735591:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735602:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735622:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,1 mode: --/EX res: [0x200026560:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735631:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 84 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735640:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 4/0,1 mode: --/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.735998:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 84 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.736015:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 84 pid: 188682 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.736033:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049161216:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826021.736197:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826021.739382:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.739553:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042921472 00000100:00100000:0.0:1787826021.739567:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042921472 00010000:00010000:0.0:1787826021.739621:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 85 pid: 188682 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.739683:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12166 00000100:00100000:0.0:1787826021.739696:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:2391:x1874663042921472:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826021.739715:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826021.739723:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 85 pid: 188682 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.739739:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 85 pid: 188682 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.739768:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x31:0x0].0x0 (ffff8eb46268af00) 00010000:00010000:0.0:1787826021.739773:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,1 mode: --/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.739785:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.739794:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.739817:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826021.739891:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:2391:x1874663042921472:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 197us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.739899:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12166 00010000:00010000:2.0:1787826021.740790:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebbd4 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed88 expref: 84 pid: 188682 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826021.740817:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049161216:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826021.740843:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.740854:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.740862:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.740921:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.740929:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.740942:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826021.740965:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049161344:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787826021.741022:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826021.741107:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.741223:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049161344 00000100:00100000:3.0:1787826021.741232:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049161344 00000100:00100000:3.0:1787826021.741314:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12357 00000100:00100000:3.0:1787826021.741354:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049161344:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826021.741374:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.741394:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebc05 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.741421:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 6 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.741430:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.741457:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 6 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.741471:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 6 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.741483:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049161472:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826021.741553:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.743997:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049161472:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826021.744046:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.744068:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x31:0x0].0x0 (ffff8eb480de3400) 00010000:00010000:3.0:1787826021.744072:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826021.744078:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.744089:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.744737:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18e00, rc 0) 00000100:00100000:3.0:1787826021.744828:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049161344:12345-0@lo:101:mdt00_003.0 Request processed in 3504us (3804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.744839:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12357 00000100:00100000:2.0:1787826021.744942:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869809 gen 2 00000004:00080000:2.0:1787826021.744949:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869808 committed transno 17179869809 00000004:00080000:2.0:1787826021.744978:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869809 committed transno 17179869809 00000100:00100000:2.0:1787826021.744998:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049161344:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826021.745022:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.745041:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.745670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.745809:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042921600 00000100:00100000:0.0:1787826021.745820:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042921600 00010000:00010000:0.0:1787826021.745865:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 7 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.745950:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12167 00000100:00100000:0.0:1787826021.745961:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042921600:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826021.745980:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826021.745988:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 7 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.746002:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 7 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.746029:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebbe2 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed8f expref: 7 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.746047:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x31:0x0].0x0 (ffff8eb480de3400) 00010000:00010000:0.0:1787826021.746053:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.746065:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.746075:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.746115:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.746131:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049161600:0@lo:105: 00000100:00100000:0.0:1787826021.746183:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.746228:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.746380:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049161600 00000100:00100000:3.0:1787826021.746386:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049161600 00000100:00100000:3.0:1787826021.746424:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4732 00000100:00100000:3.0:1787826021.746432:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049161600:12345-0@lo:105: 00010000:00010000:3.0:1787826021.746444:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.746454:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.746464:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.746471:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.746479:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.746488:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.746507:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34bf38200) 00000100:00100000:3.0:1787826021.746549:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049161600:12345-0@lo:105: Request processed in 118us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.746556:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4732 00010000:00010000:2.0:1787826021.746659:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.746670:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826021.747476:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049161728:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787826021.747533:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826021.747563:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.747750:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049161600:0@lo:105: 00010000:00010000:0.0:1787826021.747768:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826021.747827:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042921600:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1865us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.747837:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12167 00000100:00100000:3.0:1787826021.748451:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049161728 00000100:00100000:3.0:1787826021.748460:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049161728 00000100:00100000:3.0:1787826021.748507:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12358 00000100:00100000:3.0:1787826021.748517:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049161728:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1787826021.750712:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049161728:12345-0@lo:403:mdt00_003.0 Request processed in 2184us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826021.750729:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12358 00000100:00100000:2.0:1787826021.753027:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049161728:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1787826021.754282:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].440, 944 off675592 00000040:00080000:2.0:1787826021.754561:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].311, 1024 off516800 00000004:00080000:2.0:1787826021.754569:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349480000 with version 628 00000004:00080000:3.0:1787826021.755857:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 628 rpc_version 628 00000020:00100000:3.0:1787826021.755916:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826021.755931:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a424a80 x1874663049161984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826021.755962:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a424a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049161984:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826021.756053:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826021.756101:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826021.756290:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049161984 00000100:00100000:2.0:1787826021.756300:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049161984 00000100:00100000:3.0:1787826021.756590:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12359 00000100:00100000:3.0:1787826021.756605:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049161984:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826021.757242:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049161984:12345-0@lo:1000:osp_up1-0.0 Request processed in 639us (1186us total) trans 17179869810 rc 0/0 00000100:00100000:3.0:1787826021.757252:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12359 00000100:00100000:1.0:1787826021.757656:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a424a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049161984:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826021.757830:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbd:0x0]: returning size 4096 00010000:00010000:2.0:1787826021.757860:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757871:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757879:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757890:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.757895:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757903:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757923:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x31:0x0].0x0 (ffff8eb46268af00) 00010000:00010000:2.0:1787826021.757926:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826021.757933:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 2/0,0 mode: --/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757938:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebbfe lrc: 0/0,0 mode: --/EX res: [0x200026560:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757958:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757967:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.757975:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758037:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826021.758048:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x31:0x0] 00010000:00010000:2.0:1787826021.758058:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758065:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758071:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758077:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.758080:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758086:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758094:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbd:0x0].0x0 (ffff8eb46268a100) 00010000:00010000:2.0:1787826021.758098:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826021.758101:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758106:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebbf7 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758124:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758131:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758138:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758144:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.758146:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758157:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758165:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.758167:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.758170:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758176:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebbe9 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826021.758186:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d837fd3 reply state 0000000070f3b0c0 transno 335007449183 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758200:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.758208:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.758211:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826021.758214:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826021.758313:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:155598:x1874663042921344:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 23081us (23269us total) trans 335007449183 rc 0/0 00000100:00100000:2.0:1787826021.758379:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 724 00010000:00010000:0.0:1787826021.758841:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826021.758850:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.758859:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826021.758865:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826021.758874:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.758919:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.758926:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787826021.758987:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049162112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826021.759050:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826021.759127:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.759135:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf38200/0x878a5eea00cebc05 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebc0c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.759157:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826021.759159:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826021.759161:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826021.759216:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049162112 00000100:00100000:1.0:1787826021.759225:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049162112 00000100:00100000:1.0:1787826021.759291:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4189 00000100:00100000:1.0:1787826021.759303:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3619:x1874663049162112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.759318:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826021.759365:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc0c lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cebc05 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.759384:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x31:0x0].0x0 (ffff8eb480de3400) 00010000:00010000:1.0:1787826021.759396:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826021.762599:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049162112:12345-0@lo:103:ldlm_bl.0 Request processed in 3280us (3531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.762618:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4189 00000100:00100000:3.0:1787826021.762817:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049162112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826021.792528:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.805075:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042921728 00000100:00100000:3.0:1787826021.805096:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042921728 00000100:00100000:3.0:1787826021.805288:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 725 00000100:00100000:3.0:1787826021.805303:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:155616:x1874663042921728:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826021.805353:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.805383:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cebc13 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed96 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.805473:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.805490:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.805504:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.805517:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 40 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.805526:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.805533:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.805888:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.805899:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.805907:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.805914:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.805928:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.805938:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.805953:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.805957:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.805963:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.805970:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cebc1a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.805993:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806000:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806006:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806011:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826021.806014:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806020:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806028:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826021.806031:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.806034:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806040:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cebc21 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806075:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cebc13 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed96 expref: 86 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806086:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.806089:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826021.806093:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cebc13 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed96 expref: 86 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.806104:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19600, rc 0) 00000100:00100000:0.0:1787826021.806199:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:155616:x1874663042921728:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 899us (13685us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826021.806209:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 725 00000100:00100000:1.0:1787826021.811381:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.812538:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042921856 00000100:00100000:2.0:1787826021.812569:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042921856 00000100:00100000:3.0:1787826021.812711:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 726 00000100:00100000:3.0:1787826021.812730:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:155616:x1874663042921856:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826021.812759:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.812790:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc28 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ed9d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812874:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812890:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812900:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812909:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 40 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812915:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812929:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812980:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812989:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812994:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.812998:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826021.813002:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813010:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813023:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.813026:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.813032:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813049:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebc2f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813066:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813072:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813078:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813083:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826021.813087:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813094:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813101:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826021.813104:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.813108:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813112:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebc36 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813145:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc28 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed9d expref: 86 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813156:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.813159:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.813163:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebc28 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ed9d expref: 86 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.813173:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18e00, rc 0) 00000100:00100000:3.0:1787826021.813705:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:155616:x1874663042921856:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 979us (2378us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826021.813716:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 726 00000100:00100000:3.0:1787826021.820889:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826021.821251:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042921984 00000100:00100000:1.0:1787826021.821266:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042921984 00000100:00100000:1.0:1787826021.821519:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 727 00000100:00100000:1.0:1787826021.821532:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+85:155616:x1874663042921984:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826021.821568:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826021.821596:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebc3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eda4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.821716:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebc44 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.821736:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebc44 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.821750:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebc44 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826021.821815:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:1.0:1787826021.821819:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826021.821842:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebc44 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.821872:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebc3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eda4 expref: 87 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.821893:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebc44 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eda4 expref: 86 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.821904:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826021.821907:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826021.821911:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:1.0:1787826021.822015:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+86:155616:x1874663042921984:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 486us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.822024:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 727 00000100:00100000:1.0:1787826021.829595:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.829702:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042922240 00000100:00100000:0.0:1787826021.829716:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042922240 00000100:00100000:0.0:1787826021.829794:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 728 00000100:00100000:0.0:1787826021.829807:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+86:155616:x1874663042922240:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826021.829896:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826021.829933:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebc44 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eda4 expref: 86 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.829959:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826021.829966:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826021.830053:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.830069:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.830080:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.830093:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 40 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.830111:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.830120:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826021.833314:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].441, 2152 off677744 00000040:00080000:0.0:1787826021.833448:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].312, 2352 off519152 00000004:00080000:0.0:1787826021.833456:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fb900 with version 629 00000004:00080000:1.0:1787826021.833796:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 629 rpc_version 629 00000020:00100000:1.0:1787826021.833851:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826021.833864:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c143800 x1874663049162368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826021.833894:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049162368:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826021.833984:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.834064:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.834184:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049162368 00000100:00100000:3.0:1787826021.834195:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049162368 00000100:00100000:3.0:1787826021.834378:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12360 00000100:00100000:3.0:1787826021.834392:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049162368:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826021.835543:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049162368:12345-0@lo:1000:osp_up1-0.0 Request processed in 1148us (1553us total) trans 17179869811 rc 0/0 00000100:00100000:3.0:1787826021.835558:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12360 00000100:00100000:1.0:1787826021.835735:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049162368:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826021.836035:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.836056:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.836070:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.836096:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.836105:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.836111:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.836159:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.836164:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.836173:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.836192:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049162496:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826021.836235:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826021.836804:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826021.844256:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049162496 00000100:00100000:2.0:1787826021.844280:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049162496 00000100:00100000:2.0:1787826021.844662:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12361 00000100:00100000:2.0:1787826021.844678:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049162496:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826021.844828:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.844863:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebc6e lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebc67 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.844904:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebc6e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebc67 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.845028:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebc6e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebc67 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.845106:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x32:0x0].0x0 (ffff8eb449aace00) 00010000:00010000:2.0:1787826021.845111:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.845116:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38000, rc 0) 00000100:00100000:2.0:1787826021.845295:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049162496:12345-0@lo:101:mdt00_003.0 Request processed in 620us (9057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.845304:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12361 00000100:00100000:3.0:1787826021.845829:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049162496:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826021.845857:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.845870:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826021.845900:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b656dd0e reply state 000000009d359820 transno 335007449184 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.845914:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846035:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x32:0x0].0x0 (ffff8eb480de3700) 00010000:00010000:3.0:1787826021.846098:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826021.846102:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826021.846110:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846119:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826021.846133:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x32:0x0] 00000004:00010000:3.0:1787826021.846143:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b656dd0e reply state 000000009d359820 transno 335007449184 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846153:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846160:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbe:0x0].0x0 (ffff8eb480de3d00) 00010000:00010000:3.0:1787826021.846162:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826021.846164:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826021.846172:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbe:0x0]: returning size 4096 00010000:00010000:3.0:1787826021.846183:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846190:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846197:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846204:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826021.846209:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846217:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846229:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826021.846232:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826021.846236:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846242:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebc4b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826021.846265:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b656dd0e reply state 000000009d359820 transno 335007449184 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846275:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.846282:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826021.846284:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826021.846287:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826021.846674:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+87:155616:x1874663042922240:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 16863us (17090us total) trans 335007449184 rc 0/0 00000100:00100000:3.0:1787826021.846685:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 728 00000100:00100000:2.0:1787826021.879023:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.879201:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042922368 00000100:00100000:3.0:1787826021.879215:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042922368 00000100:00100000:3.0:1787826021.879317:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 729 00000100:00100000:3.0:1787826021.879371:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+87:155631:x1874663042922368:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826021.879403:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.882044:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00cebc75 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edab expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882167:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882187:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882202:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882348:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 41 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882360:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882367:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882728:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebc8a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882739:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebc8a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882747:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebc8a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826021.882868:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbe:0x0]: returning size 4096 00000004:00200000:2.0:1787826021.882874:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826021.882898:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebc8a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882912:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882972:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882981:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.882992:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.882997:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883005:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883019:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826021.883022:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.883027:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883033:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cebc7c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883049:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883055:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883061:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883066:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826021.883069:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883074:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883085:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826021.883088:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826021.883091:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883096:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38200/0x878a5eea00cebc83 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883128:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39200/0x878a5eea00cebc75 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edab expref: 89 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883142:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebc8a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edab expref: 88 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.883148:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbe:0x0].0x0 (ffff8eb480de3d00) 00010000:00010000:2.0:1787826021.883150:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826021.883153:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:2.0:1787826021.883687:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+88:155631:x1874663042922368:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 4317us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.883700:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 729 00000100:00100000:3.0:1787826021.909925:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.912773:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042922496 00000100:00100000:2.0:1787826021.912795:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042922496 00000100:00100000:2.0:1787826021.912959:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 730 00000100:00100000:2.0:1787826021.912973:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+88:155631:x1874663042922496:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826021.913002:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826021.913031:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebc91 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edb2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.913117:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.913136:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.913150:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826021.913213:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x32:0x0]: returning size 4096 00000004:00200000:2.0:1787826021.913220:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826021.913264:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebc91 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 90 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.913290:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 89 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.913300:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x32:0x0].0x0 (ffff8eb480de3700) 00010000:00010000:2.0:1787826021.913303:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826021.913307:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00000100:00100000:2.0:1787826021.913441:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:155631:x1874663042922496:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 471us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.913450:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 730 00000100:00100000:1.0:1787826021.934939:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.935050:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042922624 00000100:00100000:0.0:1787826021.935063:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042922624 00000100:00100000:0.0:1787826021.935141:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 731 00000100:00100000:0.0:1787826021.935153:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155631:x1874663042922624:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826021.935181:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826021.935210:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebc9f lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edb9 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.935296:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.935315:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebc6e lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebc67 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.935367:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.935414:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebc6e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cebc67 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.935444:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049162624:0@lo:104: 00000100:00100000:0.0:1787826021.935506:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.935660:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049162624 00000100:00100000:1.0:1787826021.935667:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049162624 00000100:00100000:1.0:1787826021.935709:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4733 00000100:00100000:1.0:1787826021.935719:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049162624:12345-0@lo:104: 00010000:00010000:1.0:1787826021.935735:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.935794:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826021.935801:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049162624:12345-0@lo:104: Request processed in 85us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.935809:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4733 00010000:00010000:1.0:1787826021.935840:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826021.935846:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.935855:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826021.935861:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826021.935872:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.935902:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.935909:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826021.935934:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.935942:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fa00/0x878a5eea00cebc67 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebc6e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.935969:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826021.935971:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826021.935973:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826021.935987:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049162752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826021.936021:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.936083:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049162752 00000100:00100000:1.0:1787826021.936088:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049162752 00010000:00010000:1.0:1787826021.936111:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebc6e lrc: 5/0,0 mode: PW/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cebc67 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.936136:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12168 00000100:00100000:1.0:1787826021.936143:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049162752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.936156:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826021.936724:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826021.936754:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049162624:0@lo:104: 00010000:00010000:0.0:1787826021.936780:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826021.940690:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869811 is committed 00010000:00010000:1.0:1787826021.940879:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38000/0x878a5eea00cebc6e lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cebc67 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.940905:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x32:0x0].0x0 (ffff8eb449aace00) 00010000:00010000:1.0:1787826021.940911:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.940923:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.940932:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.940967:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826021.941070:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049162752:12345-0@lo:103:ldlm_bl.0 Request processed in 4924us (5045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.941082:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12168 00000100:00100000:2.0:1787826021.941214:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049162752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826021.941382:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.941391:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826021.941474:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x32:0x0]: returning size 4096 00000004:00200000:0.0:1787826021.941481:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826021.941868:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebc9f lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.941896:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.941906:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x32:0x0].0x0 (ffff8eb449aace00) 00010000:00010000:0.0:1787826021.941909:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826021.941913:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e600, rc 0) 00000100:00100000:0.0:1787826021.942039:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155631:x1874663042922624:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 6887us (7113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.942048:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 731 00000100:00100000:1.0:1787826021.961974:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826021.962076:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042922880 00000100:00100000:3.0:1787826021.962089:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042922880 00000100:00100000:3.0:1787826021.962169:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 732 00000100:00100000:3.0:1787826021.962181:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:155631:x1874663042922880:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:3.0:1787826021.962259:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826021.962294:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebc8a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edab expref: 89 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.962320:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbe:0x0].0x0 (ffff8eb480de3d00) 00010000:00010000:3.0:1787826021.962719:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826021.964966:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965000:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965018:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965038:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 41 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965054:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965062:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965187:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965196:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965203:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965226:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965241:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 88 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965251:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965306:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 88 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.965369:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 88 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826021.965387:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049162880:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826021.965750:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.975450:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826021.975562:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042923008 00000100:00100000:2.0:1787826021.975576:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042923008 00010000:00010000:2.0:1787826021.975633:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 89 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826021.975696:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12169 00000100:00100000:2.0:1787826021.975708:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:2391:x1874663042923008:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826021.975727:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826021.975736:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 89 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.975751:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 89 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.975781:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x32:0x0].0x0 (ffff8eb480de3700) 00010000:00010000:2.0:1787826021.975787:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.975799:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.975809:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.975834:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826021.975897:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:2391:x1874663042923008:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 190us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.975905:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12169 00010000:00010000:1.0:1787826021.976921:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebc98 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb2 expref: 88 pid: 187904 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.976948:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049162880:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826021.976974:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.976983:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.976990:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.977054:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.977063:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.977075:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.977101:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049163008:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787826021.977165:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.977207:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.977408:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049163008 00000100:00100000:3.0:1787826021.977516:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049163008 00000100:00100000:3.0:1787826021.977598:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12362 00000100:00100000:3.0:1787826021.977608:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049163008:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826021.977628:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826021.977657:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebcc9 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.977686:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.977696:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.977745:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826021.977760:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 6 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826021.977773:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049163136:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826021.977877:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826021.992954:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826021.993074:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049163136:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826021.993110:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.993123:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x32:0x0].0x0 (ffff8eb449aace00) 00010000:00010000:0.0:1787826021.993126:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826021.993130:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.993138:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826021.993145:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18e00, rc 0) 00000100:00100000:0.0:1787826021.993214:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049163008:12345-0@lo:101:mdt00_003.0 Request processed in 15606us (16048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826021.993222:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12362 00000100:00100000:2.0:1787826021.993579:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869811 gen 2 00000004:00080000:2.0:1787826021.993585:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869810 committed transno 17179869811 00000004:00080000:2.0:1787826021.993602:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869811 committed transno 17179869811 00000100:00100000:2.0:1787826021.993616:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049163008:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826021.993636:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.993646:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.994044:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042923136 00000100:00100000:1.0:1787826021.994062:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042923136 00010000:00010000:1.0:1787826021.994101:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.994143:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12170 00000100:00100000:1.0:1787826021.994152:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042923136:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826021.994166:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826021.994173:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.994184:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.994204:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cebca6 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edb9 expref: 7 pid: 187906 timeout: 8188 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.994220:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x32:0x0].0x0 (ffff8eb449aace00) 00010000:00010000:1.0:1787826021.994226:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.994235:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.994244:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826021.994274:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.994292:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049163264:0@lo:105: 00000100:00100000:1.0:1787826021.994402:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.994433:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826021.994753:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049163264 00000100:00100000:2.0:1787826021.994759:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049163264 00000100:00100000:2.0:1787826021.994801:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4734 00000100:00100000:2.0:1787826021.994809:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049163264:12345-0@lo:105: 00010000:00010000:2.0:1787826021.994818:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.994827:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.994835:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.994842:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.994849:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.994857:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.994883:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb441356a00) 00000100:00100000:2.0:1787826021.994923:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049163264:12345-0@lo:105: Request processed in 114us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826021.994930:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4734 00010000:00010000:2.0:1787826021.994953:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826021.994962:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826021.995832:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049163264:0@lo:105: 00010000:00010000:1.0:1787826021.995849:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826021.995894:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042923136:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1742us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826021.995901:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12170 00000100:00100000:1.0:1787826021.996726:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049163392:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787826021.996790:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826021.996821:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826021.997876:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049163392 00000100:00100000:2.0:1787826021.997887:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049163392 00000100:00100000:2.0:1787826021.997942:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12363 00000100:00100000:2.0:1787826021.997961:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049163392:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1787826022.007514:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049163392:12345-0@lo:403:mdt00_003.0 Request processed in 9546us (10715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.007529:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12363 00000100:00100000:1.0:1787826022.008919:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049163392:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1787826022.011179:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].442, 656 off678400 00000040:00080000:1.0:1787826022.011399:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].313, 736 off519888 00000004:00080000:1.0:1787826022.011407:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb481768000 with version 630 00000004:00080000:0.0:1787826022.011645:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 630 rpc_version 630 00000020:00100000:0.0:1787826022.011692:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826022.011703:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a428700 x1874663049163648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1696/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826022.011729:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049163648:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826022.011800:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.011839:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.015263:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049163648 00000100:00100000:1.0:1787826022.015280:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049163648 00000100:00100000:1.0:1787826022.015369:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12364 00000100:00100000:1.0:1787826022.015381:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049163648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826022.015684:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049163648:12345-0@lo:1000:osp_up1-0.0 Request processed in 305us (3885us total) trans 17179869812 rc 0/0 00000100:00100000:1.0:1787826022.015692:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12364 00000100:00100000:3.0:1787826022.017485:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049163648:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826022.017960:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbe:0x0]: returning size 4096 00010000:00010000:1.0:1787826022.017986:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018008:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018016:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018021:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.018026:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018033:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018056:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x32:0x0].0x0 (ffff8eb480de3700) 00010000:00010000:1.0:1787826022.018059:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826022.018065:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018071:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebcc2 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018089:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018098:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018106:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018139:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826022.018149:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x32:0x0] 00010000:00010000:1.0:1787826022.018157:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018162:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018167:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018172:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.018175:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018181:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018189:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbe:0x0].0x0 (ffff8eb480de3d00) 00010000:00010000:1.0:1787826022.018191:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826022.018194:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018199:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcbb lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018214:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018219:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018224:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018228:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.018230:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018234:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018241:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.018243:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.018245:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018250:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebcad lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826022.018257:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034ccc39e reply state 00000000ea0c6643 transno 335007449185 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018268:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.018274:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.018276:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826022.018279:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826022.018416:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:155631:x1874663042922880:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 56234us (56455us total) trans 335007449185 rc 0/0 00000100:00100000:1.0:1787826022.018426:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 732 00010000:00010000:3.0:1787826022.018502:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826022.018509:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.018516:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826022.018521:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826022.018528:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.018560:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.018568:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826022.018596:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.018603:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441356a00/0x878a5eea00cebcc9 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebcd0 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.018621:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826022.018623:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826022.018625:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826022.018845:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826022.018868:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049163776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826022.018917:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.019127:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049163776 00000100:00100000:3.0:1787826022.019135:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049163776 00000100:00100000:3.0:1787826022.019189:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4190 00000100:00100000:3.0:1787826022.019199:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049163776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826022.019212:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826022.019230:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cebcd0 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cebcc9 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.019244:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x32:0x0].0x0 (ffff8eb449aace00) 00010000:00010000:3.0:1787826022.019254:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826022.019302:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049163776:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.019310:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4190 00000100:00100000:1.0:1787826022.019792:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049163776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826022.067407:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.067525:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042923264 00000100:00100000:2.0:1787826022.067535:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042923264 00000100:00100000:2.0:1787826022.067612:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 733 00000100:00100000:2.0:1787826022.067623:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:155650:x1874663042923264:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826022.067658:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.067679:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebcd7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edc0 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067740:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067753:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067765:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067775:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 42 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067782:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067788:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067827:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067835:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067842:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067850:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826022.067854:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067862:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067874:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826022.067877:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.067882:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067888:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebcde lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067901:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067907:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067913:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067918:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826022.067921:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067927:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067933:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826022.067936:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.067939:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067944:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebce5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067970:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebcd7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edc0 expref: 90 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.067986:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826022.067988:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.067992:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebcd7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edc0 expref: 90 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.068001:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:2.0:1787826022.068074:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:155650:x1874663042923264:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 452us (676us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826022.068082:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 733 00000100:00080000:0.0:1787826022.068559:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826022.072591:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.072940:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042923392 00000100:00100000:0.0:1787826022.072951:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042923392 00000100:00100000:0.0:1787826022.073018:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 734 00000100:00100000:0.0:1787826022.073028:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:155650:x1874663042923392:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826022.073171:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.073195:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebcec lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edc7 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073256:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073270:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073282:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073294:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 42 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073301:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073307:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073387:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073394:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073400:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073405:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.073409:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073416:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073428:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.073432:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.073436:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073442:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebcf3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073455:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073460:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073466:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073471:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.073475:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073481:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073487:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826022.073490:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.073493:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073498:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebcfa lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073524:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebcec lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edc7 expref: 90 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073533:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.073535:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.073538:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebcec lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edc7 expref: 90 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.073546:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715c00, rc 0) 00000100:00100000:0.0:1787826022.073618:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:155650:x1874663042923392:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 591us (1036us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826022.073625:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 734 00000100:00100000:0.0:1787826022.084410:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.085916:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042923520 00000100:00100000:2.0:1787826022.085930:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042923520 00000100:00100000:2.0:1787826022.086022:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 735 00000100:00100000:2.0:1787826022.086033:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+89:155650:x1874663042923520:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826022.086061:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.086083:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebd01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edce expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.086149:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebd08 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.086164:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebd08 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.086176:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebd08 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826022.086227:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826022.086231:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826022.086252:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebd08 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.086278:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebd01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edce expref: 91 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.086297:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebd08 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edce expref: 90 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.086306:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826022.086309:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826022.086313:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00000100:00100000:2.0:1787826022.086447:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+90:155650:x1874663042923520:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 414us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.086454:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 735 00000100:00100000:3.0:1787826022.102289:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.106197:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042923776 00000100:00100000:1.0:1787826022.106211:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042923776 00000100:00100000:1.0:1787826022.106360:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 736 00000100:00100000:1.0:1787826022.106371:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+90:155650:x1874663042923776:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826022.106428:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826022.106453:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebd08 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edce expref: 90 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.106474:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.106479:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826022.106539:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.106551:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.106561:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.106573:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 42 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.106586:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.106593:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826022.107475:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].443, 2152 off680552 00000040:00080000:1.0:1787826022.107552:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].314, 2352 off522240 00000004:00080000:1.0:1787826022.107557:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb481768480 with version 631 00000004:00080000:2.0:1787826022.110404:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 631 rpc_version 631 00000020:00100000:2.0:1787826022.110452:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826022.110463:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34bdf6a00 x1874663049164032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826022.110487:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049164032:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826022.110559:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.110595:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.111293:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049164032 00000100:00100000:1.0:1787826022.111304:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049164032 00000100:00100000:1.0:1787826022.111430:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12365 00000100:00100000:1.0:1787826022.111441:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a7af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049164032:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826022.112101:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a7af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049164032:12345-0@lo:1000:osp_up1-0.0 Request processed in 661us (1542us total) trans 17179869813 rc 0/0 00000100:00100000:1.0:1787826022.112111:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12365 00000100:00100000:2.0:1787826022.112301:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049164032:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826022.112906:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.112923:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.112935:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.112954:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.112961:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.112967:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.113009:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.113016:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.113026:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.113044:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049164160:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826022.117451:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.117504:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.117532:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049164160 00000100:00100000:1.0:1787826022.117541:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049164160 00000100:00100000:1.0:1787826022.117607:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12366 00000100:00100000:1.0:1787826022.117617:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049164160:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826022.117641:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826022.117676:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebd32 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebd2b expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.117707:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebd32 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebd2b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.117720:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebd32 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebd2b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.117729:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x33:0x0].0x0 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826022.117732:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.117748:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:1.0:1787826022.117804:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049164160:12345-0@lo:101:mdt00_003.0 Request processed in 188us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.117811:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12366 00000100:00100000:0.0:1787826022.118403:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049164160:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826022.118422:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118434:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.118459:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000170fbb76 reply state 00000000ae174348 transno 335007449186 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118472:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118478:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x33:0x0].0x0 (ffff8eb480de3c00) 00010000:00010000:0.0:1787826022.118480:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826022.118483:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826022.118489:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118496:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826022.118507:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x33:0x0] 00000004:00010000:0.0:1787826022.118515:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000170fbb76 reply state 00000000ae174348 transno 335007449186 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118524:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118531:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbf:0x0].0x0 (ffff8eb480de3100) 00010000:00010000:0.0:1787826022.118533:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826022.118534:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787826022.118538:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbf:0x0]: returning size 4096 00010000:00010000:0.0:1787826022.118547:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118553:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118559:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118564:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.118569:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118577:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118589:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.118591:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.118594:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118601:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebd0f lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.118615:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000170fbb76 reply state 00000000ae174348 transno 335007449186 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118623:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.118628:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826022.118630:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826022.118632:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787826022.118724:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+91:155650:x1874663042923776:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 12352us (16443us total) trans 335007449186 rc 0/0 00000100:00100000:0.0:1787826022.118733:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 736 00000100:00100000:0.0:1787826022.153764:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.154006:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042923904 00000100:00100000:2.0:1787826022.154021:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042923904 00000100:00100000:2.0:1787826022.154111:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 737 00000100:00100000:2.0:1787826022.154124:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+91:155667:x1874663042923904:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826022.154161:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.154192:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebd39 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edd5 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155233:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155258:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155447:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155463:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 43 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155472:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155479:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155853:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd4e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155863:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd4e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.155871:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd4e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826022.155994:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbf:0x0]: returning size 4096 00000004:00200000:2.0:1787826022.156000:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826022.156027:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd4e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.156041:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.156048:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.156055:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.156062:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826022.156067:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.156075:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.156089:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826022.156092:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.156097:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.156104:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd40 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157057:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157077:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157084:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157090:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826022.157094:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157101:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157115:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826022.157117:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.157130:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157136:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd47 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157179:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebd39 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edd5 expref: 93 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157193:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd4e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edd5 expref: 92 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.157200:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbf:0x0].0x0 (ffff8eb480de3100) 00010000:00010000:2.0:1787826022.157202:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826022.157206:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:2.0:1787826022.157526:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+92:155667:x1874663042923904:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 3401us (10543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.157537:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 737 00000100:00100000:1.0:1787826022.162392:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.162492:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042924032 00000100:00100000:0.0:1787826022.162505:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042924032 00000100:00100000:0.0:1787826022.162591:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 738 00000100:00100000:0.0:1787826022.162603:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+92:155667:x1874663042924032:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826022.162628:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.162665:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd55 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eddc expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.162745:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 3/1,0 mode: --/PR res: [0x200026560:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.162761:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.162774:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826022.162835:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x33:0x0]: returning size 4096 00000004:00200000:0.0:1787826022.162840:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826022.162880:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd55 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 94 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.162901:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 93 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.162915:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x33:0x0].0x0 (ffff8eb480de3c00) 00010000:00010000:0.0:1787826022.162919:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826022.162922:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715c00, rc 0) 00000100:00100000:0.0:1787826022.162995:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:155667:x1874663042924032:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 394us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.163004:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 738 00000100:00100000:2.0:1787826022.165020:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.165121:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042924160 00000100:00100000:1.0:1787826022.165142:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042924160 00000100:00100000:1.0:1787826022.165224:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 739 00000100:00100000:1.0:1787826022.165237:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155667:x1874663042924160:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826022.165269:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826022.165295:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00cebd63 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ede3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.165389:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.165405:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebd32 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebd2b expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.165415:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.165457:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebd32 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cebd2b expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.165477:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049164288:0@lo:104: 00000100:00080000:0.0:1787826022.165744:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826022.165810:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826022.165896:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4728cf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.165981:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049164288 00000100:00100000:3.0:1787826022.165986:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049164288 00000100:00100000:3.0:1787826022.166056:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4735 00000100:00100000:3.0:1787826022.166065:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049164288:12345-0@lo:104: 00010000:00010000:3.0:1787826022.166079:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.166153:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826022.166160:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049164288:12345-0@lo:104: Request processed in 96us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.166167:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4735 00010000:00010000:0.0:1787826022.166207:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826022.166215:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.166225:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826022.166232:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.166381:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049164288:0@lo:104: 00010000:00010000:1.0:1787826022.166407:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.166517:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.166564:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.166571:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826022.166604:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.166612:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cebd2b lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebd32 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.166644:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826022.166656:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826022.166658:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826022.166759:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826022.166776:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049164416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826022.166821:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.166896:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049164416 00000100:00100000:0.0:1787826022.166902:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049164416 00010000:00010000:0.0:1787826022.166926:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebd32 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cebd2b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.166958:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12171 00000100:00100000:0.0:1787826022.166966:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3617:x1874663049164416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826022.166979:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787826022.178613:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869813 is committed 00010000:00010000:0.0:1787826022.178851:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebd32 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cebd2b expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.178877:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x33:0x0].0x0 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826022.178883:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.178896:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.178905:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.178943:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826022.179041:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049164416:12345-0@lo:103:ldlm_bl.0 Request processed in 12074us (12217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.179052:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12171 00010000:00010000:1.0:1787826022.179141:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.179151:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826022.179221:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x33:0x0]: returning size 4096 00000004:00200000:1.0:1787826022.179227:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826022.179290:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00cebd63 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.179310:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.179319:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x33:0x0].0x0 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826022.179446:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826022.179450:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356200, rc 0) 00000100:00100000:1.0:1787826022.179556:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155667:x1874663042924160:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 14322us (14548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.179565:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 739 00000100:00100000:2.0:1787826022.179799:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049164416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826022.191442:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.191831:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042924416 00000100:00100000:0.0:1787826022.191848:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042924416 00000100:00100000:0.0:1787826022.191940:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 740 00000100:00100000:0.0:1787826022.191952:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:155667:x1874663042924416:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:0.0:1787826022.192028:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826022.192070:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd4e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edd5 expref: 93 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.192097:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbf:0x0].0x0 (ffff8eb480de3100) 00010000:00010000:0.0:1787826022.192104:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826022.192134:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.192150:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.192163:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.192182:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 43 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.192201:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.192210:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.192722:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.192733:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.192741:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.192764:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.192775:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 92 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.192783:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.192826:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 92 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.192849:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 92 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.192866:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049164544:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826022.193074:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826022.195471:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049164544:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826022.195514:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.198236:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.199110:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042924544 00000100:00100000:0.0:1787826022.199125:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042924544 00010000:00010000:2.0:1787826022.199240:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 93 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.199294:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12172 00000100:00100000:2.0:1787826022.199307:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:2392:x1874663042924544:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826022.199363:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826022.199372:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 93 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.199388:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 93 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.199424:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cebd5c lrc: 0/0,0 mode: --/PR res: [0x200026560:0x33:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eddc expref: 93 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.199451:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x33:0x0].0x0 (ffff8eb480de3c00) 00010000:00010000:2.0:1787826022.199457:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.199469:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.199477:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.199518:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826022.199810:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.199820:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.199887:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.199897:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.199908:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.199925:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+92:2392:x1874663042924544:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 620us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.199934:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12172 00000100:00100000:3.0:1787826022.200106:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049164672:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787826022.200412:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.200449:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826022.201518:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049164672 00000100:00100000:2.0:1787826022.201536:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049164672 00000100:00100000:2.0:1787826022.201607:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12367 00000100:00100000:2.0:1787826022.201618:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049164672:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787826022.201642:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.201681:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebd8d expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.201932:0:177386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.201947:0:177386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.202003:0:177386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.202021:0:177386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 6 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.202038:0:177386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049164800:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826022.202139:0:177386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.207929:0:177386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049164800:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826022.207995:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.208015:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x33:0x0].0x0 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826022.208019:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826022.208024:0:177386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.208042:0:177386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.208050:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:3.0:1787826022.208237:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049164672:12345-0@lo:101:mdt00_000.0 Request processed in 6619us (7823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.208254:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12367 00000100:00100000:2.0:1787826022.208432:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869813 gen 2 00000004:00080000:2.0:1787826022.208440:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869812 committed transno 17179869813 00000004:00080000:2.0:1787826022.208471:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869813 committed transno 17179869813 00000100:00100000:2.0:1787826022.208492:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049164672:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787826022.208519:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.208531:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.208782:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.208892:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042924672 00000100:00100000:3.0:1787826022.208901:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042924672 00010000:00010000:3.0:1787826022.208950:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 7 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.209028:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12173 00000100:00100000:3.0:1787826022.209043:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2391:x1874663042924672:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826022.209061:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826022.209072:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 7 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.209086:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 7 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.209115:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356200/0x878a5eea00cebd6a lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ede3 expref: 7 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.209211:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x33:0x0].0x0 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826022.209217:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.209233:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.209242:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.209292:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.209314:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049164928:0@lo:105: 00000100:00100000:3.0:1787826022.209469:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.209513:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.209593:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049164928 00000100:00100000:0.0:1787826022.209599:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049164928 00000100:00100000:0.0:1787826022.209658:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4736 00000100:00100000:0.0:1787826022.209667:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049164928:12345-0@lo:105: 00010000:00010000:0.0:1787826022.209678:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.209689:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.209705:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.209713:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.209719:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.209733:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.209755:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab18e00) 00000100:00100000:0.0:1787826022.209809:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049164928:12345-0@lo:105: Request processed in 144us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.209822:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4736 00000100:00100000:3.0:1787826022.210004:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049164928:0@lo:105: 00010000:00010000:3.0:1787826022.210025:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826022.210088:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042924672:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1050us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.210096:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12173 00010000:00010000:2.0:1787826022.210750:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.210773:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.211968:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049165056:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787826022.212077:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.212277:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.212389:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049165056 00000100:00100000:1.0:1787826022.212406:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049165056 00000100:00100000:1.0:1787826022.212478:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12368 00000100:00100000:1.0:1787826022.212494:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049165056:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787826022.216727:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049165056:12345-0@lo:403:mdt00_000.0 Request processed in 4213us (4634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.216747:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12368 00000100:00100000:2.0:1787826022.216890:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049165056:0@lo:403:mdt00_000.0 00000040:00080000:2.0:1787826022.221286:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].444, 656 off681208 00000040:00080000:2.0:1787826022.221700:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].315, 736 off522976 00000004:00080000:2.0:1787826022.221715:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349480d80 with version 632 00000004:00080000:3.0:1787826022.221835:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 632 rpc_version 632 00000020:00100000:3.0:1787826022.221895:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826022.221910:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a427800 x1874663049165312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826022.221952:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049165312:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826022.222060:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.222244:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.222312:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049165312 00000100:00100000:1.0:1787826022.222518:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049165312 00000100:00100000:1.0:1787826022.222720:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12369 00000100:00100000:1.0:1787826022.222740:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049165312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826022.223078:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049165312:12345-0@lo:1000:osp_up1-0.0 Request processed in 348us (1018us total) trans 17179869814 rc 0/0 00000100:00100000:1.0:1787826022.223088:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12369 00000100:00100000:2.0:1787826022.223291:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049165312:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787826022.223417:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bbf:0x0]: returning size 4096 00010000:00010000:0.0:1787826022.223459:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223477:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223486:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223493:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.223499:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223507:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223533:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x33:0x0].0x0 (ffff8eb480de3c00) 00010000:00010000:0.0:1787826022.223536:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826022.223623:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223637:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebd86 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223665:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223679:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223687:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223728:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826022.223738:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x33:0x0] 00010000:00010000:0.0:1787826022.223753:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223760:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223767:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223778:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.223781:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223788:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223802:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbf:0x0].0x0 (ffff8eb480de3100) 00010000:00010000:0.0:1787826022.223805:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826022.223808:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223814:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebd7f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223834:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223841:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223852:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223858:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.223861:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223867:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223876:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.223882:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.223885:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223891:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebd71 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.223903:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039babda9 reply state 000000001674043a transno 335007449187 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223922:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.223930:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826022.223932:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826022.223940:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826022.224032:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:155667:x1874663042924416:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 32080us (32602us total) trans 335007449187 rc 0/0 00000100:00100000:0.0:1787826022.224045:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 740 00010000:00010000:2.0:1787826022.224118:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826022.224138:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.224147:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826022.224151:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826022.224160:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.224206:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.224213:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826022.224268:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.224276:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18e00/0x878a5eea00cebd8d lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebd94 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.224307:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826022.224309:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826022.224311:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826022.224321:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826022.224379:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049165440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826022.224445:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.224660:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049165440 00000100:00100000:2.0:1787826022.224669:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049165440 00000100:00100000:2.0:1787826022.224742:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4191 00000100:00100000:2.0:1787826022.224753:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049165440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826022.224775:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826022.224803:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebd94 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cebd8d expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.224824:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x33:0x0].0x0 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826022.224836:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826022.224883:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049165440:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.224890:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4191 00000100:00100000:2.0:1787826022.224940:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049165440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826022.229737:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826022.243774:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.243911:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042924800 00000100:00100000:2.0:1787826022.243924:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042924800 00000100:00100000:2.0:1787826022.244033:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 741 00000100:00100000:2.0:1787826022.244046:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:155686:x1874663042924800:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826022.244078:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.244105:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd9b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edea expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244194:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244212:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244226:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244241:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 44 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244249:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244256:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244355:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244363:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244370:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244377:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826022.244382:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244392:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244406:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826022.244409:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.244415:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244422:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebda2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244439:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244445:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244451:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244457:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826022.244460:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244466:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244474:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826022.244476:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.244479:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244486:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebda9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244521:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd9b lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edea expref: 94 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244532:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826022.244534:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.244539:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebd9b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edea expref: 94 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.244549:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:2.0:1787826022.244631:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:155686:x1874663042924800:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 587us (929us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826022.244639:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 741 00000100:00100000:2.0:1787826022.249312:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.249465:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042924928 00000100:00100000:1.0:1787826022.249479:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042924928 00000100:00100000:1.0:1787826022.249548:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 742 00000100:00100000:1.0:1787826022.249561:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:155686:x1874663042924928:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826022.249587:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826022.249627:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebdb0 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edf1 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250119:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250139:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250153:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250172:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 44 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250181:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250188:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250250:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250258:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250265:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250271:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.250277:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250284:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250298:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.250302:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.250307:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250313:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebdb7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250492:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250500:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250507:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250512:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.250516:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250522:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250531:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.250533:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.250537:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250543:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebdbe lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250583:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebdb0 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edf1 expref: 94 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250595:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.250598:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.250602:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebdb0 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edf1 expref: 94 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.250613:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356a00, rc 0) 00000100:00100000:1.0:1787826022.250859:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:155686:x1874663042924928:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1299us (1562us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826022.250868:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 742 00000100:00100000:0.0:1787826022.255564:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.255702:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042925056 00000100:00100000:1.0:1787826022.255716:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042925056 00000100:00100000:1.0:1787826022.255792:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 743 00000100:00100000:1.0:1787826022.255805:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+93:155686:x1874663042925056:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826022.255830:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826022.255855:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebdc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edf8 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.255937:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebdcc lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.255954:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebdcc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.255969:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebdcc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826022.256033:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:1.0:1787826022.256038:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826022.256063:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebdcc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.256094:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebdc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edf8 expref: 95 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.256118:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebdcc lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edf8 expref: 94 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.256128:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.256132:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826022.256136:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:1.0:1787826022.256222:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+94:155686:x1874663042925056:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 419us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.256230:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 743 00000100:00100000:3.0:1787826022.264787:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.264871:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042925312 00000100:00100000:0.0:1787826022.264890:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042925312 00000100:00100000:0.0:1787826022.264978:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 744 00000100:00100000:0.0:1787826022.264992:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+94:155686:x1874663042925312:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826022.265071:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826022.265110:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebdcc lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edf8 expref: 94 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.265149:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.265155:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826022.265240:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.265257:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.265270:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.265282:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 44 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.265300:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.265307:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826022.266313:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].445, 2152 off683360 00000040:00080000:0.0:1787826022.266441:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].317, 2352 off526640 00000004:00080000:0.0:1787826022.266448:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fb600 with version 633 00000004:00080000:3.0:1787826022.269271:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 633 rpc_version 633 00000020:00100000:3.0:1787826022.269375:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826022.269392:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47f995500 x1874663049165696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826022.269422:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049165696:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826022.269520:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.269574:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.269753:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049165696 00000100:00100000:0.0:1787826022.269765:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049165696 00000100:00100000:0.0:1787826022.269841:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12370 00000100:00100000:0.0:1787826022.269852:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049165696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826022.270867:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049165696:12345-0@lo:1000:osp_up1-0.0 Request processed in 1012us (1342us total) trans 17179869815 rc 0/0 00000100:00100000:0.0:1787826022.270880:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12370 00000100:00100000:0.0:1787826022.271024:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049165696:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826022.272874:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.272911:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.272933:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.272966:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.272982:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.272991:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273051:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273067:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273079:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.273117:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049165824:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787826022.273209:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.273285:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826022.273410:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049165824 00000100:00100000:2.0:1787826022.273420:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049165824 00000100:00100000:2.0:1787826022.273489:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12371 00000100:00100000:2.0:1787826022.273501:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187904:x1874663049165824:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787826022.273524:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.273547:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebdf6 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebdef expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.273574:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebdf6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebdef expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.273593:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebdf6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebdef expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.273602:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x34:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:2.0:1787826022.273605:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.273622:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:2.0:1787826022.273687:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187904:x1874663049165824:12345-0@lo:101:mdt00_000.0 Request processed in 188us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.273695:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12371 00000100:00100000:3.0:1787826022.273751:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049165824:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826022.273778:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273801:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826022.273832:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc596173 reply state 0000000090d8de6a transno 335007449188 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273846:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273858:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x34:0x0].0x0 (ffff8eb476e51e00) 00010000:00010000:3.0:1787826022.273860:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826022.273864:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826022.273871:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273883:0:187904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826022.273895:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x34:0x0] 00000004:00010000:3.0:1787826022.273900:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc596173 reply state 0000000090d8de6a transno 335007449188 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273908:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273919:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc0:0x0].0x0 (ffff8eb476e51c00) 00010000:00010000:3.0:1787826022.273921:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826022.273923:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826022.273929:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc0:0x0]: returning size 4096 00010000:00010000:3.0:1787826022.273939:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273952:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273959:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273965:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.273971:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.273986:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.274000:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.274007:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.274012:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.274018:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cebdd3 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826022.274041:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc596173 reply state 0000000090d8de6a transno 335007449188 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.274052:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.274058:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826022.274061:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826022.274064:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826022.274181:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+95:155686:x1874663042925312:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 9189us (9403us total) trans 335007449188 rc 0/0 00000100:00100000:3.0:1787826022.274189:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 744 00000100:00100000:3.0:1787826022.302747:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.306800:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042925440 00000100:00100000:0.0:1787826022.306815:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042925440 00000100:00100000:0.0:1787826022.306897:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 745 00000100:00100000:0.0:1787826022.306909:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+95:155688:x1874663042925440:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826022.306934:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.306956:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cebdfd lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6edff expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307022:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307038:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307050:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307061:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 45 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307070:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307077:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307830:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebe12 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307844:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebe12 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307853:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebe12 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826022.307937:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc0:0x0]: returning size 4096 00000004:00200000:0.0:1787826022.307942:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787826022.307961:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebe12 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307971:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307978:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307985:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.307990:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.307996:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308004:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308017:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.308020:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.308025:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308031:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe04 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308047:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308052:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308057:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308062:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.308064:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308070:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308080:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826022.308082:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.308085:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308168:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe0b lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308202:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cebdfd lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edff expref: 97 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308216:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebe12 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edff expref: 96 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.308223:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc0:0x0].0x0 (ffff8eb476e51c00) 00010000:00010000:0.0:1787826022.308225:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826022.308228:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568a00, rc 0) 00000100:00100000:0.0:1787826022.309007:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+96:155688:x1874663042925440:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 2094us (6267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.309019:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 745 00000100:00100000:0.0:1787826022.312104:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.312225:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042925568 00000100:00100000:3.0:1787826022.312243:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042925568 00000100:00100000:3.0:1787826022.312376:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 746 00000100:00100000:3.0:1787826022.312390:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+96:155688:x1874663042925568:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826022.312416:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826022.312443:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cebe19 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee06 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.312516:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.312534:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.312547:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826022.312623:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x34:0x0]: returning size 4096 00000004:00200000:3.0:1787826022.312630:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826022.312683:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cebe19 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 98 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.312704:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 97 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.312721:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x34:0x0].0x0 (ffff8eb476e51e00) 00010000:00010000:3.0:1787826022.312724:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826022.312728:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18a00, rc 0) 00000100:00100000:3.0:1787826022.312804:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:155688:x1874663042925568:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 417us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.312813:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 746 00000100:00100000:1.0:1787826022.317019:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.317095:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042925696 00000100:00100000:3.0:1787826022.317108:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042925696 00000100:00100000:3.0:1787826022.317209:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 747 00000100:00100000:3.0:1787826022.317220:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155688:x1874663042925696:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826022.317244:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826022.317276:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe27 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee0d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.317378:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.317395:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebdf6 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebdef expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.317405:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.317446:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebdf6 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cebdef expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.317464:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049165952:0@lo:104: 00000100:00100000:3.0:1787826022.317519:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.317566:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.317733:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049165952 00000100:00100000:1.0:1787826022.317738:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049165952 00000100:00100000:1.0:1787826022.317781:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4737 00000100:00100000:1.0:1787826022.317789:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049165952:12345-0@lo:104: 00010000:00010000:1.0:1787826022.317804:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.317860:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826022.317866:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049165952:12345-0@lo:104: Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.317873:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4737 00010000:00010000:1.0:1787826022.317901:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826022.317908:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.317917:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826022.317925:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826022.317935:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.317964:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.317971:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826022.317993:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.318001:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cebdef lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebdf6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.318022:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826022.318024:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826022.318026:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826022.318038:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049166080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826022.318070:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826022.318104:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049166080 00000100:00100000:1.0:1787826022.318107:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049166080 00010000:00010000:1.0:1787826022.318134:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebdf6 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cebdef expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.318157:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12174 00000100:00100000:1.0:1787826022.318163:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049166080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826022.318173:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826022.321454:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049165952:0@lo:104: 00010000:00010000:1.0:1787826022.321495:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826022.323556:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869815 is committed 00010000:00010000:0.0:1787826022.323740:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cebdf6 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cebdef expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.323763:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x34:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:0.0:1787826022.323771:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.323783:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.323793:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.323833:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826022.323983:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049166080:12345-0@lo:103:ldlm_bl.0 Request processed in 5817us (5908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.323995:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12174 00010000:00010000:1.0:1787826022.324108:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.324117:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826022.324205:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x34:0x0]: returning size 4096 00000004:00200000:1.0:1787826022.324213:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826022.324287:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe27 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.324306:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.324315:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x34:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:1.0:1787826022.324318:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826022.324571:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19800, rc 0) 00000100:00100000:1.0:1787826022.324637:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155688:x1874663042925696:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 7418us (7630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.324655:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 747 00000100:00100000:3.0:1787826022.329721:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049166080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826022.331560:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.334847:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042925952 00000100:00100000:0.0:1787826022.334867:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042925952 00000100:00100000:0.0:1787826022.334999:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 748 00000100:00100000:0.0:1787826022.335013:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:155688:x1874663042925952:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:0.0:1787826022.335083:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826022.335126:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebe12 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6edff expref: 97 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335149:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc0:0x0].0x0 (ffff8eb476e51c00) 00010000:00010000:0.0:1787826022.335156:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826022.335184:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335200:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335213:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335226:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 45 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335243:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335256:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335369:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335379:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335387:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335407:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335418:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 96 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335428:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 4/0,1 mode: --/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335470:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 96 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.335487:0:188682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 96 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.335505:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049166208:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826022.335620:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.343490:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.343584:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042926080 00000100:00100000:2.0:1787826022.343598:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042926080 00010000:00010000:2.0:1787826022.343664:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 97 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.343717:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12175 00000100:00100000:2.0:1787826022.343730:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:2392:x1874663042926080:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826022.343747:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826022.343755:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 97 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.343772:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 97 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.343801:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x34:0x0].0x0 (ffff8eb476e51e00) 00010000:00010000:2.0:1787826022.343807:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.343825:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.343835:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.343858:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826022.343925:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:2392:x1874663042926080:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 196us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.343933:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12175 00010000:00010000:3.0:1787826022.344796:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe20 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee06 expref: 96 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.344822:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188682:1874663049166208:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826022.344852:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.344863:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.344871:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.344934:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.344943:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.344955:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.344980:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049166336:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826022.345037:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.345078:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826022.345278:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049166336 00000100:00100000:2.0:1787826022.345286:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049166336 00000100:00100000:2.0:1787826022.345367:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12372 00000100:00100000:2.0:1787826022.345378:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188682:x1874663049166336:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826022.345397:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.345417:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebe58 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebe51 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.345445:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.345454:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebe58 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebe51 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.345481:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.345498:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 6 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.345512:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049166464:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826022.345572:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.348885:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.349409:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042926208 00000100:00100000:2.0:1787826022.349422:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042926208 00010000:00010000:2.0:1787826022.349482:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.349532:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12176 00000100:00100000:2.0:1787826022.349544:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2391:x1874663042926208:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826022.349563:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826022.349571:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.349585:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.349614:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x34:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:2.0:1787826022.349623:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebe58 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebe51 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.349636:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebe58 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cebe51 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.349654:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebe58 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cebe51 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.349705:0:9496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebe58 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebe51 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.349722:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9496:1874663049166592:0@lo:105: 00000100:00100000:2.0:1787826022.349803:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.349856:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826022.349887:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787826022.349899:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049166592 00000100:00100000:2.0:1787826022.349903:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049166592 00000100:00100000:2.0:1787826022.349948:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4738 00000100:00100000:2.0:1787826022.349959:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9496:x1874663049166592:12345-0@lo:105: 00010000:00010000:2.0:1787826022.349972:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.349983:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.349994:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.350003:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.350011:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.350021:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.350038:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab19c00) 00000100:00100000:2.0:1787826022.350081:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9496:x1874663049166592:12345-0@lo:105: Request processed in 125us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.350089:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4738 00010000:00010000:1.0:1787826022.350479:0:177390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cebe2e lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee0d expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.350494:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049166464:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826022.350521:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebe58 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebe51 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.350529:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x34:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:1.0:1787826022.350532:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826022.350534:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00000100:00100000:1.0:1787826022.350592:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049166336:12345-0@lo:101:mdt00_003.0 Request processed in 5216us (5554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.350600:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12372 00000100:00100000:3.0:1787826022.350774:0:188682:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869815 gen 2 00000004:00080000:3.0:1787826022.350782:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869814 committed transno 17179869815 00000004:00080000:3.0:1787826022.350807:0:188682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869815 committed transno 17179869815 00000100:00100000:3.0:1787826022.350833:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049166336:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826022.350851:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.352457:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9496:1874663049166592:0@lo:105: 00010000:00010000:2.0:1787826022.353375:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826022.353459:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042926208:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 3910us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.353473:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12176 00000100:00100000:1.0:1787826022.361186:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049166720:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787826022.361623:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826022.361671:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4728cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.361742:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049166720 00000100:00100000:3.0:1787826022.361752:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049166720 00000100:00100000:3.0:1787826022.361826:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12373 00000100:00100000:3.0:1787826022.361838:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049166720:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787826022.367115:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188682:x1874663049166720:12345-0@lo:403:mdt00_003.0 Request processed in 5263us (5478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.367142:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12373 00000100:00100000:0.0:1787826022.367542:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049166720:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1787826022.369541:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].446, 656 off684016 00000040:00080000:0.0:1787826022.369853:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].318, 736 off527376 00000004:00080000:0.0:1787826022.369861:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fb600 with version 634 00000004:00080000:3.0:1787826022.371520:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 634 rpc_version 634 00000020:00100000:3.0:1787826022.371574:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826022.371590:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb3427e6d80 x1874663049166976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826022.371627:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049166976:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826022.371784:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.371833:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.371911:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049166976 00000100:00100000:0.0:1787826022.371921:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049166976 00000100:00100000:0.0:1787826022.371987:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12374 00000100:00100000:0.0:1787826022.371999:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049166976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826022.372309:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049166976:12345-0@lo:1000:osp_up1-0.0 Request processed in 311us (524us total) trans 17179869816 rc 0/0 00000100:00100000:0.0:1787826022.372319:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12374 00000100:00100000:0.0:1787826022.372412:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049166976:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787826022.372446:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc0:0x0]: returning size 4096 00010000:00010000:0.0:1787826022.372472:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372484:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372492:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372499:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.372504:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372512:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372536:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x34:0x0].0x0 (ffff8eb476e51e00) 00010000:00010000:0.0:1787826022.372539:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826022.372544:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 2/0,0 mode: --/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372552:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe4a lrc: 0/0,0 mode: --/EX res: [0x200026560:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372569:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372578:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372586:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372606:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826022.372616:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x34:0x0] 00010000:00010000:0.0:1787826022.372625:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826022.372631:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372639:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826022.372643:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.372663:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372692:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.372898:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826022.373165:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049167104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826022.373214:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.373292:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049167104 00000100:00100000:3.0:1787826022.373298:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049167104 00000100:00100000:3.0:1787826022.373371:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4192 00000100:00100000:3.0:1787826022.373382:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049167104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826022.373396:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826022.373420:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebe58 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cebe51 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.373442:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x34:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:3.0:1787826022.373453:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826022.373583:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373592:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cebe51 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebe58 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373609:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826022.373611:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826022.373613:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826022.373638:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373656:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373663:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373669:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.373673:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373680:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373690:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc0:0x0].0x0 (ffff8eb476e51c00) 00010000:00010000:0.0:1787826022.373694:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826022.373707:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373713:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe43 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373731:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373738:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373744:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373748:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.373751:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373757:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373764:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.373767:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.373770:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373776:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe35 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.373785:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062a063c0 reply state 00000000307862f4 transno 335007449189 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373805:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.373812:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826022.373815:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826022.373818:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826022.373896:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:155688:x1874663042925952:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 38882us (42345us total) trans 335007449189 rc 0/0 00000100:00100000:0.0:1787826022.373905:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 748 00000100:00100000:3.0:1787826022.374430:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049167104:12345-0@lo:103:ldlm_bl.0 Request processed in 1049us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.374439:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4192 00000100:00100000:2.0:1787826022.374639:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049167104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826022.402891:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.403012:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042926336 00000100:00100000:0.0:1787826022.403028:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042926336 00000100:00100000:0.0:1787826022.403111:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 749 00000100:00100000:0.0:1787826022.403123:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:155692:x1874663042926336:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826022.403158:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.403186:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe5f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee14 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403280:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403299:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403316:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403371:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 46 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403387:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403395:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403462:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403471:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403477:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403484:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.403489:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403497:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403511:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.403515:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.403520:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403527:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe66 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403545:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403551:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403557:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403562:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.403565:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403572:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403579:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826022.403582:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.403585:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403591:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe6d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403626:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe5f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee14 expref: 98 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403637:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.403640:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.403654:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe5f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee14 expref: 98 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.403671:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568200, rc 0) 00000100:00100000:0.0:1787826022.403749:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:155692:x1874663042926336:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 627us (876us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826022.403758:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 749 00000100:00100000:0.0:1787826022.410622:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.410765:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042926464 00000100:00100000:3.0:1787826022.410781:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042926464 00000100:00100000:3.0:1787826022.410865:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 750 00000100:00100000:3.0:1787826022.410879:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:155692:x1874663042926464:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826022.410912:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826022.410942:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe74 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee1b expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411035:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411053:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411068:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411084:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 46 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411093:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411106:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411167:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411176:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411183:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411190:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.411195:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411203:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411219:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.411222:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.411228:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411234:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebe7b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411251:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411257:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411263:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411280:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.411283:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411289:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411296:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826022.411298:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.411301:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411307:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebe82 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411380:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe74 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee1b expref: 98 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411392:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.411394:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.411398:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebe74 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee1b expref: 98 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.411407:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18a00, rc 0) 00000100:00100000:3.0:1787826022.411608:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:155692:x1874663042926464:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 730us (1003us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826022.411618:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 750 00000100:00100000:2.0:1787826022.433721:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.433792:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042926592 00000100:00100000:0.0:1787826022.433808:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042926592 00000100:00100000:0.0:1787826022.433887:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 751 00000100:00100000:0.0:1787826022.433899:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+97:155692:x1874663042926592:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826022.433925:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.433953:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee22 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.434044:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe90 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.434063:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe90 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.434078:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe90 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826022.434146:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:0.0:1787826022.434151:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826022.434177:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe90 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.434211:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee22 expref: 99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.434237:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe90 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee22 expref: 98 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.434248:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.434252:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826022.434257:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568600, rc 0) 00000100:00100000:0.0:1787826022.434636:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+98:155692:x1874663042926592:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 736us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.434654:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 751 00000100:00100000:1.0:1787826022.444666:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.449843:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042926848 00000100:00100000:0.0:1787826022.449879:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042926848 00000100:00100000:0.0:1787826022.450151:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 752 00000100:00100000:0.0:1787826022.450169:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+98:155692:x1874663042926848:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826022.450272:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826022.450315:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebe90 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee22 expref: 98 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.450393:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.450400:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826022.450512:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.450529:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.450545:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.450559:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 46 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.450583:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.450590:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826022.453251:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].447, 2152 off686168 00000040:00080000:0.0:1787826022.453416:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].319, 2352 off529728 00000004:00080000:0.0:1787826022.453428:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fb3c0 with version 635 00000004:00080000:3.0:1787826022.453512:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 635 rpc_version 635 00000020:00100000:3.0:1787826022.453586:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826022.453612:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb3427e6a00 x1874663049167360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826022.453642:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049167360:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826022.453782:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.453853:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826022.453913:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049167360 00000100:00100000:2.0:1787826022.453924:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049167360 00000100:00100000:2.0:1787826022.453996:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12375 00000100:00100000:2.0:1787826022.454008:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049167360:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826022.455033:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049167360:12345-0@lo:1000:osp_up1-0.0 Request processed in 1022us (1246us total) trans 17179869817 rc 0/0 00000100:00100000:2.0:1787826022.455045:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12375 00000100:00100000:3.0:1787826022.455319:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049167360:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826022.456861:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.456882:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.456913:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.457012:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 3/0,1 mode: --/PW res: [0x200026560:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.457020:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.457027:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.457425:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.457441:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.457471:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.457502:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049167488:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826022.457620:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.457762:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.457848:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049167488 00000100:00100000:3.0:1787826022.457858:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049167488 00000100:00100000:3.0:1787826022.458014:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12376 00000100:00100000:3.0:1787826022.458233:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049167488:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826022.458513:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826022.458557:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebeba lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebeb3 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.458588:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebeba lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebeb3 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.458602:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebeba lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebeb3 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.458631:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x35:0x0].0x0 (ffff8eb476e51800) 00010000:00010000:3.0:1787826022.458635:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.458640:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18a00, rc 0) 00000100:00100000:3.0:1787826022.458777:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049167488:12345-0@lo:101:mdt00_003.0 Request processed in 547us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.458786:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12376 00000100:00100000:0.0:1787826022.458860:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049167488:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826022.458898:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.458911:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.459011:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be326ea4 reply state 00000000c8c09d2f transno 335007449190 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.459101:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.459112:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x35:0x0].0x0 (ffff8eb47f8ff800) 00010000:00010000:0.0:1787826022.459115:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826022.459190:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826022.459199:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.461596:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826022.461628:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x35:0x0] 00000004:00010000:1.0:1787826022.461725:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be326ea4 reply state 00000000c8c09d2f transno 335007449190 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461748:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461759:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc1:0x0].0x0 (ffff8eb47f8ff400) 00010000:00010000:1.0:1787826022.461762:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826022.461768:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826022.461777:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc1:0x0]: returning size 4096 00010000:00010000:1.0:1787826022.461789:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461800:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461807:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461813:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.461818:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461825:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461837:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.461840:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.461844:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461850:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebe97 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826022.461871:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be326ea4 reply state 00000000c8c09d2f transno 335007449190 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461882:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.461888:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.461890:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826022.461892:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826022.462027:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+99:155692:x1874663042926848:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 11855us (17380us total) trans 335007449190 rc 0/0 00000100:00100000:1.0:1787826022.462037:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 752 00000100:00100000:3.0:1787826022.501167:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.501471:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042926976 00000100:00100000:0.0:1787826022.501486:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042926976 00000100:00100000:0.0:1787826022.501564:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 753 00000100:00100000:0.0:1787826022.501578:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+99:155696:x1874663042926976:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826022.501614:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.501652:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cebec1 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee29 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501751:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501771:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501784:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501798:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 47 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501807:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501813:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501921:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cebed6 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501932:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cebed6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.501937:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cebed6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826022.502027:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc1:0x0]: returning size 4096 00000004:00200000:0.0:1787826022.502032:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787826022.502052:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cebed6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502063:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502068:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502074:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502080:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.502086:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502094:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502109:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.502113:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.502118:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502129:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cebec8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502145:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502152:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502158:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502164:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.502167:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502173:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502181:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826022.502183:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.502186:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502192:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebecf lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502224:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cebec1 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee29 expref: 101 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.502246:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cebed6 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee29 expref: 100 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.503939:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc1:0x0].0x0 (ffff8eb47f8ff400) 00010000:00010000:0.0:1787826022.503945:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826022.503950:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568800, rc 0) 00000100:00100000:2.0:1787826022.504232:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+100:155696:x1874663042926976:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 2650us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.504245:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 753 00000100:00100000:3.0:1787826022.515220:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.515370:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042927104 00000100:00100000:0.0:1787826022.515384:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042927104 00000100:00100000:0.0:1787826022.515467:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 754 00000100:00100000:0.0:1787826022.515480:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+100:155696:x1874663042927104:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826022.515510:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.515539:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cebedd lrc: 2/0,0 mode: --/CR res: [0x200026560:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee30 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.515619:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.515637:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.515660:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826022.515724:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x35:0x0]: returning size 4096 00000004:00200000:0.0:1787826022.515731:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826022.515774:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cebedd lrc: 0/0,0 mode: --/CR res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 102 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.515801:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 101 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.515809:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x35:0x0].0x0 (ffff8eb47f8ff800) 00010000:00010000:0.0:1787826022.515813:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826022.515817:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568a00, rc 0) 00000100:00100000:0.0:1787826022.515893:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:155696:x1874663042927104:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 417us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.515901:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 754 00000100:00100000:3.0:1787826022.530595:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.530731:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042927232 00000100:00100000:0.0:1787826022.530745:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042927232 00000100:00100000:0.0:1787826022.530845:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 755 00000100:00100000:0.0:1787826022.530859:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155696:x1874663042927232:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826022.530887:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.530913:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568e00/0x878a5eea00cebeeb lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee37 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.531004:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.531029:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebeba lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebeb3 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.531040:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.531084:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebeba lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cebeb3 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.531105:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049167616:0@lo:104: 00000100:00100000:0.0:1787826022.531172:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.531233:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.531468:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049167616 00000100:00100000:3.0:1787826022.531473:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049167616 00000100:00100000:3.0:1787826022.531523:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4739 00000100:00100000:3.0:1787826022.531531:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049167616:12345-0@lo:104: 00010000:00010000:3.0:1787826022.531546:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.531618:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826022.531625:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049167616:12345-0@lo:104: Request processed in 95us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.531633:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4739 00010000:00010000:3.0:1787826022.531670:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826022.531677:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.531686:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826022.531693:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826022.531703:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.531736:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.531744:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826022.531770:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.531779:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569400/0x878a5eea00cebeb3 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebeba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.531808:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826022.531811:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826022.531812:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826022.531821:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826022.531836:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049167744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826022.531877:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.531913:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049167744 00000100:00100000:3.0:1787826022.531917:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049167744 00010000:00010000:3.0:1787826022.531939:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebeba lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cebeb3 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.531962:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12177 00000100:00100000:3.0:1787826022.531971:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3617:x1874663049167744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826022.531983:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826022.533096:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049167616:0@lo:104: 00010000:00010000:0.0:1787826022.533125:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826022.542315:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869817 is committed 00010000:00010000:3.0:1787826022.545786:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebeba lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cebeb3 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.545816:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x35:0x0].0x0 (ffff8eb476e51800) 00010000:00010000:3.0:1787826022.545823:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.545868:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.545876:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.545925:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826022.546055:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049167744:12345-0@lo:103:ldlm_bl.0 Request processed in 14083us (14174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.546067:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12177 00010000:00010000:1.0:1787826022.546419:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.546430:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826022.546512:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x35:0x0]: returning size 4096 00000004:00200000:1.0:1787826022.546519:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826022.546578:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568e00/0x878a5eea00cebeeb lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.546599:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.546609:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x35:0x0].0x0 (ffff8eb476e51800) 00010000:00010000:1.0:1787826022.546612:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826022.546615:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568200, rc 0) 00000100:00100000:1.0:1787826022.546689:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155696:x1874663042927232:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 15833us (16111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.546707:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 755 00000100:00100000:2.0:1787826022.547971:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049167744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826022.552491:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.552555:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042927488 00000100:00100000:1.0:1787826022.552568:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042927488 00000100:00100000:1.0:1787826022.552655:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 756 00000100:00100000:1.0:1787826022.552668:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:155696:x1874663042927488:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:1.0:1787826022.552872:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826022.552917:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cebed6 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee29 expref: 101 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553260:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc1:0x0].0x0 (ffff8eb47f8ff400) 00010000:00010000:1.0:1787826022.553267:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826022.553299:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553317:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553359:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553373:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 47 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553392:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553398:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553508:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553516:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553524:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553550:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553561:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 100 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553570:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 4/0,1 mode: --/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553613:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 100 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.553631:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 100 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.553657:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049167872:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826022.553772:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4728cfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.563994:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.564058:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049167872:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826022.564076:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042927616 00000100:00100000:0.0:1787826022.564087:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042927616 00010000:00010000:1.0:1787826022.564096:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564139:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 101 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.564190:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12178 00000100:00100000:0.0:1787826022.564201:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:2391:x1874663042927616:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826022.564221:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826022.564229:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 101 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564243:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 101 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564271:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cebee4 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x35:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee30 expref: 101 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564291:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x35:0x0].0x0 (ffff8eb47f8ff800) 00010000:00010000:0.0:1787826022.564297:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564308:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564317:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564373:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826022.564415:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.564425:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.564436:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+100:2391:x1874663042927616:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 234us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.564445:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12178 00010000:00010000:1.0:1787826022.564484:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.564493:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.564503:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.564525:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049168000:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787826022.564574:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826022.564614:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4728cfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.564681:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049168000 00000100:00100000:0.0:1787826022.564686:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049168000 00000100:00100000:0.0:1787826022.564723:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12377 00000100:00100000:0.0:1787826022.564730:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049168000:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787826022.564749:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.564767:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebf15 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564790:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564801:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564937:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.564957:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 6 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.564969:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8414:1874663049168128:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826022.565127:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.572631:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826022.572767:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8414:1874663049168128:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826022.572815:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.572831:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x35:0x0].0x0 (ffff8eb476e51800) 00010000:00010000:0.0:1787826022.572835:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826022.572839:0:8414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.572851:0:8414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.572859:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569800, rc 0) 00000100:00100000:0.0:1787826022.572941:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049168000:12345-0@lo:101:mdt00_000.0 Request processed in 8210us (8364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.572951:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12377 00000100:00100000:3.0:1787826022.572988:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869817 gen 2 00000004:00080000:3.0:1787826022.572997:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869816 committed transno 17179869817 00000004:00080000:3.0:1787826022.573023:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869817 committed transno 17179869817 00000100:00100000:3.0:1787826022.573052:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049168000:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826022.573074:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.573088:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.575012:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042927744 00000100:00100000:2.0:1787826022.575030:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042927744 00010000:00010000:2.0:1787826022.575093:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.575142:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12179 00000100:00100000:2.0:1787826022.575153:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042927744:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826022.575170:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826022.575178:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.575194:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.575220:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cebef2 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee37 expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.575241:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x35:0x0].0x0 (ffff8eb476e51800) 00010000:00010000:2.0:1787826022.575248:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.575261:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.575269:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.575315:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.575359:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049168256:0@lo:105: 00000100:00100000:2.0:1787826022.575433:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.575483:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.575573:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049168256 00000100:00100000:0.0:1787826022.575578:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049168256 00000100:00100000:0.0:1787826022.575615:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4740 00000100:00100000:0.0:1787826022.575622:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049168256:12345-0@lo:105: 00010000:00010000:0.0:1787826022.575636:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.575657:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.575666:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.575675:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.575682:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.575692:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.575717:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb441357800) 00000100:00100000:0.0:1787826022.575754:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049168256:12345-0@lo:105: Request processed in 132us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.575760:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4740 00000100:00100000:2.0:1787826022.576627:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049168256:0@lo:105: 00010000:00010000:2.0:1787826022.576665:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826022.576733:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042927744:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1580us (4116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.576742:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12179 00010000:00010000:2.0:1787826022.576778:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.576788:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.577569:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049168384:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787826022.577640:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.577685:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.577974:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049168384 00000100:00100000:1.0:1787826022.577992:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049168384 00000100:00100000:1.0:1787826022.578165:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12378 00000100:00100000:1.0:1787826022.578176:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049168384:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787826022.584160:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049168384:12345-0@lo:403:mdt00_000.0 Request processed in 5971us (6503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.584180:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12378 00000100:00100000:3.0:1787826022.584425:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049168384:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1787826022.588263:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].448, 656 off686824 00000040:00080000:3.0:1787826022.588678:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].320, 736 off530464 00000004:00080000:3.0:1787826022.588685:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34896b9c0 with version 636 00000004:00080000:0.0:1787826022.598057:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 636 rpc_version 636 00000020:00100000:0.0:1787826022.598125:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826022.598141:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66d500 x1874663049168640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826022.598171:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049168640:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826022.598263:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.598310:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826022.598348:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049168640 00000100:00100000:2.0:1787826022.598358:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049168640 00000100:00100000:2.0:1787826022.598431:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12379 00000100:00100000:2.0:1787826022.598442:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049168640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826022.598780:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049168640:12345-0@lo:1000:osp_up1-0.0 Request processed in 339us (516us total) trans 17179869818 rc 0/0 00000100:00100000:2.0:1787826022.598790:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12379 00000100:00100000:0.0:1787826022.599011:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049168640:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1787826022.599103:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc1:0x0]: returning size 4096 00010000:00010000:3.0:1787826022.599133:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599145:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599154:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599160:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.599165:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599173:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599192:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x35:0x0].0x0 (ffff8eb47f8ff800) 00010000:00010000:3.0:1787826022.599195:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826022.599199:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 2/0,0 mode: --/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599206:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf0e lrc: 0/0,0 mode: --/EX res: [0x200026560:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599223:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599233:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599240:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599271:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787826022.599282:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x35:0x0] 00010000:00010000:3.0:1787826022.599290:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599295:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599301:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599306:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.599309:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599315:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599322:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc1:0x0].0x0 (ffff8eb47f8ff400) 00010000:00010000:3.0:1787826022.599346:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826022.599350:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599356:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf07 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.599370:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826022.599373:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.599377:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599379:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.599385:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357800 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826022.599387:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.599389:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599392:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.599395:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826022.599397:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599401:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599408:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.599410:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.599412:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599417:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebef9 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826022.599426:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043068ea1 reply state 000000009ac98b1e transno 335007449191 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.599427:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.599434:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826022.599440:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.599447:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826022.599449:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826022.599452:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826022.599457:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.599463:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357800/0x878a5eea00cebf15 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebf1c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.599481:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826022.599483:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826022.599484:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826022.599533:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:155696:x1874663042927488:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 46865us (47055us total) trans 335007449191 rc 0/0 00000100:00100000:3.0:1787826022.599542:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 756 00000100:00100000:3.0:1787826022.599570:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826022.599584:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049168768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826022.599628:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.599789:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049168768 00000100:00100000:0.0:1787826022.599794:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049168768 00000100:00100000:0.0:1787826022.600102:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4193 00000100:00100000:0.0:1787826022.600112:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049168768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826022.600128:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826022.600150:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569800/0x878a5eea00cebf1c lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cebf15 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.600165:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x35:0x0].0x0 (ffff8eb476e51800) 00010000:00010000:0.0:1787826022.600175:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826022.600220:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049168768:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.600227:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4193 00000100:00100000:2.0:1787826022.600382:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049168768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826022.650730:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.653967:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042927872 00000100:00100000:3.0:1787826022.654119:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042927872 00000100:00100000:3.0:1787826022.654210:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 757 00000100:00100000:3.0:1787826022.654223:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:155698:x1874663042927872:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826022.654256:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826022.654283:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebf23 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee3e expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654384:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654401:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654414:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654426:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 48 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654434:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654440:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654499:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654507:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654515:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654522:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.654527:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654535:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654551:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.654554:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.654559:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654565:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebf2a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654581:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654588:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654593:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654598:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.654601:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654607:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654614:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826022.654616:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.654620:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654625:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebf31 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654762:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebf23 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee3e expref: 102 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654774:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.654776:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.654780:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebf23 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee3e expref: 102 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.654790:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18a00, rc 0) 00000100:00100000:3.0:1787826022.655090:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:155698:x1874663042927872:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 868us (4369us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826022.655099:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 757 00000100:00100000:2.0:1787826022.663103:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.666223:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042928000 00000100:00100000:1.0:1787826022.666243:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042928000 00000100:00100000:1.0:1787826022.666343:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 758 00000100:00100000:1.0:1787826022.666356:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:155698:x1874663042928000:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826022.666382:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826022.666409:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf38 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee45 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666487:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666512:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666527:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666540:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 48 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666548:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666554:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666605:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666612:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666619:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666626:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.666631:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666639:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666666:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.666670:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.666675:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666682:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cebf3f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666695:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666701:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666707:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666713:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.666715:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666721:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666727:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.666729:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.666732:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666737:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebf46 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666767:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf38 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee45 expref: 102 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666778:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.666780:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.666784:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf38 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee45 expref: 102 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.666792:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356200, rc 0) 00000100:00100000:1.0:1787826022.667073:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:155698:x1874663042928000:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 718us (3979us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826022.667081:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 758 00000100:00100000:1.0:1787826022.678598:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.686580:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042928128 00000100:00100000:3.0:1787826022.686600:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042928128 00000100:00100000:1.0:1787826022.688093:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 759 00000100:00100000:1.0:1787826022.688113:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+101:155698:x1874663042928128:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826022.688144:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826022.688171:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee4c expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.688273:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebf54 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.688295:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebf54 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.688309:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebf54 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826022.688397:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:1.0:1787826022.688402:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826022.688427:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebf54 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.688457:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee4c expref: 103 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.688476:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebf54 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee4c expref: 102 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.688486:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.688490:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826022.688495:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fc00, rc 0) 00000100:00100000:1.0:1787826022.688592:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+102:155698:x1874663042928128:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 484us (10010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.688600:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 759 00000100:00100000:0.0:1787826022.706486:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.706598:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042928384 00000100:00100000:1.0:1787826022.706612:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042928384 00000100:00100000:1.0:1787826022.706692:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 760 00000100:00100000:1.0:1787826022.706711:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+102:155698:x1874663042928384:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826022.706785:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826022.706836:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00cebf54 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee4c expref: 102 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.706860:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.706867:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826022.706946:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.706963:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.706975:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.707000:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 48 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.707019:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.707027:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826022.709589:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].450, 2152 off690280 00000040:00080000:1.0:1787826022.710629:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].321, 2352 off532816 00000004:00080000:1.0:1787826022.710641:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4728cfe40 with version 637 00000004:00080000:0.0:1787826022.711209:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 637 rpc_version 637 00000020:00100000:0.0:1787826022.714188:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826022.714220:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66ce00 x1874663049169024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826022.714261:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049169024:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826022.715102:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.715192:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826022.717747:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049169024 00000100:00100000:3.0:1787826022.717766:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049169024 00000100:00100000:0.0:1787826022.718236:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12380 00000100:00100000:0.0:1787826022.718250:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049169024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826022.719494:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049169024:12345-0@lo:1000:osp_up1-0.0 Request processed in 1241us (4387us total) trans 17179869819 rc 0/0 00000100:00100000:0.0:1787826022.719507:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12380 00000100:00100000:0.0:1787826022.719613:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049169024:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826022.720278:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.720298:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.720313:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.720974:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.720996:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.721005:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.721049:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.721059:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.721069:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.721093:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049169152:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787826022.721154:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826022.721193:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.721367:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049169152 00000100:00100000:0.0:1787826022.721375:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049169152 00000100:00100000:0.0:1787826022.721430:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12381 00000100:00100000:0.0:1787826022.721440:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187904:x1874663049169152:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787826022.721461:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.721479:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cebf7e lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebf77 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.721504:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cebf7e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebf77 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.721517:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cebf7e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebf77 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.721526:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x36:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:0.0:1787826022.721530:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.721534:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569200, rc 0) 00000100:00100000:0.0:1787826022.721577:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187904:x1874663049169152:12345-0@lo:101:mdt00_000.0 Request processed in 139us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.721583:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12381 00000100:00100000:1.0:1787826022.721755:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049169152:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787826022.721775:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.721786:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826022.721812:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c182106 reply state 00000000c1f1f627 transno 335007449192 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722086:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722093:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x36:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:1.0:1787826022.722095:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826022.722100:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826022.722108:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722116:0:187904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826022.722130:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x36:0x0] 00000004:00010000:1.0:1787826022.722140:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c182106 reply state 00000000c1f1f627 transno 335007449192 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722149:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722157:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc2:0x0].0x0 (ffff8eb47f8ff300) 00010000:00010000:1.0:1787826022.722160:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826022.722162:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826022.722168:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc2:0x0]: returning size 4096 00010000:00010000:1.0:1787826022.722178:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722185:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722193:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722213:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.722218:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722228:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722241:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.722244:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.722249:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722257:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cebf5b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826022.722680:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c182106 reply state 00000000c1f1f627 transno 335007449192 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722702:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.722708:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.722711:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826022.722713:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826022.722927:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+103:155698:x1874663042928384:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 16214us (16451us total) trans 335007449192 rc 0/0 00000100:00100000:1.0:1787826022.722937:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 760 00000100:00100000:1.0:1787826022.759723:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.759823:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042928512 00000100:00100000:2.0:1787826022.759842:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042928512 00000100:00100000:2.0:1787826022.759918:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 761 00000100:00100000:2.0:1787826022.759930:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+103:155703:x1874663042928512:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826022.759964:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.760003:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebf85 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee53 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760089:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760107:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760122:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760135:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 49 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760143:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760150:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760258:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebf9a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760267:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebf9a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760275:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebf9a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826022.760425:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc2:0x0]: returning size 4096 00000004:00200000:2.0:1787826022.760432:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826022.760457:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebf9a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760470:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760478:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760484:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760490:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826022.760496:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760504:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760519:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826022.760523:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.760529:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760534:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebf8c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760549:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760561:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760566:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760572:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826022.760574:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760581:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760589:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:2.0:1787826022.760592:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826022.760595:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760602:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cebf93 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760631:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebf85 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee53 expref: 105 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760657:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebf9a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee53 expref: 104 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.760666:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc2:0x0].0x0 (ffff8eb47f8ff300) 00010000:00010000:2.0:1787826022.760668:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826022.760672:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511e00, rc 0) 00000100:00100000:2.0:1787826022.760748:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+104:155703:x1874663042928512:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 819us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.760757:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 761 00000100:00100000:1.0:1787826022.767294:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.767430:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042928640 00000100:00100000:3.0:1787826022.767443:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042928640 00000100:00100000:3.0:1787826022.767512:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 762 00000100:00100000:3.0:1787826022.767522:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+104:155703:x1874663042928640:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826022.767547:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826022.767573:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfa1 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee5a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.767655:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.767672:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.767685:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826022.767752:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x36:0x0]: returning size 4096 00000004:00200000:3.0:1787826022.767758:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826022.767799:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfa1 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 106 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.768050:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 105 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.768063:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x36:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:3.0:1787826022.768066:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826022.768070:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18000, rc 0) 00000100:00100000:3.0:1787826022.768169:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:155703:x1874663042928640:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 647us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.768180:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 762 00000100:00100000:3.0:1787826022.779257:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.779447:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042928768 00000100:00100000:2.0:1787826022.779460:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042928768 00000100:00100000:2.0:1787826022.779523:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 763 00000100:00100000:2.0:1787826022.779535:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155703:x1874663042928768:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826022.779560:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.779584:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cebfaf lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee61 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.779669:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.779687:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cebf7e lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebf77 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.779697:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.779741:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cebf7e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cebf77 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.779761:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049169280:0@lo:104: 00000100:00100000:2.0:1787826022.779837:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.779884:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3494800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.780016:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049169280 00000100:00100000:0.0:1787826022.780022:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049169280 00000100:00100000:0.0:1787826022.780064:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4741 00000100:00100000:0.0:1787826022.780072:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049169280:12345-0@lo:104: 00010000:00010000:0.0:1787826022.780087:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.780153:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826022.780159:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049169280:12345-0@lo:104: Request processed in 89us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.780167:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4741 00010000:00010000:0.0:1787826022.780194:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826022.780201:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.780210:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826022.780217:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.780227:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.780255:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.780268:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826022.780290:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.780298:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441357000/0x878a5eea00cebf77 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cebf7e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.780320:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826022.780341:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826022.780344:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826022.780351:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826022.780363:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049169408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826022.780392:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.780421:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049169408 00000100:00100000:0.0:1787826022.780425:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049169408 00010000:00010000:0.0:1787826022.780442:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cebf7e lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cebf77 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.780462:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12180 00000100:00100000:0.0:1787826022.780467:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3619:x1874663049169408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826022.780476:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826022.781882:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049169280:0@lo:104: 00010000:00010000:2.0:1787826022.781914:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826022.787773:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869819 is committed 00010000:00010000:2.0:1787826022.797101:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cebf7e lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cebf77 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.797130:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x36:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:2.0:1787826022.797136:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.797146:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.797154:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.797620:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826022.797932:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049169408:12345-0@lo:103:ldlm_bl.0 Request processed in 17458us (17533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.797946:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12180 00010000:00010000:2.0:1787826022.798121:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.798132:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826022.798223:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x36:0x0]: returning size 4096 00000004:00200000:2.0:1787826022.798231:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826022.798304:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cebfaf lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.798381:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.798390:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x36:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:2.0:1787826022.798393:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826022.798398:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00000100:00100000:2.0:1787826022.798468:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155703:x1874663042928768:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 18935us (19227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.798477:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 763 00000100:00100000:0.0:1787826022.800123:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049169408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826022.806736:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.807119:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042929024 00000100:00100000:2.0:1787826022.807132:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042929024 00000100:00100000:2.0:1787826022.807224:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 764 00000100:00100000:2.0:1787826022.807244:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:155703:x1874663042929024:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:2.0:1787826022.807360:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826022.807416:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cebf9a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee53 expref: 105 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807444:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc2:0x0].0x0 (ffff8eb47f8ff300) 00010000:00010000:2.0:1787826022.807450:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826022.807477:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807493:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807505:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807517:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 49 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807543:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807552:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807710:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807719:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807726:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807760:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807770:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 104 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807788:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.807997:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 104 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.808022:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 104 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.808039:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049169536:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826022.808173:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3494800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.812152:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.812252:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042929152 00000100:00100000:3.0:1787826022.812265:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042929152 00000100:00100000:2.0:1787826022.815028:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049169536:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826022.815070:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.815288:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 105 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.815366:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12181 00000100:00100000:3.0:1787826022.815388:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:2392:x1874663042929152:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826022.815407:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826022.815415:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 105 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.815429:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 105 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.815456:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfa8 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x36:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee5a expref: 105 pid: 188682 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.815473:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x36:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:3.0:1787826022.815478:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.815494:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.815503:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.815537:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826022.815629:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+104:2392:x1874663042929152:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 243us (3499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.815639:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12181 00010000:00010000:2.0:1787826022.815994:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.816003:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.816077:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.816085:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.816096:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.816126:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049169664:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787826022.816211:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.816260:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3494800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.816406:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049169664 00000100:00100000:1.0:1787826022.816416:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049169664 00000100:00100000:1.0:1787826022.816476:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12382 00000100:00100000:1.0:1787826022.816486:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049169664:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787826022.816506:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826022.816525:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cebfd9 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.816560:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.816571:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.816621:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.816636:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 6 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.816662:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049169792:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826022.816741:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.821847:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826022.822135:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049169792:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826022.822206:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.822227:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x36:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:2.0:1787826022.822231:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826022.822237:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.822250:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.822259:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:2.0:1787826022.822427:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049169664:12345-0@lo:101:mdt00_000.0 Request processed in 5942us (6215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.822438:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12382 00000100:00100000:3.0:1787826022.822570:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042929280 00000100:00100000:3.0:1787826022.822580:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042929280 00010000:00010000:3.0:1787826022.822634:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 7 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.822679:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12182 00000100:00100000:3.0:1787826022.822697:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2391:x1874663042929280:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826022.822715:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826022.822727:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 7 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.822740:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 7 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.822771:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cebfb6 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee61 expref: 7 pid: 187906 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.822802:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x36:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:3.0:1787826022.822808:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.822833:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.822843:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.823076:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.823106:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049169920:0@lo:105: 00000100:00100000:3.0:1787826022.823173:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.823229:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.823418:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049169920 00000100:00100000:1.0:1787826022.823424:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049169920 00000100:00100000:1.0:1787826022.823485:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4742 00000100:00100000:1.0:1787826022.823494:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049169920:12345-0@lo:105: 00010000:00010000:1.0:1787826022.823506:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.823518:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.823528:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.823537:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.823546:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.823555:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.823912:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb481715c00) 00000100:00100000:3.0:1787826022.824093:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049169920:0@lo:105: 00010000:00010000:3.0:1787826022.824109:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826022.825443:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869819 gen 2 00000004:00080000:0.0:1787826022.825458:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869818 committed transno 17179869819 00000004:00080000:0.0:1787826022.825501:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869819 committed transno 17179869819 00000100:00100000:0.0:1787826022.825527:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049169664:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787826022.825568:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826022.826375:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049169920:12345-0@lo:105: Request processed in 2870us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.826390:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4742 00000100:00100000:3.0:1787826022.826660:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042929280:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 3967us (4838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.826677:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12182 00000100:00100000:1.0:1787826022.829623:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a425880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049170048:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787826022.829807:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826022.829958:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.830083:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049170048 00000100:00100000:0.0:1787826022.830094:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049170048 00000100:00100000:0.0:1787826022.830220:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12383 00000100:00100000:0.0:1787826022.830231:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049170048:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787826022.842783:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049170048:12345-0@lo:403:mdt00_000.0 Request processed in 12541us (12965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826022.842800:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12383 00000100:00100000:0.0:1787826022.843006:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a425880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049170048:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1787826022.845666:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].451, 944 off691224 00000040:00080000:0.0:1787826022.848453:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].322, 1024 off533840 00000004:00080000:0.0:1787826022.848473:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925ecc0 with version 638 00000004:00080000:2.0:1787826022.848937:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 638 rpc_version 638 00000020:00100000:2.0:1787826022.849023:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826022.849037:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a429f80 x1874663049170304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826022.849066:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049170304:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826022.849160:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826022.849216:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3494800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826022.849956:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049170304 00000100:00100000:0.0:1787826022.849967:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049170304 00000100:00100000:0.0:1787826022.850195:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12384 00000100:00100000:0.0:1787826022.850213:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049170304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826022.852711:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049170304:12345-0@lo:1000:osp_up1-0.0 Request processed in 2477us (3527us total) trans 17179869820 rc 0/0 00000100:00100000:0.0:1787826022.852728:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12384 00000100:00100000:2.0:1787826022.858166:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049170304:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787826022.859109:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc2:0x0]: returning size 4096 00010000:00010000:0.0:1787826022.859147:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859161:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859170:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859181:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.859188:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859197:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859218:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x36:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:0.0:1787826022.859222:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826022.859226:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859233:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cebfd2 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859248:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859256:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859617:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859653:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826022.859666:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x36:0x0] 00010000:00010000:0.0:1787826022.859676:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859683:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859691:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859708:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.859711:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859718:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859728:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc2:0x0].0x0 (ffff8eb47f8ff300) 00010000:00010000:0.0:1787826022.859730:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826022.859735:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859741:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cebfcb lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859760:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859766:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859772:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859778:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826022.859781:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859791:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859799:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826022.859801:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.859804:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859809:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cebfbd lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826022.859829:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a739956 reply state 00000000e24f63f1 transno 335007449193 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859844:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.859853:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:0.0:1787826022.859855:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826022.859859:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826022.859926:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826022.859933:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.859941:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826022.859946:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826022.859952:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.859987:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826022.859995:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:155703:x1874663042929024:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 52738us (53258us total) trans 335007449193 rc 0/0 00010000:00010000:3.0:1787826022.859995:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787826022.860009:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 764 00010000:00010000:3.0:1787826022.860026:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.860036:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cebfd9 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cebfe0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.860066:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826022.860069:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826022.860071:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826022.860199:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826022.860220:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049170432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826022.860292:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.860319:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049170432 00000100:00100000:3.0:1787826022.860351:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049170432 00000100:00100000:3.0:1787826022.860422:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4194 00000100:00100000:3.0:1787826022.860434:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049170432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826022.860449:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826022.860471:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00cebfe0 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cebfd9 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.860486:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x36:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:3.0:1787826022.860510:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826022.860558:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049170432:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826022.860566:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4194 00000100:00100000:1.0:1787826022.861471:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049170432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826022.899663:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.899718:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042929408 00000100:00100000:3.0:1787826022.899732:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042929408 00000100:00100000:3.0:1787826022.899801:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 765 00000100:00100000:3.0:1787826022.899823:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:155710:x1874663042929408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826022.899857:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826022.899884:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfe7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee68 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.899969:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.899997:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900010:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900023:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 50 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900033:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900040:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900093:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900102:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900109:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900116:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.900122:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900130:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900144:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.900148:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.900153:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900160:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cebfee lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900174:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900180:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900186:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900192:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.900195:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900202:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900208:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826022.900211:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.900214:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900219:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cebff5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900249:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfe7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee68 expref: 106 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900260:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.900262:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.900481:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cebfe7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee68 expref: 106 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.900493:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18000, rc 0) 00000100:00100000:3.0:1787826022.900568:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:155710:x1874663042929408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 756us (928us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826022.900576:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 765 00000100:00100000:0.0:1787826022.924628:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826022.924809:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042929536 00000100:00100000:1.0:1787826022.924822:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042929536 00000100:00100000:1.0:1787826022.924922:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 766 00000100:00100000:1.0:1787826022.924936:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:155710:x1874663042929536:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826022.924969:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826022.925012:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebffc lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee6f expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925114:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925136:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925148:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925166:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 50 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925175:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925181:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925253:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925260:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925268:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925280:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.925285:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925297:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925316:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.925319:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.925355:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925377:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356400/0x878a5eea00cec003 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925392:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925404:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925410:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925416:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.925419:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925425:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925437:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.925440:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.925443:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925450:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec00a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925489:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebffc lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee6f expref: 106 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925500:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826022.925503:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.925506:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cebffc lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee6f expref: 106 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.925524:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:1.0:1787826022.925614:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:155710:x1874663042929536:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 679us (999us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826022.925628:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 766 00000100:00100000:1.0:1787826022.937878:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.949418:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042929664 00000100:00100000:3.0:1787826022.949436:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042929664 00000100:00100000:2.0:1787826022.949750:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 767 00000100:00100000:2.0:1787826022.949762:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+105:155710:x1874663042929664:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826022.949790:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826022.949829:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee76 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.949915:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec018 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.949932:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec018 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.949946:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec018 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826022.950111:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826022.950116:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826022.950140:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec018 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.950171:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee76 expref: 107 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.950191:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec018 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee76 expref: 106 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.950202:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826022.950206:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826022.950210:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715c00, rc 0) 00000100:00100000:2.0:1787826022.950299:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+106:155710:x1874663042929664:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 538us (12497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826022.950307:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 767 00000100:00100000:1.0:1787826022.964252:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826022.964448:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042929920 00000100:00100000:3.0:1787826022.964462:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042929920 00000100:00100000:3.0:1787826022.965455:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 768 00000100:00100000:3.0:1787826022.965476:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+106:155710:x1874663042929920:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:3.0:1787826022.965551:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826022.965587:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec018 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee76 expref: 106 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.965609:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.965615:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826022.965702:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.965720:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.965732:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.965745:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 50 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.965763:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.965770:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826022.968546:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].452, 2152 off693376 00000040:00080000:1.0:1787826022.968676:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].323, 2352 off536192 00000004:00080000:1.0:1787826022.968683:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb443e5be40 with version 639 00000004:00080000:1.0:1787826022.968707:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 639 rpc_version 639 00000020:00100000:1.0:1787826022.968754:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826022.968768:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb348ffea00 x1874663049170688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826022.968798:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049170688:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826022.970228:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826022.970277:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826022.970312:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049170688 00000100:00100000:1.0:1787826022.970320:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049170688 00000100:00100000:1.0:1787826022.971014:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12385 00000100:00100000:1.0:1787826022.971026:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049170688:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826022.971673:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049170688:12345-0@lo:1000:osp_up1-0.0 Request processed in 647us (1449us total) trans 17179869821 rc 0/0 00000100:00100000:1.0:1787826022.971685:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12385 00000100:00100000:3.0:1787826022.972791:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049170688:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787826022.973286:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.973307:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.973321:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.973386:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.973398:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.973404:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.973447:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.973455:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826022.973465:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.973488:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049170816:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787826022.973559:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826022.974632:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049170816 00000100:00100000:0.0:1787826022.974651:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049170816 00000100:00100000:0.0:1787826022.974714:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12386 00000100:00100000:0.0:1787826022.974725:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049170816:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826022.974750:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826022.974774:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cec042 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec03b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.974805:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cec042 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec03b expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.975048:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cec042 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec03b expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826022.975059:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x37:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:0.0:1787826022.975062:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826022.975066:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569a00, rc 0) 00000100:00100000:0.0:1787826022.975123:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049170816:12345-0@lo:101:mdt00_003.0 Request processed in 400us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826022.975131:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12386 00000001:00080000:3.0:1787826022.975617:0:187875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449194 is committed 00000020:00080000:3.0:1787826022.975639:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4728cf3c0 refcount 2 committed 0 result 0 batchid 330712484042 00000020:00080000:3.0:1787826022.975652:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47f9ec400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4728cfe40 00000020:00080000:3.0:1787826022.975657:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].321 00000020:00080000:3.0:1787826022.975660:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47f9ec100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb472799200 00000020:00080000:3.0:1787826022.975663:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].450 00000020:00080000:3.0:1787826022.975675:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34896b840 refcount 2 committed 0 result 0 batchid 330712484041 00000020:00080000:3.0:1787826022.975678:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477426600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34896b9c0 00000020:00080000:3.0:1787826022.975681:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].320 00000020:00080000:3.0:1787826022.975683:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477426900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b76000 00000020:00080000:3.0:1787826022.975686:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].448 00000020:00080000:3.0:1787826022.975693:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4811fba80 refcount 2 committed 0 result 0 batchid 330712484040 00000020:00080000:3.0:1787826022.975695:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45cb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4811fb3c0 00000020:00080000:3.0:1787826022.975699:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].319 00000020:00080000:3.0:1787826022.975701:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb476d78800 00000020:00080000:3.0:1787826022.975703:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].447 00000020:00080000:3.0:1787826022.975710:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4811fb0c0 refcount 2 committed 0 result 0 batchid 330712484039 00000020:00080000:3.0:1787826022.975712:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45c600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4811fb600 00000020:00080000:3.0:1787826022.975715:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].318 00000020:00080000:3.0:1787826022.975717:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb479aeba00 00000020:00080000:3.0:1787826022.975720:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].446 00000020:00080000:3.0:1787826022.975727:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4811fbc00 refcount 2 committed 0 result 0 batchid 330712484038 00000020:00080000:3.0:1787826022.975729:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45c500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4811fb600 00000020:00080000:3.0:1787826022.975732:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].317 00000020:00080000:3.0:1787826022.975735:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b77e00 00000020:00080000:3.0:1787826022.975738:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].445 00000020:00080000:3.0:1787826022.975746:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb349480cc0 refcount 2 committed 0 result 0 batchid 330712484037 00000020:00080000:3.0:1787826022.975749:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349480d80 00000020:00080000:3.0:1787826022.975752:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].315 00000020:00080000:3.0:1787826022.975754:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb480d30200 00000020:00080000:3.0:1787826022.975757:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].444 00000020:00080000:3.0:1787826022.975763:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4817689c0 refcount 2 committed 0 result 0 batchid 330712484036 00000020:00080000:3.0:1787826022.975766:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47f9ec800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb481768480 00000020:00080000:3.0:1787826022.975769:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].314 00000020:00080000:3.0:1787826022.975771:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb348823e00 00000020:00080000:3.0:1787826022.975774:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].443 00000020:00080000:3.0:1787826022.975780:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb481768b40 refcount 2 committed 0 result 0 batchid 330712484035 00000020:00080000:3.0:1787826022.975785:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb480d37000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb481768000 00000020:00080000:3.0:1787826022.975788:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].313 00000020:00080000:3.0:1787826022.975790:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb480d37a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb348823600 00000020:00080000:3.0:1787826022.975793:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].442 00000020:00080000:3.0:1787826022.975798:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4811fbb40 refcount 2 committed 0 result 0 batchid 330712484034 00000020:00080000:3.0:1787826022.975801:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a243f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4811fb900 00000020:00080000:3.0:1787826022.975804:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].312 00000020:00080000:3.0:1787826022.975806:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a243000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b76e00 00000020:00080000:3.0:1787826022.975808:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].441 00000020:00080000:3.0:1787826022.975813:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb349480480 refcount 2 committed 0 result 0 batchid 330712484033 00000020:00080000:3.0:1787826022.975828:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349480000 00000020:00080000:3.0:1787826022.975831:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].311 00000020:00080000:3.0:1787826022.975833:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb480d30600 00000020:00080000:3.0:1787826022.975836:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].440 00000020:00080000:3.0:1787826022.975843:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34896b600 refcount 2 committed 0 result 0 batchid 330712484032 00000020:00080000:3.0:1787826022.975845:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477426800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34896bd80 00000020:00080000:3.0:1787826022.975848:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].310 00000020:00080000:3.0:1787826022.975850:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477426b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4730b8c00 00000020:00080000:3.0:1787826022.975852:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].439 00000020:00080000:3.0:1787826022.975857:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4811fbcc0 refcount 2 committed 0 result 0 batchid 330712484031 00000020:00080000:3.0:1787826022.975860:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47750e400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4811fb480 00000020:00080000:3.0:1787826022.975863:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].309 00000020:00080000:3.0:1787826022.975865:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47750ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47999fe00 00000020:00080000:3.0:1787826022.975868:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].438 00000020:00080000:3.0:1787826022.975874:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb3436b2240 refcount 2 committed 0 result 0 batchid 330712484030 00000020:00080000:3.0:1787826022.975877:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436b26c0 00000020:00080000:3.0:1787826022.975880:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].308 00000020:00080000:3.0:1787826022.975883:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb480d30800 00000020:00080000:3.0:1787826022.975885:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].437 00000020:00080000:3.0:1787826022.975891:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925e540 refcount 2 committed 0 result 0 batchid 330712484029 00000020:00080000:3.0:1787826022.975894:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb34a0c1400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34925e600 00000020:00080000:3.0:1787826022.975897:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].307 00000020:00080000:3.0:1787826022.975899:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb34a0c1600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34a497000 00000020:00080000:3.0:1787826022.975902:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].436 00000020:00080000:3.0:1787826022.975908:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4811fb300 refcount 2 committed 0 result 0 batchid 330712484028 00000020:00080000:3.0:1787826022.975910:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47750e000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4811fbb40 00000020:00080000:3.0:1787826022.975913:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].306 00000020:00080000:3.0:1787826022.975915:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47750ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34bac4000 00000020:00080000:3.0:1787826022.975918:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].435 00000020:00080000:3.0:1787826022.975925:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4812c1900 refcount 2 committed 0 result 0 batchid 330712484027 00000020:00080000:3.0:1787826022.975927:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4812c1240 00000020:00080000:3.0:1787826022.975930:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].305 00000020:00080000:3.0:1787826022.975932:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb3494a2900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b77400 00000020:00080000:3.0:1787826022.975935:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].434 00000020:00080000:3.0:1787826022.975939:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb349172300 refcount 2 committed 0 result 0 batchid 330712484026 00000020:00080000:3.0:1787826022.975942:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349172180 00000020:00080000:3.0:1787826022.975946:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].304 00000020:00080000:3.0:1787826022.975948:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b76a00 00000020:00080000:3.0:1787826022.975951:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].433 00000020:00080000:3.0:1787826022.975955:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb3436a59c0 refcount 2 committed 0 result 0 batchid 330712484025 00000020:00080000:3.0:1787826022.975958:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a3ecc00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436a50c0 00000020:00080000:3.0:1787826022.975960:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].303 00000020:00080000:3.0:1787826022.975962:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a3ec800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4730b8e00 00000020:00080000:3.0:1787826022.975965:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].432 00000020:00080000:3.0:1787826022.975971:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb443e5bb40 refcount 2 committed 0 result 0 batchid 330712484024 00000020:00080000:3.0:1787826022.975974:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a3ecf00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb443e5bcc0 00000020:00080000:3.0:1787826022.975976:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].302 00000020:00080000:3.0:1787826022.975978:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a3ec600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47999f400 00000020:00080000:3.0:1787826022.976107:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].431 00000020:00080000:3.0:1787826022.976115:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb3436b2300 refcount 2 committed 0 result 0 batchid 330712484023 00000020:00080000:3.0:1787826022.976118:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a3ece00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436b2540 00000020:00080000:3.0:1787826022.976121:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].301 00000020:00080000:3.0:1787826022.976123:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a3ec500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47999f600 00000020:00080000:3.0:1787826022.976126:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].430 00000020:00080000:3.0:1787826022.976131:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925e900 refcount 2 committed 0 result 0 batchid 330712484022 00000020:00080000:3.0:1787826022.976133:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47a7b3240 00000020:00080000:3.0:1787826022.976136:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].300 00000020:00080000:3.0:1787826022.976138:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b77800 00000020:00080000:3.0:1787826022.976141:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].429 00000020:00080000:3.0:1787826022.976146:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb443e5bc00 refcount 2 committed 0 result 0 batchid 330712484021 00000020:00080000:3.0:1787826022.976148:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb443e5be40 00000020:00080000:3.0:1787826022.976151:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].299 00000020:00080000:3.0:1787826022.976153:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b76600 00000020:00080000:3.0:1787826022.976156:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].428 00000020:00080000:3.0:1787826022.976162:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34896b180 refcount 2 committed 0 result 0 batchid 330712484020 00000020:00080000:3.0:1787826022.976165:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb481fca800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34896bb40 00000020:00080000:3.0:1787826022.976168:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].298 00000020:00080000:3.0:1787826022.976170:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb480cdb400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb476c21e00 00000020:00080000:3.0:1787826022.976173:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].427 00000020:00080000:3.0:1787826022.976179:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34896ba80 refcount 2 committed 0 result 0 batchid 330712484019 00000020:00080000:3.0:1787826022.976181:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34896b840 00000020:00080000:3.0:1787826022.976184:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].297 00000020:00080000:3.0:1787826022.976186:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb341ae6600 00000020:00080000:3.0:1787826022.976189:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].425 00000020:00080000:3.0:1787826022.976195:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34896b300 refcount 2 committed 0 result 0 batchid 330712484018 00000020:00080000:3.0:1787826022.976198:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34896bd80 00000020:00080000:3.0:1787826022.976202:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].296 00000020:00080000:3.0:1787826022.976204:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb341ae7000 00000020:00080000:3.0:1787826022.976207:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].424 00000020:00080000:3.0:1787826022.976215:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34896b6c0 refcount 2 committed 0 result 0 batchid 330712484017 00000020:00080000:3.0:1787826022.976218:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34896bb40 00000020:00080000:3.0:1787826022.976221:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].294 00000020:00080000:3.0:1787826022.976223:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb341ae7a00 00000020:00080000:3.0:1787826022.976226:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].423 00000020:00080000:3.0:1787826022.976231:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb479b53240 refcount 2 committed 0 result 0 batchid 330712484016 00000020:00080000:3.0:1787826022.976233:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a3ec300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34be53900 00000020:00080000:3.0:1787826022.976236:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].293 00000020:00080000:3.0:1787826022.976238:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a3ec400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb46e2b6a00 00000020:00080000:3.0:1787826022.976240:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].422 00000020:00080000:3.0:1787826022.976250:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34be53780 refcount 2 committed 0 result 0 batchid 330712484015 00000020:00080000:3.0:1787826022.976252:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a4bdf00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34be53a80 00000020:00080000:3.0:1787826022.976256:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].292 00000020:00080000:3.0:1787826022.976258:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479bf0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb46e2b6800 00000020:00080000:3.0:1787826022.976260:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].421 00000020:00080000:3.0:1787826022.976266:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925ef00 refcount 2 committed 0 result 0 batchid 330712484014 00000020:00080000:3.0:1787826022.976269:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34be53a80 00000020:00080000:3.0:1787826022.976271:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].291 00000020:00080000:3.0:1787826022.976274:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb341ae7800 00000020:00080000:3.0:1787826022.976276:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].420 00000020:00080000:3.0:1787826022.976282:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb3436b2600 refcount 2 committed 0 result 0 batchid 330712484013 00000020:00080000:3.0:1787826022.976285:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb446099500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436b2e40 00000020:00080000:3.0:1787826022.976288:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].290 00000020:00080000:3.0:1787826022.976290:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47999ea00 00000020:00080000:3.0:1787826022.976293:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].419 00000020:00080000:3.0:1787826022.976297:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb3436b2000 refcount 2 committed 0 result 0 batchid 330712484012 00000020:00080000:3.0:1787826022.976299:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436b2e40 00000020:00080000:3.0:1787826022.976302:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].289 00000020:00080000:3.0:1787826022.976304:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb479bdb800 00000020:00080000:3.0:1787826022.976306:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].418 00000020:00080000:3.0:1787826022.976312:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34953ca80 refcount 2 committed 0 result 0 batchid 330712484011 00000020:00080000:3.0:1787826022.976314:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34953c840 00000020:00080000:3.0:1787826022.976317:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].288 00000020:00080000:3.0:1787826022.976319:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b77200 00000020:00080000:3.0:1787826022.976415:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].417 00000020:00080000:3.0:1787826022.976423:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925e9c0 refcount 2 committed 0 result 0 batchid 330712484010 00000020:00080000:3.0:1787826022.976426:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34925e480 00000020:00080000:3.0:1787826022.976428:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].287 00000020:00080000:3.0:1787826022.976430:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34bbb7600 00000020:00080000:3.0:1787826022.976433:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].416 00000020:00080000:3.0:1787826022.976439:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb46e38a180 refcount 2 committed 0 result 0 batchid 330712484009 00000020:00080000:3.0:1787826022.976442:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb3494a2a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb46e38a240 00000020:00080000:3.0:1787826022.976445:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].286 00000020:00080000:3.0:1787826022.976447:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb3494a2000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34bac5e00 00000020:00080000:3.0:1787826022.976449:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].415 00000020:00080000:3.0:1787826022.976455:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb441374cc0 refcount 2 committed 0 result 0 batchid 330712484008 00000020:00080000:3.0:1787826022.976458:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb441374000 00000020:00080000:3.0:1787826022.976461:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].285 00000020:00080000:3.0:1787826022.976463:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b76200 00000020:00080000:3.0:1787826022.976465:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].414 00000020:00080000:3.0:1787826022.976469:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb3436b2780 refcount 2 committed 0 result 0 batchid 330712484007 00000020:00080000:3.0:1787826022.976472:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436b2540 00000020:00080000:3.0:1787826022.976475:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].284 00000020:00080000:3.0:1787826022.976477:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47999fc00 00000020:00080000:3.0:1787826022.976479:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].413 00000020:00080000:3.0:1787826022.976484:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4413743c0 refcount 2 committed 0 result 0 batchid 330712484006 00000020:00080000:3.0:1787826022.976487:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45eb39900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb441374000 00000020:00080000:3.0:1787826022.976489:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].283 00000020:00080000:3.0:1787826022.976491:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb34a1a7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b77a00 00000020:00080000:3.0:1787826022.976494:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].412 00000020:00080000:3.0:1787826022.976499:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb3436b2900 refcount 2 committed 0 result 0 batchid 330712484005 00000020:00080000:3.0:1787826022.976502:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436b2780 00000020:00080000:3.0:1787826022.976505:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].282 00000020:00080000:3.0:1787826022.976507:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb45edada00 00000020:00080000:3.0:1787826022.976509:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].411 00000020:00080000:3.0:1787826022.976517:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb3436b2b40 refcount 2 committed 0 result 0 batchid 330712484004 00000020:00080000:3.0:1787826022.976520:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436b2780 00000020:00080000:3.0:1787826022.976522:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].281 00000020:00080000:3.0:1787826022.976524:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb479bdb000 00000020:00080000:3.0:1787826022.976527:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].410 00000020:00080000:3.0:1787826022.976532:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb441374c00 refcount 2 committed 0 result 0 batchid 330712484003 00000020:00080000:3.0:1787826022.976535:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb441374240 00000020:00080000:3.0:1787826022.976538:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].280 00000020:00080000:3.0:1787826022.976540:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b76400 00000020:00080000:3.0:1787826022.976543:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].409 00000020:00080000:3.0:1787826022.976548:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34953c240 refcount 2 committed 0 result 0 batchid 330712484002 00000020:00080000:3.0:1787826022.976551:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34953c840 00000020:00080000:3.0:1787826022.976553:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].279 00000020:00080000:3.0:1787826022.976555:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47999ec00 00000020:00080000:3.0:1787826022.976558:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].408 00000020:00080000:3.0:1787826022.976563:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb46e38a480 refcount 2 committed 0 result 0 batchid 330712484001 00000020:00080000:3.0:1787826022.976566:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb3494a2c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb46e38a3c0 00000020:00080000:3.0:1787826022.976568:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].278 00000020:00080000:3.0:1787826022.976571:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb3494a2200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34bac5800 00000020:00080000:3.0:1787826022.976574:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].407 00000020:00080000:3.0:1787826022.976578:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb46e38a840 refcount 2 committed 0 result 0 batchid 330712484000 00000020:00080000:3.0:1787826022.976581:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb3494a2700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb46e38a9c0 00000020:00080000:3.0:1787826022.976583:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].277 00000020:00080000:3.0:1787826022.976585:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb3494a2100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34bac5600 00000020:00080000:3.0:1787826022.976588:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].406 00000020:00080000:3.0:1787826022.976594:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925ee40 refcount 2 committed 0 result 0 batchid 330712483999 00000020:00080000:3.0:1787826022.976597:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb480cdb800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34925ecc0 00000020:00080000:3.0:1787826022.976600:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].276 00000020:00080000:3.0:1787826022.976603:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb480cdbd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34bbb7800 00000020:00080000:3.0:1787826022.976606:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].405 00000020:00080000:3.0:1787826022.976611:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34be53840 refcount 2 committed 0 result 0 batchid 330712483998 00000020:00080000:3.0:1787826022.976613:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34be53780 00000020:00080000:3.0:1787826022.976616:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].275 00000020:00080000:3.0:1787826022.976618:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a7d8f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47a4d1800 00000020:00080000:3.0:1787826022.976620:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].404 00000020:00080000:3.0:1787826022.976626:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb441374300 refcount 2 committed 0 result 0 batchid 330712483997 00000020:00080000:3.0:1787826022.976629:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb441374f00 00000020:00080000:3.0:1787826022.976631:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].273 00000020:00080000:3.0:1787826022.976634:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349b77600 00000020:00080000:3.0:1787826022.976637:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].402 00000020:00080000:3.0:1787826022.976652:0:187875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 330712483995 batchid updated 00000020:00080000:3.0:1787826022.976678:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34c642900 refcount 2 committed 0 result 0 batchid 330712483996 00000020:00080000:3.0:1787826022.976681:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb443e5bc00 00000020:00080000:3.0:1787826022.976684:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].272 00000020:00080000:3.0:1787826022.976686:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb481133400 00000020:00080000:3.0:1787826022.976689:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].401 00000020:00080000:3.0:1787826022.976692:0:187875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 330712483994 batchid updated 00010000:00010000:1.0:1787826022.977943:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00ceadc6 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.977960:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00ceadc6 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.977970:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00ceadc6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.977978:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.977994:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00ceadc6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978003:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00ceadc6 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978024:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.978028:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.978033:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00ceadc6 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978040:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00ceadc6 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 50 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978057:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00ceadcd lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978064:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00ceadcd lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978070:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00ceadcd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978076:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.978078:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00ceadcd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978084:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00ceadcd lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978091:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bab:0x0].0x0 (ffff8eb45edbd400) 00010000:00010000:1.0:1787826022.978093:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.978096:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00ceadcd lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978101:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00ceadcd lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978120:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00ceadd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978127:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00ceadd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978132:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00ceadd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978138:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.978141:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00ceadd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978148:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00ceadd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978155:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x1f:0x0].0x0 (ffff8eb45edbde00) 00010000:00010000:1.0:1787826022.978157:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.978160:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00ceadd4 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978166:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00ceadd4 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978205:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceae28 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978212:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceae28 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978218:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceae28 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978224:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.978228:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceae28 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978234:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceae28 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978247:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.978250:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.978253:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceae28 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978259:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceae28 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 49 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978271:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceae8a lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978277:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceae8a lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978283:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceae8a lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978289:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.978292:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceae8a lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978298:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceae8a lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978305:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.978307:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.978310:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceae8a lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.978316:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceae8a lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 48 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.978938:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3494800c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787826022.979069:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462aa00/0x878a5eea00ceae91 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979078:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462aa00/0x878a5eea00ceae91 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979084:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462aa00/0x878a5eea00ceae91 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979090:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462aa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.979094:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462aa00/0x878a5eea00ceae91 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979101:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462aa00/0x878a5eea00ceae91 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979112:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bac:0x0].0x0 (ffff8eb476e51100) 00010000:00010000:1.0:1787826022.979115:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.979118:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462aa00/0x878a5eea00ceae91 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979125:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462aa00/0x878a5eea00ceae91 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979138:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ae00/0x878a5eea00ceae98 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979145:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ae00/0x878a5eea00ceae98 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979151:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ae00/0x878a5eea00ceae98 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979157:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462ae00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.979159:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ae00/0x878a5eea00ceae98 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979166:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ae00/0x878a5eea00ceae98 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979172:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x20:0x0].0x0 (ffff8eb476e51b00) 00010000:00010000:1.0:1787826022.979175:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.979178:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ae00/0x878a5eea00ceae98 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979183:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462ae00/0x878a5eea00ceae98 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979202:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00ceaeec lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979208:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00ceaeec lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979214:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00ceaeec lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979220:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.979223:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00ceaeec lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979228:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00ceaeec lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979240:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.979242:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.979245:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00ceaeec lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979251:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00ceaeec lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979262:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b600/0x878a5eea00ceaf4e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979268:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b600/0x878a5eea00ceaf4e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979274:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b600/0x878a5eea00ceaf4e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979279:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462b600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.979281:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b600/0x878a5eea00ceaf4e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979287:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b600/0x878a5eea00ceaf4e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979294:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.979297:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.979299:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b600/0x878a5eea00ceaf4e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979305:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b600/0x878a5eea00ceaf4e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979315:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a800/0x878a5eea00ceaf55 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979321:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a800/0x878a5eea00ceaf55 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.979420:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049170816:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826022.979447:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979459:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826022.979491:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428083b5 reply state 000000008f4e4fc5 transno 335007449194 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979505:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979511:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x37:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:3.0:1787826022.979513:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826022.979517:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826022.979522:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979529:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826022.979541:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x37:0x0] 00000004:00010000:3.0:1787826022.979549:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428083b5 reply state 000000008f4e4fc5 transno 335007449194 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979558:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979563:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc3:0x0].0x0 (ffff8eb449aac700) 00010000:00010000:3.0:1787826022.979565:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826022.979568:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826022.979574:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc3:0x0]: returning size 4096 00010000:00010000:3.0:1787826022.979585:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979591:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979597:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979603:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.979606:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979613:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979622:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826022.979624:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.979627:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979633:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec01f lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826022.979657:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428083b5 reply state 000000008f4e4fc5 transno 335007449194 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979666:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.979672:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826022.979675:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826022.979677:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00080000:3.0:1787826022.979793:0:188682:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1787826022.979905:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a800/0x878a5eea00ceaf55 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979911:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.979914:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a800/0x878a5eea00ceaf55 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979920:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a800/0x878a5eea00ceaf55 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979929:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bad:0x0].0x0 (ffff8eb476e51900) 00010000:00010000:1.0:1787826022.979931:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.979934:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a800/0x878a5eea00ceaf55 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979939:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a800/0x878a5eea00ceaf55 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979954:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b000/0x878a5eea00ceaf5c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979960:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b000/0x878a5eea00ceaf5c lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979966:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b000/0x878a5eea00ceaf5c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.979971:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462b000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.979973:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b000/0x878a5eea00ceaf5c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980048:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b000/0x878a5eea00ceaf5c lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980059:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x21:0x0].0x0 (ffff8eb476e51d00) 00010000:00010000:1.0:1787826022.980061:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.980064:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b000/0x878a5eea00ceaf5c lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980070:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b000/0x878a5eea00ceaf5c lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980092:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a600/0x878a5eea00ceafb0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980100:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a600/0x878a5eea00ceafb0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980106:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a600/0x878a5eea00ceafb0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980112:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.980115:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a600/0x878a5eea00ceafb0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980122:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a600/0x878a5eea00ceafb0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980134:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.980137:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.980139:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a600/0x878a5eea00ceafb0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980145:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a600/0x878a5eea00ceafb0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980159:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00ceb012 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980165:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00ceb012 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980171:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00ceb012 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980177:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.980180:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00ceb012 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980185:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00ceb012 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980192:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.980195:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.980197:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00ceb012 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980202:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00ceb012 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980212:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceb019 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980218:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceb019 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980223:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceb019 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980228:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.980231:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceb019 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980237:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceb019 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980244:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bae:0x0].0x0 (ffff8eb344814e00) 00010000:00010000:1.0:1787826022.980246:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.980249:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceb019 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980255:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceb019 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980268:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceb020 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980275:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceb020 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980281:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceb020 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980287:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.980290:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceb020 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980296:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceb020 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980304:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x22:0x0].0x0 (ffff8eb344814300) 00010000:00010000:1.0:1787826022.980306:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.980309:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceb020 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.980315:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceb020 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826022.980785:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+52:155710:x1874663042929920:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 14346us (15577us total) trans 335007449194 rc 0/0 00000100:00100000:3.0:1787826022.980801:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 768 00010000:00010000:1.0:1787826022.981701:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981714:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981721:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981727:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462b400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.981732:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981739:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981760:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.981763:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.981767:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981774:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b400/0x878a5eea00ceb074 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981787:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981792:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981799:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981804:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.981807:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981812:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981828:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.981831:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.981833:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981850:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00ceb0d6 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981861:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981868:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981875:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981880:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462b800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.981883:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981889:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981896:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1baf:0x0].0x0 (ffff8eb476e51500) 00010000:00010000:1.0:1787826022.981898:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.981901:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981907:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b800/0x878a5eea00ceb0dd lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1baf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981922:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981929:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981935:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981940:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.981943:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981948:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981955:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x23:0x0].0x0 (ffff8eb476e51f00) 00010000:00010000:1.0:1787826022.981957:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.981960:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.981966:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a000/0x878a5eea00ceb0e4 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983047:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983064:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983072:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983077:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983081:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983088:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983106:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.983109:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983113:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983119:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ceb138 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983156:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983163:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983169:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983174:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983177:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983182:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983188:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.983191:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983193:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983198:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00ceb19a lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983209:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983215:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983221:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983226:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983229:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983234:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983240:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb0:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:1.0:1787826022.983242:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983245:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983250:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3400/0x878a5eea00ceb1a1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983265:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983271:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983276:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983281:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983284:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983289:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983296:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x24:0x0].0x0 (ffff8eb47f8ff700) 00010000:00010000:1.0:1787826022.983299:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983301:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983306:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3e00/0x878a5eea00ceb1a8 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983401:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceb1fc lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983411:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceb1fc lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983417:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceb1fc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983422:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983425:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceb1fc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983432:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceb1fc lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983446:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.983449:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983451:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceb1fc lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983457:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceb1fc lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983471:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983478:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983484:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983489:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983492:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983498:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983506:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.983509:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983511:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983517:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceb25e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983527:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983533:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983539:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983545:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983548:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983555:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983563:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb1:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:1.0:1787826022.983565:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983569:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983575:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ceb265 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983589:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983595:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983600:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983605:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983608:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983614:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983622:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x25:0x0].0x0 (ffff8eb449543100) 00010000:00010000:1.0:1787826022.983624:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983628:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983633:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ceb26c lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983661:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983668:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983674:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983678:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983681:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983687:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983699:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.983701:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983704:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983710:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00ceb2c0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983724:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983730:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983736:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983741:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983743:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983749:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983757:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.983759:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983762:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983767:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00ceb322 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983779:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983784:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983789:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983794:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.983796:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983801:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.983807:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb2:0x0].0x0 (ffff8eb449543700) 00010000:00010000:1.0:1787826022.983809:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.983812:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984153:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984164:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984169:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984175:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.984179:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984185:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984196:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:3.0:1787826022.984199:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.984202:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984208:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec026 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984221:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984228:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984238:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984245:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.984247:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984254:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984263:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc3:0x0].0x0 (ffff8eb449aac700) 00010000:00010000:3.0:1787826022.984265:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.984269:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984275:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec02d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984290:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984296:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984302:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984307:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826022.984310:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984321:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984355:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x37:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:3.0:1787826022.984358:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826022.984361:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826022.984367:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec034 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984496:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceb329 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984513:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984520:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984527:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984533:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.984537:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984543:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984553:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x26:0x0].0x0 (ffff8eb449543300) 00010000:00010000:1.0:1787826022.984556:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.984559:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984566:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceb330 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984585:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984593:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984599:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984604:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.984607:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984613:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984625:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.984627:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.984630:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984637:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00ceb384 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984662:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb3e6 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984670:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb3e6 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984677:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb3e6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984683:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.984686:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb3e6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984693:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb3e6 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984702:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.984704:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.984707:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb3e6 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984714:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceb3e6 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984726:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca400/0x878a5eea00ceb3ed lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984733:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca400/0x878a5eea00ceb3ed lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984738:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca400/0x878a5eea00ceb3ed lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984743:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4429ca400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.984746:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca400/0x878a5eea00ceb3ed lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984752:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca400/0x878a5eea00ceb3ed lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984760:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb3:0x0].0x0 (ffff8eb449543800) 00010000:00010000:1.0:1787826022.984762:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.984766:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca400/0x878a5eea00ceb3ed lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984771:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca400/0x878a5eea00ceb3ed lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984786:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cbe00/0x878a5eea00ceb3f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984793:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cbe00/0x878a5eea00ceb3f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984799:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cbe00/0x878a5eea00ceb3f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.984805:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4429cbe00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.984808:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cbe00/0x878a5eea00ceb3f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985480:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cbe00/0x878a5eea00ceb3f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985499:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x27:0x0].0x0 (ffff8eb449543a00) 00010000:00010000:1.0:1787826022.985502:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.985506:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cbe00/0x878a5eea00ceb3f4 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985513:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cbe00/0x878a5eea00ceb3f4 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985564:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca000/0x878a5eea00ceb448 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985572:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca000/0x878a5eea00ceb448 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985579:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca000/0x878a5eea00ceb448 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985584:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4429ca000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.985588:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca000/0x878a5eea00ceb448 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985594:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca000/0x878a5eea00ceb448 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985608:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.985610:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.985613:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca000/0x878a5eea00ceb448 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985620:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429ca000/0x878a5eea00ceb448 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985635:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985651:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985657:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985663:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.985666:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985671:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985680:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.985682:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.985685:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985691:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00ceb4aa lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985704:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985710:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985715:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985719:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.985722:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985728:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985735:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb4:0x0].0x0 (ffff8eb47f8fec00) 00010000:00010000:1.0:1787826022.985737:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.985740:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985746:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceb4b1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985761:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985767:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985772:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985778:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.985781:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985786:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985793:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x28:0x0].0x0 (ffff8eb47f8fed00) 00010000:00010000:1.0:1787826022.985795:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.985798:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.985803:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3a00/0x878a5eea00ceb4b8 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986596:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986610:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986616:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986622:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.986626:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986633:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986661:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.986665:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.986668:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986673:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00ceb50c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986693:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986700:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986706:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986711:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.986713:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986719:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986726:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.986729:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.986731:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986737:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc400/0x878a5eea00ceb56e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986747:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986753:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986758:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986764:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.986767:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986773:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986781:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb5:0x0].0x0 (ffff8eb449aac100) 00010000:00010000:1.0:1787826022.986783:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.986786:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986792:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceb575 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986810:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986945:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986951:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986957:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.986960:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986967:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.986976:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x29:0x0].0x0 (ffff8eb449aac000) 00010000:00010000:1.0:1787826022.987046:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.987052:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987058:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceb57c lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987078:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987085:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987091:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987096:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcc000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.987099:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987105:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987118:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.987121:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.987123:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987130:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcc000/0x878a5eea00ceb5d0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987144:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987150:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987155:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987161:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.987164:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987169:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987177:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.987180:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.987182:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987189:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00ceb632 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987202:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987209:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987215:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987221:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.987224:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987230:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987238:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb6:0x0].0x0 (ffff8eb472727000) 00010000:00010000:1.0:1787826022.987241:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.987244:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987251:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd800/0x878a5eea00ceb639 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987266:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987273:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987279:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987286:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcd600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.987289:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987295:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987303:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2a:0x0].0x0 (ffff8eb472727600) 00010000:00010000:1.0:1787826022.987305:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.987309:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987315:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcd600/0x878a5eea00ceb640 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987627:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987636:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987654:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987659:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.987662:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987668:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987682:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.987685:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.987688:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987694:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00ceb694 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987708:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987715:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987721:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987726:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.987729:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987734:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987742:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.987745:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.987748:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987754:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00ceb6f6 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987767:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987773:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987778:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987783:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.987786:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987794:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.987802:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb7:0x0].0x0 (ffff8eb47f8fde00) 00010000:00010000:1.0:1787826022.987804:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.987807:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988124:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356600/0x878a5eea00ceb6fd lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988144:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988151:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988156:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988162:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.988165:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988170:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988180:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2b:0x0].0x0 (ffff8eb47f8fd000) 00010000:00010000:1.0:1787826022.988181:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.988184:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988190:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00ceb704 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988206:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988214:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988219:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988224:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcce00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.988227:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988233:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988245:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.988247:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.988250:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988256:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bdcce00/0x878a5eea00ceb758 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988269:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988275:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988281:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988286:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ea00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.988289:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988295:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988304:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.988307:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.988309:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.988314:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceb7ba lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826022.988469:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 330712484042 committed batchid 330712483995 00000004:00080000:2.0:1787826022.988655:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349480240 with version 640 00000020:00080000:2.0:1787826022.988671:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483939 cancel update log [0x240001f58:0x1:0x0].213: rc = 0 00000020:00080000:2.0:1787826022.988724:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483939 cancel update log [0x200026560:0x1:0x0].342: rc = 0 00000004:00080000:2.0:1787826022.988751:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349480900 with version 641 00000020:00080000:2.0:1787826022.988756:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483940 cancel update log [0x240001f58:0x1:0x0].214: rc = 0 00000020:00080000:2.0:1787826022.988776:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483940 cancel update log [0x200026560:0x1:0x0].343: rc = 0 00000004:00080000:2.0:1787826022.988798:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349480d80 with version 642 00000020:00080000:2.0:1787826022.988801:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483941 cancel update log [0x240001f58:0x1:0x0].215: rc = 0 00000020:00080000:2.0:1787826022.988832:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483941 cancel update log [0x200026560:0x1:0x0].344: rc = 0 00000004:00080000:2.0:1787826022.988859:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349480180 with version 643 00000020:00080000:2.0:1787826022.988862:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483942 cancel update log [0x240001f58:0x1:0x0].216: rc = 0 00000020:00080000:2.0:1787826022.988883:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483942 cancel update log [0x200026560:0x1:0x0].345: rc = 0 00000004:00080000:2.0:1787826022.988905:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3494800c0 with version 644 00000020:00080000:2.0:1787826022.988908:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483943 cancel update log [0x240001f58:0x1:0x0].217: rc = 0 00000020:00080000:2.0:1787826022.988927:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483943 cancel update log [0x200026560:0x1:0x0].346: rc = 0 00000004:00080000:2.0:1787826022.988947:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172a80 with version 645 00000020:00080000:2.0:1787826022.988950:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483944 cancel update log [0x240001f58:0x1:0x0].218: rc = 0 00000020:00080000:2.0:1787826022.988970:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483944 cancel update log [0x200026560:0x1:0x0].347: rc = 0 00000004:00080000:2.0:1787826022.989027:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34953cb40 with version 646 00000020:00080000:2.0:1787826022.989030:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483945 cancel update log [0x240001f58:0x1:0x0].219: rc = 0 00000020:00080000:2.0:1787826022.989052:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483945 cancel update log [0x200026560:0x1:0x0].348: rc = 0 00000004:00080000:2.0:1787826022.989073:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172600 with version 647 00000020:00080000:2.0:1787826022.989076:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483946 cancel update log [0x240001f58:0x1:0x0].220: rc = 0 00000020:00080000:2.0:1787826022.989096:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483946 cancel update log [0x200026560:0x1:0x0].349: rc = 0 00000004:00080000:2.0:1787826022.989116:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925ed80 with version 648 00000020:00080000:2.0:1787826022.989119:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483947 cancel update log [0x240001f58:0x1:0x0].221: rc = 0 00000020:00080000:2.0:1787826022.989137:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483947 cancel update log [0x200026560:0x1:0x0].350: rc = 0 00000004:00080000:2.0:1787826022.989159:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925e0c0 with version 649 00000020:00080000:2.0:1787826022.989162:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483948 cancel update log [0x240001f58:0x1:0x0].222: rc = 0 00000020:00080000:2.0:1787826022.989181:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483948 cancel update log [0x200026560:0x1:0x0].351: rc = 0 00000004:00080000:2.0:1787826022.989202:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb441374780 with version 650 00000020:00080000:2.0:1787826022.989205:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483949 cancel update log [0x240001f58:0x1:0x0].223: rc = 0 00000020:00080000:2.0:1787826022.989225:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483949 cancel update log [0x200026560:0x1:0x0].352: rc = 0 00000004:00080000:2.0:1787826022.989247:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3436b26c0 with version 651 00000020:00080000:2.0:1787826022.989250:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483950 cancel update log [0x240001f58:0x1:0x0].224: rc = 0 00000020:00080000:2.0:1787826022.989269:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483950 cancel update log [0x200026560:0x1:0x0].353: rc = 0 00000004:00080000:2.0:1787826022.989300:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fb3c0 with version 652 00000020:00080000:2.0:1787826022.989303:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483951 cancel update log [0x240001f58:0x1:0x0].225: rc = 0 00000020:00080000:2.0:1787826022.989367:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483951 cancel update log [0x200026560:0x1:0x0].354: rc = 0 00000004:00080000:2.0:1787826022.989390:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fb540 with version 653 00000020:00080000:2.0:1787826022.989393:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483952 cancel update log [0x240001f58:0x1:0x0].226: rc = 0 00000020:00080000:2.0:1787826022.989412:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483952 cancel update log [0x200026560:0x1:0x0].355: rc = 0 00000004:00080000:2.0:1787826022.989440:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fbe40 with version 654 00000020:00080000:2.0:1787826022.989442:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483953 cancel update log [0x240001f58:0x1:0x0].227: rc = 0 00000020:00080000:2.0:1787826022.989462:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483953 cancel update log [0x200026560:0x1:0x0].356: rc = 0 00000004:00080000:2.0:1787826022.989481:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4811fb240 with version 655 00000020:00080000:2.0:1787826022.989484:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483954 cancel update log [0x240001f58:0x1:0x0].228: rc = 0 00000020:00080000:2.0:1787826022.989503:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483954 cancel update log [0x200026560:0x1:0x0].358: rc = 0 00000004:00080000:2.0:1787826022.989523:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb477422a80 with version 656 00000020:00080000:2.0:1787826022.989526:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483955 cancel update log [0x240001f58:0x1:0x0].229: rc = 0 00000020:00080000:2.0:1787826022.989546:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483955 cancel update log [0x200026560:0x1:0x0].359: rc = 0 00000004:00080000:2.0:1787826022.989568:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4774226c0 with version 657 00000020:00080000:2.0:1787826022.989571:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483956 cancel update log [0x240001f58:0x1:0x0].230: rc = 0 00000020:00080000:2.0:1787826022.989591:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483956 cancel update log [0x200026560:0x1:0x0].360: rc = 0 00000004:00080000:2.0:1787826022.989610:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb477422f00 with version 658 00000020:00080000:2.0:1787826022.989613:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483957 cancel update log [0x240001f58:0x1:0x0].231: rc = 0 00000020:00080000:2.0:1787826022.989634:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483957 cancel update log [0x200026560:0x1:0x0].361: rc = 0 00000004:00080000:2.0:1787826022.989662:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4774229c0 with version 659 00000020:00080000:2.0:1787826022.989666:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483958 cancel update log [0x240001f58:0x1:0x0].233: rc = 0 00000020:00080000:2.0:1787826022.989684:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483958 cancel update log [0x200026560:0x1:0x0].362: rc = 0 00000004:00080000:2.0:1787826022.989704:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb450964cc0 with version 660 00000020:00080000:2.0:1787826022.989708:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483959 cancel update log [0x240001f58:0x1:0x0].234: rc = 0 00000020:00080000:2.0:1787826022.989726:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483959 cancel update log [0x200026560:0x1:0x0].363: rc = 0 00000004:00080000:2.0:1787826022.989747:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34953a900 with version 661 00000020:00080000:2.0:1787826022.989750:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483960 cancel update log [0x240001f58:0x1:0x0].235: rc = 0 00000020:00080000:2.0:1787826022.989768:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483960 cancel update log [0x200026560:0x1:0x0].364: rc = 0 00000004:00080000:2.0:1787826022.989787:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34953a300 with version 662 00000020:00080000:2.0:1787826022.989790:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483961 cancel update log [0x240001f58:0x1:0x0].236: rc = 0 00000020:00080000:2.0:1787826022.989815:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483961 cancel update log [0x200026560:0x1:0x0].365: rc = 0 00000004:00080000:2.0:1787826022.989836:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34953a000 with version 663 00000020:00080000:2.0:1787826022.989839:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483962 cancel update log [0x240001f58:0x1:0x0].237: rc = 0 00000020:00080000:2.0:1787826022.989858:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483962 cancel update log [0x200026560:0x1:0x0].366: rc = 0 00000004:00080000:2.0:1787826022.989876:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34953a3c0 with version 664 00000020:00080000:2.0:1787826022.989879:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483963 cancel update log [0x240001f58:0x1:0x0].238: rc = 0 00000020:00080000:2.0:1787826022.989896:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483963 cancel update log [0x200026560:0x1:0x0].367: rc = 0 00000004:00080000:2.0:1787826022.989917:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172b40 with version 665 00000020:00080000:2.0:1787826022.989920:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483964 cancel update log [0x240001f58:0x1:0x0].239: rc = 0 00000020:00080000:2.0:1787826022.989936:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483964 cancel update log [0x200026560:0x1:0x0].368: rc = 0 00000004:00080000:2.0:1787826022.989966:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34919a3c0 with version 666 00000020:00080000:2.0:1787826022.989969:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483965 cancel update log [0x240001f58:0x1:0x0].240: rc = 0 00000020:00080000:2.0:1787826022.989986:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483965 cancel update log [0x200026560:0x1:0x0].369: rc = 0 00000004:00080000:2.0:1787826022.990004:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34919a0c0 with version 667 00000020:00080000:2.0:1787826022.990007:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483966 cancel update log [0x240001f58:0x1:0x0].241: rc = 0 00000020:00080000:2.0:1787826022.990024:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483966 cancel update log [0x200026560:0x1:0x0].370: rc = 0 00000004:00080000:2.0:1787826022.990045:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a4ca240 with version 668 00000020:00080000:2.0:1787826022.990048:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483967 cancel update log [0x240001f58:0x1:0x0].242: rc = 0 00000020:00080000:2.0:1787826022.990066:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483967 cancel update log [0x200026560:0x1:0x0].371: rc = 0 00000004:00080000:2.0:1787826022.990084:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4770c5600 with version 669 00000020:00080000:2.0:1787826022.990087:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483968 cancel update log [0x240001f58:0x1:0x0].243: rc = 0 00000020:00080000:2.0:1787826022.990105:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483968 cancel update log [0x200026560:0x1:0x0].372: rc = 0 00000004:00080000:2.0:1787826022.990124:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4770c5c00 with version 670 00000020:00080000:2.0:1787826022.990127:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483969 cancel update log [0x240001f58:0x1:0x0].244: rc = 0 00000020:00080000:2.0:1787826022.990148:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483969 cancel update log [0x200026560:0x1:0x0].373: rc = 0 00000004:00080000:2.0:1787826022.990167:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4770c5480 with version 671 00000020:00080000:2.0:1787826022.990170:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483970 cancel update log [0x240001f58:0x1:0x0].245: rc = 0 00000020:00080000:2.0:1787826022.990187:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483970 cancel update log [0x200026560:0x1:0x0].374: rc = 0 00000004:00080000:2.0:1787826022.990206:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4770c5cc0 with version 672 00000020:00080000:2.0:1787826022.990209:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483971 cancel update log [0x240001f58:0x1:0x0].246: rc = 0 00000020:00080000:2.0:1787826022.990228:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483971 cancel update log [0x200026560:0x1:0x0].375: rc = 0 00000004:00080000:2.0:1787826022.990247:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4770c5a80 with version 673 00000020:00080000:2.0:1787826022.990250:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483972 cancel update log [0x240001f58:0x1:0x0].247: rc = 0 00000020:00080000:2.0:1787826022.990269:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483972 cancel update log [0x200026560:0x1:0x0].376: rc = 0 00000004:00080000:2.0:1787826022.990292:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4770c5b40 with version 674 00000020:00080000:2.0:1787826022.990295:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483973 cancel update log [0x240001f58:0x1:0x0].248: rc = 0 00000020:00080000:2.0:1787826022.990312:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483973 cancel update log [0x200026560:0x1:0x0].377: rc = 0 00000004:00080000:2.0:1787826022.990365:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb441374180 with version 675 00000020:00080000:2.0:1787826022.990369:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483974 cancel update log [0x240001f58:0x1:0x0].249: rc = 0 00000020:00080000:2.0:1787826022.990390:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483974 cancel update log [0x200026560:0x1:0x0].378: rc = 0 00000004:00080000:2.0:1787826022.990409:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a16c0 with version 676 00000020:00080000:2.0:1787826022.990412:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483975 cancel update log [0x240001f58:0x1:0x0].250: rc = 0 00000020:00080000:2.0:1787826022.990429:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483975 cancel update log [0x200026560:0x1:0x0].379: rc = 0 00000004:00080000:2.0:1787826022.990447:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a1900 with version 677 00000020:00080000:2.0:1787826022.990450:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483976 cancel update log [0x240001f58:0x1:0x0].251: rc = 0 00000020:00080000:2.0:1787826022.990500:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483976 cancel update log [0x200026560:0x1:0x0].381: rc = 0 00000004:00080000:2.0:1787826022.990521:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a1f00 with version 678 00000020:00080000:2.0:1787826022.990524:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483977 cancel update log [0x240001f58:0x1:0x0].252: rc = 0 00000020:00080000:2.0:1787826022.990542:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483977 cancel update log [0x200026560:0x1:0x0].382: rc = 0 00000004:00080000:2.0:1787826022.990561:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a1000 with version 679 00000020:00080000:2.0:1787826022.990565:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483978 cancel update log [0x240001f58:0x1:0x0].254: rc = 0 00000020:00080000:2.0:1787826022.990582:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483978 cancel update log [0x200026560:0x1:0x0].383: rc = 0 00000004:00080000:2.0:1787826022.990600:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a1480 with version 680 00000020:00080000:2.0:1787826022.990603:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483979 cancel update log [0x240001f58:0x1:0x0].255: rc = 0 00000020:00080000:2.0:1787826022.990621:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483979 cancel update log [0x200026560:0x1:0x0].384: rc = 0 00000004:00080000:2.0:1787826022.990652:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a1c00 with version 681 00000020:00080000:2.0:1787826022.990656:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483980 cancel update log [0x240001f58:0x1:0x0].256: rc = 0 00000020:00080000:2.0:1787826022.990677:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483980 cancel update log [0x200026560:0x1:0x0].385: rc = 0 00000004:00080000:2.0:1787826022.990697:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a1cc0 with version 682 00000020:00080000:2.0:1787826022.990700:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483981 cancel update log [0x240001f58:0x1:0x0].257: rc = 0 00000020:00080000:2.0:1787826022.990718:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483981 cancel update log [0x200026560:0x1:0x0].386: rc = 0 00000004:00080000:2.0:1787826022.990737:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a10c0 with version 683 00000020:00080000:2.0:1787826022.990740:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483982 cancel update log [0x240001f58:0x1:0x0].258: rc = 0 00000020:00080000:2.0:1787826022.990758:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483982 cancel update log [0x200026560:0x1:0x0].387: rc = 0 00000004:00080000:2.0:1787826022.990780:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a13c0 with version 684 00000020:00080000:2.0:1787826022.990783:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483983 cancel update log [0x240001f58:0x1:0x0].259: rc = 0 00000020:00080000:2.0:1787826022.990801:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483983 cancel update log [0x200026560:0x1:0x0].388: rc = 0 00000004:00080000:2.0:1787826022.990820:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3426826c0 with version 685 00000020:00080000:2.0:1787826022.990824:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483984 cancel update log [0x240001f58:0x1:0x0].260: rc = 0 00000020:00080000:2.0:1787826022.990842:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483984 cancel update log [0x200026560:0x1:0x0].389: rc = 0 00000004:00080000:2.0:1787826022.990862:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb342682300 with version 686 00000020:00080000:2.0:1787826022.990864:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483985 cancel update log [0x240001f58:0x1:0x0].261: rc = 0 00000020:00080000:2.0:1787826022.990882:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483985 cancel update log [0x200026560:0x1:0x0].390: rc = 0 00000004:00080000:2.0:1787826022.990902:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb342682540 with version 687 00000020:00080000:2.0:1787826022.990905:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483986 cancel update log [0x240001f58:0x1:0x0].262: rc = 0 00000020:00080000:2.0:1787826022.990925:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483986 cancel update log [0x200026560:0x1:0x0].391: rc = 0 00000004:00080000:2.0:1787826022.990944:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb342682900 with version 688 00000020:00080000:2.0:1787826022.990947:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483987 cancel update log [0x240001f58:0x1:0x0].263: rc = 0 00000020:00080000:2.0:1787826022.990966:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483987 cancel update log [0x200026560:0x1:0x0].392: rc = 0 00000004:00080000:2.0:1787826022.990986:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62ee40 with version 689 00000020:00080000:2.0:1787826022.990988:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483988 cancel update log [0x240001f58:0x1:0x0].264: rc = 0 00000020:00080000:2.0:1787826022.991006:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483988 cancel update log [0x200026560:0x1:0x0].393: rc = 0 00000004:00080000:2.0:1787826022.991024:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e780 with version 690 00000020:00080000:2.0:1787826022.991026:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483989 cancel update log [0x240001f58:0x1:0x0].265: rc = 0 00000020:00080000:2.0:1787826022.991044:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483989 cancel update log [0x200026560:0x1:0x0].394: rc = 0 00000004:00080000:2.0:1787826022.991063:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62ecc0 with version 691 00000020:00080000:2.0:1787826022.991066:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483990 cancel update log [0x240001f58:0x1:0x0].266: rc = 0 00000020:00080000:2.0:1787826022.991085:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483990 cancel update log [0x200026560:0x1:0x0].395: rc = 0 00000004:00080000:2.0:1787826022.991102:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e840 with version 692 00000020:00080000:2.0:1787826022.991105:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483991 cancel update log [0x240001f58:0x1:0x0].267: rc = 0 00000020:00080000:2.0:1787826022.991122:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483991 cancel update log [0x200026560:0x1:0x0].396: rc = 0 00000004:00080000:2.0:1787826022.991139:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e300 with version 693 00000020:00080000:2.0:1787826022.991142:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483992 cancel update log [0x240001f58:0x1:0x0].268: rc = 0 00000020:00080000:2.0:1787826022.991161:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483992 cancel update log [0x200026560:0x1:0x0].397: rc = 0 00000004:00080000:2.0:1787826022.991177:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62ed80 with version 694 00000020:00080000:2.0:1787826022.991179:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483993 cancel update log [0x240001f58:0x1:0x0].269: rc = 0 00000020:00080000:2.0:1787826022.991197:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483993 cancel update log [0x200026560:0x1:0x0].398: rc = 0 00000004:00080000:2.0:1787826022.991222:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62ef00 with version 695 00000020:00080000:2.0:1787826022.991225:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483994 cancel update log [0x240001f58:0x1:0x0].270: rc = 0 00000020:00080000:2.0:1787826022.991244:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483994 cancel update log [0x200026560:0x1:0x0].399: rc = 0 00000004:00080000:2.0:1787826022.991263:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e3c0 with version 696 00000020:00080000:2.0:1787826022.991265:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483995 cancel update log [0x240001f58:0x1:0x0].271: rc = 0 00000020:00080000:2.0:1787826022.991287:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483995 cancel update log [0x200026560:0x1:0x0].400: rc = 0 00000020:00080000:2.0:1787826022.991307:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712483995 00000004:00080000:3.0:1787826022.991905:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 640 rpc_version 640 00000020:00100000:3.0:1787826022.991953:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826022.991967:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b46680 x1874663049171072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826022.992008:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049171072:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826022.992090:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826022.992137:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4728cff00 going to sleep for 11 seconds 00010000:00010000:1.0:1787826022.995280:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995305:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995314:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995321:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995354:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995363:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995388:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb8:0x0].0x0 (ffff8eb47f8fd700) 00010000:00010000:1.0:1787826022.995391:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995397:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995404:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357200/0x878a5eea00ceb7c1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995431:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995439:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995445:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995451:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995455:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995461:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995469:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2c:0x0].0x0 (ffff8eb47f8fd500) 00010000:00010000:1.0:1787826022.995472:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995476:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995482:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00ceb7c8 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995511:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995518:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995524:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995528:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995531:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995538:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995551:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.995554:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995557:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995565:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00ceb81c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995579:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995585:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995591:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995596:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995599:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995605:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995612:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.995615:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995618:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995624:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a200/0x878a5eea00ceb87e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995637:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995653:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995660:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995665:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995668:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995674:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995683:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bb9:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:1.0:1787826022.995685:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995688:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995695:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceb885 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995712:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995719:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995725:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995732:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995735:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995741:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995749:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2d:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:1.0:1787826022.995751:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995754:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995760:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00ceb88c lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995777:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995784:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995791:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995796:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462b200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995800:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995807:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995819:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.995822:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995825:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995831:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462b200/0x878a5eea00ceb8e0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995844:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995850:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995856:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995861:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995864:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995871:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995879:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.995882:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995884:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995889:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00ceb942 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995901:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995907:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995913:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995918:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.995922:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995928:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995936:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bba:0x0].0x0 (ffff8eb47f8fe000) 00010000:00010000:1.0:1787826022.995938:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.995941:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995948:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00ceb949 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995963:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995970:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.995975:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996232:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ec00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996237:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996244:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996254:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2e:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:1.0:1787826022.996256:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996260:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996266:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceb950 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996285:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996292:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996297:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996303:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34462a400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996306:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996313:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996410:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.996413:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996417:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996423:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34462a400/0x878a5eea00ceb9a4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996437:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996444:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996450:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996455:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996458:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996464:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996473:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.996475:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996478:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996484:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00ceba06 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996498:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996505:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996511:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996516:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996518:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996524:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996532:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbb:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:1.0:1787826022.996534:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996537:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996543:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceba0d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996556:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996562:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996568:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996574:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996578:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996583:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996591:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x2f:0x0].0x0 (ffff8eb47f8fee00) 00010000:00010000:1.0:1787826022.996593:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996596:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996602:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00ceba14 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996616:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996623:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996629:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996634:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996637:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996652:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996665:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.996668:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996671:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996678:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3c00/0x878a5eea00ceba68 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996692:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996699:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996705:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996711:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996714:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996721:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996729:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.996732:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996735:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996742:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cebaca lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996754:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996761:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996767:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996773:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996776:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996782:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996790:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbc:0x0].0x0 (ffff8eb472727a00) 00010000:00010000:1.0:1787826022.996792:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996796:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996802:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cebad1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996819:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996826:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996833:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996839:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996842:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996847:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996854:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x30:0x0].0x0 (ffff8eb472727300) 00010000:00010000:1.0:1787826022.996856:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996859:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996865:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cebad8 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996879:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996885:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996892:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996896:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fe00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996899:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996905:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996917:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.996920:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.996922:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996928:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cebb2c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996940:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996946:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996953:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996958:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.996961:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996968:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.996976:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.998153:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.998164:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998177:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cebb8e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998198:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998206:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998214:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998221:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.998226:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998233:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998250:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbd:0x0].0x0 (ffff8eb46268a100) 00010000:00010000:1.0:1787826022.998253:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.998256:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998262:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cebb95 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998281:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998288:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998294:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998300:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.998303:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998309:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.998317:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x31:0x0].0x0 (ffff8eb46268af00) 00010000:00010000:1.0:1787826022.998319:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.999071:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999085:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cebb9c lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999117:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999125:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999131:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999137:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.999141:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999148:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999166:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.999169:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.999172:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999178:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cebbf0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999193:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999199:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999205:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999211:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.999214:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999220:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999229:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826022.999231:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.999234:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999241:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cebc52 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999256:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999262:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999268:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999274:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826022.999277:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999283:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999291:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbe:0x0].0x0 (ffff8eb480de3d00) 00010000:00010000:1.0:1787826022.999293:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826022.999296:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999302:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cebc59 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826022.999320:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826022.999518:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049171072 00000100:00100000:2.0:1787826022.999534:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049171072 00000100:00100000:2.0:1787826022.999661:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12387 00000100:00100000:2.0:1787826022.999673:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187924:x1874663049171072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826022.999949:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187924:x1874663049171072:12345-0@lo:1000:osp_up1-0.0 Request processed in 277us (7856us total) trans 17179869822 rc 0/0 00000100:00100000:2.0:1787826022.999958:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12387 00010000:00010000:1.0:1787826023.000445:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000454:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000462:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000467:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000475:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000492:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x32:0x0].0x0 (ffff8eb480de3700) 00010000:00010000:1.0:1787826023.000494:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.000499:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000505:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cebc60 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000535:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000541:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000547:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000552:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000555:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000560:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000573:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.000576:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.000579:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000586:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cebcb4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000597:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000603:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000609:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000614:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000618:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000624:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000632:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.000634:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.000637:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000655:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cebd16 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000671:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000677:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000684:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000689:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000692:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000698:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000706:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bbf:0x0].0x0 (ffff8eb480de3100) 00010000:00010000:1.0:1787826023.000708:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.000711:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000717:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cebd1d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000729:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000736:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000742:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000748:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000751:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000757:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000765:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x33:0x0].0x0 (ffff8eb480de3c00) 00010000:00010000:1.0:1787826023.000768:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.000771:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000777:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cebd24 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000791:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000798:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000804:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000809:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000812:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000819:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000833:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.000835:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.000838:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000845:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cebd78 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000855:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000862:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000868:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000873:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000876:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000881:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000889:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.000891:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.000894:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000900:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cebdda lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000912:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000919:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000925:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000931:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000933:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000939:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000948:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc0:0x0].0x0 (ffff8eb476e51c00) 00010000:00010000:1.0:1787826023.000950:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.000953:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000959:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cebde1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000975:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000981:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000987:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.000994:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.000997:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001003:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001011:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x34:0x0].0x0 (ffff8eb476e51e00) 00010000:00010000:1.0:1787826023.001013:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.001016:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001022:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cebde8 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001035:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001042:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001048:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001053:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.001056:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001062:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001074:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.001077:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.001079:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001086:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cebe3c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001098:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001104:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001110:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001115:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.001118:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001124:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001131:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.001134:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.001136:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001143:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cebe9e lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001153:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001159:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001165:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001170:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.001173:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001179:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001187:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc1:0x0].0x0 (ffff8eb47f8ff400) 00010000:00010000:1.0:1787826023.001189:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.001192:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001198:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cebea5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001211:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001218:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001224:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001230:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.001233:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001238:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001245:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x35:0x0].0x0 (ffff8eb47f8ff800) 00010000:00010000:1.0:1787826023.001247:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.001250:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001256:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cebeac lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001269:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001276:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001281:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001286:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.001289:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001295:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001307:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.001309:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.001312:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.001318:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cebf00 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002461:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002472:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002479:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002486:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.002490:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002497:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002511:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.002514:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.002518:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002524:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cebf62 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002535:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002542:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002547:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002552:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.002556:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002562:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002570:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc2:0x0].0x0 (ffff8eb47f8ff300) 00010000:00010000:1.0:1787826023.002572:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.002576:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002581:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cebf69 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002598:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002603:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002608:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002613:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.002616:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002621:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002627:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x36:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:1.0:1787826023.002629:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.002632:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002638:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357800/0x878a5eea00cebf70 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002665:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002671:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002676:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002681:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.002684:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002689:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002701:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb449543000) 00010000:00010000:1.0:1787826023.002704:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.002706:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.002711:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cebfc4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.005295:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049171072:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.005321:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 641 rpc_version 641 00000020:00100000:2.0:1787826023.005554:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.005565:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47f995500 x1874663049171328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.005593:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049171328:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.005688:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.005762:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.005867:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049171328 00000100:00100000:1.0:1787826023.005877:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049171328 00000100:00100000:1.0:1787826023.005962:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12388 00000100:00100000:1.0:1787826023.005974:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bf53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187924:x1874663049171328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.006229:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bf53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187924:x1874663049171328:12345-0@lo:1000:osp_up1-0.0 Request processed in 256us (540us total) trans 17179869823 rc 0/0 00000100:00100000:1.0:1787826023.006237:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12388 00000100:00100000:3.0:1787826023.006849:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049171328:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826023.006864:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 642 rpc_version 642 00000020:00100000:3.0:1787826023.006884:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826023.006890:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b44a80 x1874663049171584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826023.006908:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b44a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049171584:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.006948:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.007136:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.011293:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049171584 00000100:00100000:2.0:1787826023.011312:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049171584 00000100:00100000:2.0:1787826023.011418:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12389 00000100:00100000:2.0:1787826023.011430:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187924:x1874663049171584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.011714:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187924:x1874663049171584:12345-0@lo:1000:osp_up1-0.0 Request processed in 284us (4763us total) trans 17179869824 rc 0/0 00000100:00100000:2.0:1787826023.011724:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12389 00000100:00100000:2.0:1787826023.011808:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b44a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049171584:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.011831:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 643 rpc_version 643 00000020:00100000:2.0:1787826023.011865:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.011874:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47f997b80 x1874663049171840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.011900:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049171840:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.011949:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.011968:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4728cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.012119:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049171840 00000100:00100000:2.0:1787826023.012124:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049171840 00000100:00100000:2.0:1787826023.012145:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12390 00000100:00100000:2.0:1787826023.012153:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187924:x1874663049171840:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.012246:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187924:x1874663049171840:12345-0@lo:1000:osp_up1-0.0 Request processed in 92us (296us total) trans 17179869825 rc 0/0 00000100:00100000:2.0:1787826023.012253:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12390 00000100:00100000:2.0:1787826023.012281:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049171840:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.012289:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 644 rpc_version 644 00000020:00100000:2.0:1787826023.012301:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.012306:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47f996680 x1874663049172096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.012319:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049172096:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.012444:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.012455:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.012466:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049172096 00000100:00100000:2.0:1787826023.012469:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049172096 00000100:00100000:2.0:1787826023.012487:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12391 00000100:00100000:2.0:1787826023.012493:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187924:x1874663049172096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.012565:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187924:x1874663049172096:12345-0@lo:1000:osp_up1-0.0 Request processed in 72us (120us total) trans 17179869826 rc 0/0 00000100:00100000:2.0:1787826023.012573:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12391 00000100:00100000:2.0:1787826023.012600:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049172096:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.012608:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 645 rpc_version 645 00000020:00100000:2.0:1787826023.012622:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.012627:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479bf4a80 x1874663049172352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.012638:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049172352:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.012676:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.012686:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.012698:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049172352 00000100:00100000:2.0:1787826023.012701:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049172352 00000100:00100000:2.0:1787826023.012718:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12392 00000100:00100000:2.0:1787826023.012723:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187924:x1874663049172352:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.012789:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187924:x1874663049172352:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (111us total) trans 17179869827 rc 0/0 00000100:00100000:2.0:1787826023.012795:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12392 00000100:00100000:2.0:1787826023.012819:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049172352:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.012826:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 646 rpc_version 646 00000020:00100000:2.0:1787826023.012839:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.012843:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df16a00 x1874663049172608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.012854:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049172608:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.012878:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.012887:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.012898:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049172608 00000100:00100000:2.0:1787826023.012901:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049172608 00000100:00100000:2.0:1787826023.012918:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12393 00000100:00100000:2.0:1787826023.012924:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187924:x1874663049172608:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.013066:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049172608:12345-0@lo:1000:osp_up1-0.0 Request processed in 141us (187us total) trans 17179869828 rc 0/0 00000100:00100000:2.0:1787826023.013073:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12393 00000100:00100000:2.0:1787826023.013099:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049172608:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.013106:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 647 rpc_version 647 00000020:00100000:2.0:1787826023.013118:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.013123:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df16d80 x1874663049172864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.013134:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049172864:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.013159:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.013168:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4728cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.013180:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049172864 00000100:00100000:2.0:1787826023.013183:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049172864 00000100:00100000:2.0:1787826023.013198:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12394 00000100:00100000:2.0:1787826023.013203:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049172864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.013274:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187924:x1874663049172864:12345-0@lo:1000:osp_up1-0.0 Request processed in 70us (113us total) trans 17179869829 rc 0/0 00000100:00100000:2.0:1787826023.013281:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12394 00000100:00100000:2.0:1787826023.013306:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049172864:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.013313:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 648 rpc_version 648 00000020:00100000:2.0:1787826023.013512:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.013519:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df17800 x1874663049173120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.013532:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049173120:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.013558:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.013701:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.013742:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049173120 00000100:00100000:1.0:1787826023.013748:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049173120 00000100:00100000:1.0:1787826023.013779:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12395 00000100:00100000:1.0:1787826023.013787:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187924:x1874663049173120:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.013907:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187924:x1874663049173120:12345-0@lo:1000:osp_up1-0.0 Request processed in 121us (347us total) trans 17179869830 rc 0/0 00000100:00100000:1.0:1787826023.013914:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12395 00000100:00100000:1.0:1787826023.013954:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049173120:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.013962:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 649 rpc_version 649 00000020:00100000:1.0:1787826023.013975:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.013991:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb348fff100 x1874663049173376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.014005:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049173376:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014035:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.014049:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.014060:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049173376 00000100:00100000:1.0:1787826023.014064:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049173376 00000100:00100000:1.0:1787826023.014082:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12396 00000100:00100000:1.0:1787826023.014088:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187924:x1874663049173376:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014158:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187924:x1874663049173376:12345-0@lo:1000:osp_up1-0.0 Request processed in 69us (122us total) trans 17179869831 rc 0/0 00000100:00100000:1.0:1787826023.014164:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12396 00000100:00100000:1.0:1787826023.014193:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049173376:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.014200:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 650 rpc_version 650 00000020:00100000:1.0:1787826023.014212:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.014216:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb348ffe680 x1874663049173632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.014228:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049173632:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014255:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.014268:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.014279:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049173632 00000100:00100000:1.0:1787826023.014282:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049173632 00000100:00100000:1.0:1787826023.014297:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12397 00000100:00100000:1.0:1787826023.014302:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187924:x1874663049173632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014396:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187924:x1874663049173632:12345-0@lo:1000:osp_up1-0.0 Request processed in 93us (140us total) trans 17179869832 rc 0/0 00000100:00100000:1.0:1787826023.014403:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12397 00000100:00100000:1.0:1787826023.014433:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049173632:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.014440:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 651 rpc_version 651 00000020:00100000:1.0:1787826023.014451:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.014455:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb348fff480 x1874663049173888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.014467:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049173888:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014489:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.014502:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.014512:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049173888 00000100:00100000:1.0:1787826023.014516:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049173888 00000100:00100000:1.0:1787826023.014534:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12398 00000100:00100000:1.0:1787826023.014540:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187924:x1874663049173888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014606:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187924:x1874663049173888:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (115us total) trans 17179869833 rc 0/0 00000100:00100000:1.0:1787826023.014612:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12398 00000100:00100000:1.0:1787826023.014659:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049173888:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.014666:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 652 rpc_version 652 00000020:00100000:1.0:1787826023.014678:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.014683:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb348fff800 x1874663049174144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.014695:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049174144:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014724:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.014738:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.014748:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049174144 00000100:00100000:1.0:1787826023.014752:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049174144 00000100:00100000:1.0:1787826023.014769:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12399 00000100:00100000:1.0:1787826023.014775:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187924:x1874663049174144:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014838:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187924:x1874663049174144:12345-0@lo:1000:osp_up1-0.0 Request processed in 63us (113us total) trans 17179869834 rc 0/0 00000100:00100000:1.0:1787826023.014845:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12399 00000100:00100000:1.0:1787826023.014872:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049174144:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.014879:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 653 rpc_version 653 00000020:00100000:1.0:1787826023.014890:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.014895:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a427100 x1874663049174400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.014906:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049174400:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.014933:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.014945:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.014956:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049174400 00000100:00100000:1.0:1787826023.014959:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049174400 00000100:00100000:1.0:1787826023.014974:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12400 00000100:00100000:1.0:1787826023.014980:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187924:x1874663049174400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015045:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187924:x1874663049174400:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (112us total) trans 17179869835 rc 0/0 00000100:00100000:1.0:1787826023.015053:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12400 00000100:00100000:1.0:1787826023.015081:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049174400:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.015088:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 654 rpc_version 654 00000020:00100000:1.0:1787826023.015100:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.015105:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a42a300 x1874663049174656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.015118:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049174656:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015144:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.015157:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.015167:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049174656 00000100:00100000:1.0:1787826023.015170:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049174656 00000100:00100000:1.0:1787826023.015184:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12401 00000100:00100000:1.0:1787826023.015190:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187924:x1874663049174656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015257:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187924:x1874663049174656:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (112us total) trans 17179869836 rc 0/0 00000100:00100000:1.0:1787826023.015264:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12401 00000100:00100000:1.0:1787826023.015291:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049174656:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.015298:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 655 rpc_version 655 00000020:00100000:1.0:1787826023.015309:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.015314:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a429c00 x1874663049174912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.015349:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049174912:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015374:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.015387:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.015398:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049174912 00000100:00100000:1.0:1787826023.015402:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049174912 00000100:00100000:1.0:1787826023.015417:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12402 00000100:00100000:1.0:1787826023.015422:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187924:x1874663049174912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015489:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187924:x1874663049174912:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (113us total) trans 17179869837 rc 0/0 00000100:00100000:1.0:1787826023.015496:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12402 00000100:00100000:1.0:1787826023.015524:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049174912:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.015531:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 656 rpc_version 656 00000020:00100000:1.0:1787826023.015543:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.015547:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c141f80 x1874663049175168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.015559:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049175168:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015583:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.015596:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.015606:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049175168 00000100:00100000:1.0:1787826023.015609:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049175168 00000100:00100000:1.0:1787826023.015625:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12403 00000100:00100000:1.0:1787826023.015631:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187924:x1874663049175168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015711:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187924:x1874663049175168:12345-0@lo:1000:osp_up1-0.0 Request processed in 79us (126us total) trans 17179869838 rc 0/0 00000100:00100000:1.0:1787826023.015718:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12403 00000100:00100000:1.0:1787826023.015747:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049175168:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.015753:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 657 rpc_version 657 00000020:00100000:1.0:1787826023.015763:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.015767:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c142300 x1874663049175424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.015778:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049175424:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015802:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.015814:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.015824:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049175424 00000100:00100000:1.0:1787826023.015827:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049175424 00000100:00100000:1.0:1787826023.015843:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12404 00000100:00100000:1.0:1787826023.015849:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187924:x1874663049175424:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.015915:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187924:x1874663049175424:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (111us total) trans 17179869839 rc 0/0 00000100:00100000:1.0:1787826023.015922:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12404 00000100:00100000:1.0:1787826023.015950:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049175424:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.015956:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 658 rpc_version 658 00000020:00100000:1.0:1787826023.015967:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.015972:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472977100 x1874663049175680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.015983:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049175680:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.016009:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.016022:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.016033:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049175680 00000100:00100000:1.0:1787826023.016036:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049175680 00000100:00100000:1.0:1787826023.016052:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12405 00000100:00100000:1.0:1787826023.016057:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187924:x1874663049175680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.016121:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187924:x1874663049175680:12345-0@lo:1000:osp_up1-0.0 Request processed in 63us (111us total) trans 17179869840 rc 0/0 00000100:00100000:1.0:1787826023.016128:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12405 00000100:00100000:1.0:1787826023.016154:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049175680:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.016160:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 659 rpc_version 659 00000020:00100000:1.0:1787826023.016170:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.016174:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472977480 x1874663049175936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.016185:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049175936:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.016208:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.016220:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.016231:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049175936 00000100:00100000:1.0:1787826023.016234:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049175936 00000100:00100000:1.0:1787826023.016251:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12406 00000100:00100000:1.0:1787826023.016256:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187924:x1874663049175936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.016346:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187924:x1874663049175936:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (113us total) trans 17179869841 rc 0/0 00000100:00100000:1.0:1787826023.016353:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12406 00000100:00100000:1.0:1787826023.016379:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049175936:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.016386:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 660 rpc_version 660 00000020:00100000:1.0:1787826023.016397:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.016401:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472974a80 x1874663049176192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.016413:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049176192:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.016435:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.016446:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.016456:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049176192 00000100:00100000:1.0:1787826023.016459:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049176192 00000100:00100000:1.0:1787826023.016473:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12407 00000100:00100000:1.0:1787826023.016478:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187924:x1874663049176192:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.016538:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187924:x1874663049176192:12345-0@lo:1000:osp_up1-0.0 Request processed in 59us (102us total) trans 17179869842 rc 0/0 00000100:00100000:1.0:1787826023.016545:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12407 00000100:00100000:1.0:1787826023.016575:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049176192:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.016582:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 661 rpc_version 661 00000020:00100000:1.0:1787826023.016593:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.016597:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472976a00 x1874663049176448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.016609:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049176448:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.016632:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.016862:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049176448 00000100:00100000:0.0:1787826023.016867:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049176448 00000100:00100000:0.0:1787826023.016897:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12408 00000100:00100000:0.0:1787826023.016903:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187924:x1874663049176448:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.017160:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.021216:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187924:x1874663049176448:12345-0@lo:1000:osp_up1-0.0 Request processed in 4296us (4565us total) trans 17179869843 rc 0/0 00000100:00100000:0.0:1787826023.021236:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12408 00000100:00100000:3.0:1787826023.022281:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.022559:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042930048 00000100:00100000:0.0:1787826023.022570:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042930048 00000100:00100000:0.0:1787826023.022709:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 769 00000100:00100000:0.0:1787826023.022722:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:155721:x1874663042930048:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826023.022754:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.022781:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec049 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee7d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.022868:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.022885:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.022898:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.022917:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.022925:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.022932:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023047:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec05e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023056:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec05e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023063:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec05e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826023.023172:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc3:0x0]: returning size 4096 00000004:00200000:0.0:1787826023.023179:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787826023.023205:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec05e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023219:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023226:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023234:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023241:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.023246:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023255:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023268:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.023272:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.023277:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023284:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec050 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023296:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023307:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023313:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023319:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.023321:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023476:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023485:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb47f8fe400) 00010000:00010000:0.0:1787826023.023487:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.023491:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023498:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec057 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023535:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec049 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee7d expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023549:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec05e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee7d expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.023557:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc3:0x0].0x0 (ffff8eb47f8fe200) 00010000:00010000:0.0:1787826023.023559:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826023.023562:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568a00, rc 0) 00000100:00100000:0.0:1787826023.023656:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:155721:x1874663042930048:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 936us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.023665:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 769 00000100:00100000:1.0:1787826023.023970:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049176448:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.024200:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 662 rpc_version 662 00000020:00100000:1.0:1787826023.024238:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.024246:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479841180 x1874663049176704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.024274:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049176704:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.024485:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.024559:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.025114:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049176704 00000100:00100000:3.0:1787826023.025123:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049176704 00000100:00100000:3.0:1787826023.025224:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12409 00000100:00100000:3.0:1787826023.025236:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187924:x1874663049176704:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.025559:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187924:x1874663049176704:12345-0@lo:1000:osp_up1-0.0 Request processed in 325us (1073us total) trans 17179869844 rc 0/0 00000100:00100000:3.0:1787826023.025567:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12409 00000100:00100000:0.0:1787826023.025764:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049176704:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.025780:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 663 rpc_version 663 00000020:00100000:0.0:1787826023.025800:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.025808:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34bdf6d80 x1874663049176960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.025827:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049176960:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.025866:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.026143:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.026209:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049176960 00000100:00100000:1.0:1787826023.026215:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049176960 00000100:00100000:1.0:1787826023.026267:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12410 00000100:00100000:1.0:1787826023.026276:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187924:x1874663049176960:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.026532:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187924:x1874663049176960:12345-0@lo:1000:osp_up1-0.0 Request processed in 256us (665us total) trans 17179869845 rc 0/0 00000100:00100000:1.0:1787826023.026540:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12410 00000100:00100000:1.0:1787826023.026581:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049176960:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.026591:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 664 rpc_version 664 00000020:00100000:1.0:1787826023.026606:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.026611:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479843100 x1874663049177216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.026626:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049177216:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.026667:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.026684:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.026764:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049177216 00000100:00100000:1.0:1787826023.026768:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049177216 00000100:00100000:1.0:1787826023.026790:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12411 00000100:00100000:1.0:1787826023.026796:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187924:x1874663049177216:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.026869:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187924:x1874663049177216:12345-0@lo:1000:osp_up1-0.0 Request processed in 72us (200us total) trans 17179869846 rc 0/0 00000100:00100000:1.0:1787826023.026876:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12411 00000100:00100000:1.0:1787826023.026908:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049177216:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.026916:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 665 rpc_version 665 00000020:00100000:1.0:1787826023.026928:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.026934:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479840e00 x1874663049177472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.026946:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049177472:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.026974:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.027058:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.027070:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049177472 00000100:00100000:1.0:1787826023.027074:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049177472 00000100:00100000:1.0:1787826023.027091:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12412 00000100:00100000:1.0:1787826023.027097:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187924:x1874663049177472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.027162:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187924:x1874663049177472:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (188us total) trans 17179869847 rc 0/0 00000100:00100000:1.0:1787826023.027169:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12412 00000100:00100000:1.0:1787826023.027197:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049177472:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.027204:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 666 rpc_version 666 00000020:00100000:1.0:1787826023.027217:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.027222:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479841f80 x1874663049177728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.027234:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049177728:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.027260:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.027532:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.028542:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049177728 00000100:00100000:3.0:1787826023.028553:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049177728 00000100:00100000:1.0:1787826023.028778:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.028817:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042930176 00000100:00100000:1.0:1787826023.028821:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042930176 00000100:00100000:1.0:1787826023.028861:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 770 00000100:00100000:1.0:1787826023.028871:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:155721:x1874663042930176:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826023.028891:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.028920:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec065 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee84 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.029010:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 3/1,0 mode: --/PR res: [0x200026560:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.029026:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.029039:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826023.029103:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x37:0x0]: returning size 4096 00000004:00200000:1.0:1787826023.029109:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826023.029151:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec065 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 12 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.029177:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.029188:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x37:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:1.0:1787826023.029192:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826023.029195:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e800, rc 0) 00000100:00100000:1.0:1787826023.029261:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:155721:x1874663042930176:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 392us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.029269:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 770 00000100:00100000:2.0:1787826023.030256:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12413 00000100:00100000:2.0:1787826023.030568:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187924:x1874663049177728:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.030933:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187924:x1874663049177728:12345-0@lo:1000:osp_up1-0.0 Request processed in 375us (3670us total) trans 17179869848 rc 0/0 00000100:00100000:2.0:1787826023.030941:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12413 00000100:00100000:1.0:1787826023.038496:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.043546:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049177728:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.043604:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042930304 00000100:00100000:0.0:1787826023.043613:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042930304 00000100:00100000:0.0:1787826023.043712:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 771 00000100:00100000:0.0:1787826023.043724:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155721:x1874663042930304:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826023.043749:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.043776:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cec073 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee8b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.043859:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.043876:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cec042 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec03b expref: 35 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.043892:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.043934:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cec042 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec03b expref: 35 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.043952:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049177856:0@lo:104: 00000100:00100000:0.0:1787826023.045539:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.045610:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.045668:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049177856 00000100:00100000:0.0:1787826023.045677:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049177856 00000100:00100000:0.0:1787826023.046458:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4743 00000100:00100000:0.0:1787826023.046472:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049177856:12345-0@lo:104: 00010000:00010000:0.0:1787826023.046493:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.046585:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826023.046593:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049177856:12345-0@lo:104: Request processed in 125us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.046601:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4743 00000100:00100000:0.0:1787826023.046671:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049177856:0@lo:104: 00010000:00010000:0.0:1787826023.048221:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.048259:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826023.048416:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.048432:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826023.048439:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.048449:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.048504:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.048511:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826023.048551:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.048559:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511e00/0x878a5eea00cec03b lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec042 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.048580:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826023.048582:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826023.048583:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826023.048594:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826023.048617:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049177984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826023.049812:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.049895:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049177984 00000100:00100000:0.0:1787826023.049904:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049177984 00010000:00010000:0.0:1787826023.049950:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cec042 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec03b expref: 36 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.050584:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12183 00000100:00100000:0.0:1787826023.050605:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+36:3617:x1874663049177984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826023.050627:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:0.0:1787826023.051276:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 667 rpc_version 667 00000020:00100000:0.0:1787826023.051316:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.051858:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66ce00 x1874663049178240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.051891:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049178240:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.052218:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.052270:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049178240 00000100:00100000:0.0:1787826023.052279:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049178240 00000100:00100000:0.0:1787826023.052531:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12414 00000100:00100000:0.0:1787826023.052542:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187924:x1874663049178240:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.052761:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187924:x1874663049178240:12345-0@lo:1000:osp_up1-0.0 Request processed in 220us (778us total) trans 17179869849 rc 0/0 00000100:00100000:0.0:1787826023.052769:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12414 00000100:00100000:0.0:1787826023.053238:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.053300:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049178240:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.053316:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 668 rpc_version 668 00000020:00100000:0.0:1787826023.055424:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.055446:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477dd6300 x1874663049178496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.055479:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049178496:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.055565:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.055620:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.056432:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049178496 00000100:00100000:1.0:1787826023.056444:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049178496 00000100:00100000:1.0:1787826023.056511:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12415 00000100:00100000:1.0:1787826023.056522:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187924:x1874663049178496:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.057515:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:187924:x1874663049178496:12345-0@lo:1000:osp_up1-0.0 Request processed in 990us (1945us total) trans 17179869850 rc 0/0 00000100:00100000:1.0:1787826023.057528:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12415 00000100:00100000:0.0:1787826023.058207:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049178496:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.058229:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 669 rpc_version 669 00000020:00100000:0.0:1787826023.058397:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.058409:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477ddd880 x1874663049178752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.058435:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddd880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049178752:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.058492:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.058530:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.059319:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049178752 00000100:00100000:1.0:1787826023.059406:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049178752 00000100:00100000:1.0:1787826023.059463:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12416 00000100:00100000:1.0:1787826023.059473:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:187924:x1874663049178752:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.059679:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:187924:x1874663049178752:12345-0@lo:1000:osp_up1-0.0 Request processed in 206us (1186us total) trans 17179869851 rc 0/0 00000100:00100000:1.0:1787826023.059688:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12416 00000001:00080000:0.0:1787826023.060147:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869849 is committed 00000100:00100000:1.0:1787826023.061504:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddd880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049178752:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826023.061527:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 670 rpc_version 670 00000020:00100000:1.0:1787826023.061568:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.061575:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4774f3b80 x1874663049179008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.061600:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049179008:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.061687:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826023.061789:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cec042 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec03b expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.061811:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x37:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:0.0:1787826023.061817:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.061829:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.061836:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.061864:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826023.061920:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049177984:12345-0@lo:103:ldlm_bl.0 Request processed in 11321us (12114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.061930:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12183 00010000:00010000:0.0:1787826023.061971:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.062100:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049177984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826023.062445:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049179008 00000100:00100000:1.0:1787826023.062453:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049179008 00000100:00100000:1.0:1787826023.062497:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12417 00000100:00100000:1.0:1787826023.062507:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049179008:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.062686:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187924:x1874663049179008:12345-0@lo:1000:osp_up1-0.0 Request processed in 179us (999us total) trans 17179869852 rc 0/0 00010000:00010000:0.0:1787826023.062834:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826023.062905:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x37:0x0]: returning size 4096 00000004:00200000:0.0:1787826023.062911:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826023.062970:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cec073 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.063511:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.063545:0:187924:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869849 gen 2 00000004:00080000:2.0:1787826023.063552:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869820 committed transno 17179869849 00000020:00080000:2.0:1787826023.063559:0:187924:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925eb40 refcount 2 committed 0 result 0 batchid 330712484043 00000020:00080000:2.0:1787826023.063563:0:187924:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45c300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34925ecc0 00000020:00080000:2.0:1787826023.063566:0:187924:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].322 00000020:00080000:2.0:1787826023.063569:0:187924:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb450949400 00000020:00080000:2.0:1787826023.063572:0:187924:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].451 00000004:00080000:2.0:1787826023.063599:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869821 committed transno 17179869849 00000020:00080000:2.0:1787826023.063603:0:187924:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb443e5bcc0 refcount 2 committed 0 result 0 batchid 330712484044 00000020:00080000:2.0:1787826023.063606:0:187924:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44878a600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb443e5be40 00000020:00080000:2.0:1787826023.063609:0:187924:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].323 00000020:00080000:2.0:1787826023.063611:0:187924:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44878ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4730b8800 00000020:00080000:2.0:1787826023.063614:0:187924:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].452 00000004:00080000:2.0:1787826023.063627:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869822 committed transno 17179869849 00000004:00080000:2.0:1787826023.063652:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869823 committed transno 17179869849 00000004:00080000:2.0:1787826023.063667:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869824 committed transno 17179869849 00000004:00080000:2.0:1787826023.063680:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869825 committed transno 17179869849 00010000:00010000:0.0:1787826023.063810:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.063823:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x37:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:0.0:1787826023.063826:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826023.063831:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568800, rc 0) 00000100:00100000:0.0:1787826023.063902:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155721:x1874663042930304:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 20179us (25421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.063911:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 771 00000100:00100000:1.0:1787826023.064080:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12417 00000020:00080000:1.0:1787826023.064962:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 330712484044 committed batchid 330712483995 00000004:00080000:2.0:1787826023.065076:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869826 committed transno 17179869849 00000004:00080000:2.0:1787826023.065102:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869827 committed transno 17179869849 00000004:00080000:2.0:1787826023.065114:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869828 committed transno 17179869849 00000004:00080000:2.0:1787826023.065125:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869829 committed transno 17179869849 00000004:00080000:2.0:1787826023.065134:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869830 committed transno 17179869849 00000004:00080000:2.0:1787826023.065142:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869831 committed transno 17179869849 00000004:00080000:2.0:1787826023.065152:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869832 committed transno 17179869849 00000004:00080000:2.0:1787826023.065163:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869833 committed transno 17179869849 00000004:00080000:2.0:1787826023.065171:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869834 committed transno 17179869849 00000004:00080000:2.0:1787826023.065180:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869835 committed transno 17179869849 00000004:00080000:2.0:1787826023.065190:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869836 committed transno 17179869849 00000004:00080000:2.0:1787826023.065198:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869837 committed transno 17179869849 00000004:00080000:2.0:1787826023.065207:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869838 committed transno 17179869849 00000004:00080000:2.0:1787826023.065235:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869839 committed transno 17179869849 00000004:00080000:2.0:1787826023.065247:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869840 committed transno 17179869849 00000004:00080000:2.0:1787826023.065256:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869841 committed transno 17179869849 00000004:00080000:2.0:1787826023.065265:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869842 committed transno 17179869849 00000004:00080000:2.0:1787826023.065278:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869843 committed transno 17179869849 00000004:00080000:2.0:1787826023.065288:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869844 committed transno 17179869849 00000004:00080000:2.0:1787826023.065300:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869845 committed transno 17179869849 00000004:00080000:2.0:1787826023.065314:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869846 committed transno 17179869849 00000020:00080000:1.0:1787826023.065965:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712483995 00000004:00080000:2.0:1787826023.066435:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869847 committed transno 17179869849 00000004:00080000:2.0:1787826023.066462:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869848 committed transno 17179869849 00000004:00080000:2.0:1787826023.066473:0:187924:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869849 committed transno 17179869849 00000100:00100000:2.0:1787826023.066497:0:187924:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8eb477dd6300 x1874663049178496/t17179869850(17179869850) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787826039 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826023.066527:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049179008:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.066549:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 671 rpc_version 671 00000020:00100000:2.0:1787826023.066584:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.066590:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df17800 x1874663049179264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.066616:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049179264:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.066874:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.066914:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.067564:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049179264 00000100:00100000:0.0:1787826023.067575:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049179264 00000100:00100000:0.0:1787826023.067637:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12418 00000100:00100000:0.0:1787826023.067660:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187924:x1874663049179264:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.067872:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187924:x1874663049179264:12345-0@lo:1000:osp_up1-0.0 Request processed in 214us (998us total) trans 17179869853 rc 0/0 00000100:00100000:0.0:1787826023.067880:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12418 00000100:00100000:3.0:1787826023.068063:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049179264:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826023.068079:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 672 rpc_version 672 00000020:00100000:3.0:1787826023.068104:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826023.068111:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b47100 x1874663049179520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826023.068131:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b47100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049179520:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.068173:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.068206:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.070117:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049179520 00000100:00100000:0.0:1787826023.070133:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049179520 00000100:00100000:0.0:1787826023.070211:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12419 00000100:00100000:0.0:1787826023.070224:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187924:x1874663049179520:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.070499:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187924:x1874663049179520:12345-0@lo:1000:osp_up1-0.0 Request processed in 277us (2324us total) trans 17179869854 rc 0/0 00000100:00100000:0.0:1787826023.070508:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12419 00000100:00100000:0.0:1787826023.070579:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b47100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049179520:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.070596:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 673 rpc_version 673 00000020:00100000:0.0:1787826023.070623:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.070631:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477ddd500 x1874663049179776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.070661:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddd500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049179776:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.070702:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.070730:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049179776 00000100:00100000:0.0:1787826023.070733:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049179776 00000100:00100000:0.0:1787826023.070757:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12420 00000100:00100000:0.0:1787826023.070764:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187924:x1874663049179776:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.070838:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187924:x1874663049179776:12345-0@lo:1000:osp_up1-0.0 Request processed in 74us (135us total) trans 17179869855 rc 0/0 00000100:00100000:0.0:1787826023.070844:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12420 00000100:00100000:0.0:1787826023.070866:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.070883:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddd500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049179776:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.070889:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 674 rpc_version 674 00000020:00100000:0.0:1787826023.070901:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.070906:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477ddc380 x1874663049180032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.070919:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049180032:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.070946:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.070962:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049180032 00000100:00100000:0.0:1787826023.070965:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049180032 00000100:00100000:1.0:1787826023.071720:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12421 00000100:00100000:1.0:1787826023.071735:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187924:x1874663049180032:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.071855:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187924:x1874663049180032:12345-0@lo:1000:osp_up1-0.0 Request processed in 126us (907us total) trans 17179869856 rc 0/0 00000100:00100000:1.0:1787826023.071863:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12421 00000100:00100000:0.0:1787826023.072052:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.072081:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049180032:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.072093:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 675 rpc_version 675 00000020:00100000:0.0:1787826023.072112:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.072119:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b41180 x1874663049180288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.072135:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049180288:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.072169:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.072185:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.072370:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049180288 00000100:00100000:1.0:1787826023.072376:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049180288 00000100:00100000:1.0:1787826023.072414:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12422 00000100:00100000:1.0:1787826023.072421:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187924:x1874663049180288:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.072509:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187924:x1874663049180288:12345-0@lo:1000:osp_up1-0.0 Request processed in 89us (339us total) trans 17179869857 rc 0/0 00000100:00100000:1.0:1787826023.072517:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12422 00000100:00100000:0.0:1787826023.072656:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049180288:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.072664:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 676 rpc_version 676 00000020:00100000:0.0:1787826023.072678:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.072683:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b41500 x1874663049180544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.072695:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049180544:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.072723:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.072747:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.072787:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049180544 00000100:00100000:1.0:1787826023.072791:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049180544 00000100:00100000:1.0:1787826023.072820:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12423 00000100:00100000:1.0:1787826023.072828:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187924:x1874663049180544:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.072904:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187924:x1874663049180544:12345-0@lo:1000:osp_up1-0.0 Request processed in 77us (180us total) trans 17179869858 rc 0/0 00000100:00100000:1.0:1787826023.072911:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12423 00000100:00100000:0.0:1787826023.072975:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049180544:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.072992:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 677 rpc_version 677 00000020:00100000:0.0:1787826023.073004:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.073009:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b42a00 x1874663049180800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.073021:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049180800:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.073047:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.073069:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.073160:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049180800 00000100:00100000:1.0:1787826023.073164:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049180800 00000100:00100000:1.0:1787826023.073193:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12424 00000100:00100000:1.0:1787826023.073200:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187924:x1874663049180800:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.073282:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049180800:12345-0@lo:1000:osp_up1-0.0 Request processed in 81us (232us total) trans 17179869859 rc 0/0 00000100:00100000:1.0:1787826023.073289:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12424 00000100:00100000:0.0:1787826023.073511:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049180800:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.073519:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 678 rpc_version 678 00000020:00100000:0.0:1787826023.073531:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.073537:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b41f80 x1874663049181056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.073550:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049181056:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.073579:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.073599:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.073634:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049181056 00000100:00100000:1.0:1787826023.073648:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049181056 00000100:00100000:1.0:1787826023.073676:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12425 00000100:00100000:1.0:1787826023.073682:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049181056:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.073759:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187924:x1874663049181056:12345-0@lo:1000:osp_up1-0.0 Request processed in 77us (180us total) trans 17179869860 rc 0/0 00000100:00100000:1.0:1787826023.073766:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12425 00000100:00100000:0.0:1787826023.073827:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049181056:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.073835:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 679 rpc_version 679 00000020:00100000:0.0:1787826023.073848:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.073853:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b59f80 x1874663049181312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.073866:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b59f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049181312:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.073892:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.073914:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.073952:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049181312 00000100:00100000:1.0:1787826023.073956:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049181312 00000100:00100000:1.0:1787826023.073991:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12426 00000100:00100000:1.0:1787826023.073998:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187924:x1874663049181312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.074070:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187924:x1874663049181312:12345-0@lo:1000:osp_up1-0.0 Request processed in 72us (177us total) trans 17179869861 rc 0/0 00000100:00100000:1.0:1787826023.074077:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12426 00000100:00100000:0.0:1787826023.074310:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b59f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049181312:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.074317:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 680 rpc_version 680 00000020:00100000:0.0:1787826023.074370:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.074376:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b5b800 x1874663049181568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.074389:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049181568:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.074417:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.074435:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.074578:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049181568 00000100:00100000:1.0:1787826023.074583:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049181568 00000100:00100000:1.0:1787826023.074605:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12427 00000100:00100000:1.0:1787826023.074611:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187924:x1874663049181568:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.074702:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187924:x1874663049181568:12345-0@lo:1000:osp_up1-0.0 Request processed in 90us (284us total) trans 17179869862 rc 0/0 00000100:00100000:1.0:1787826023.074708:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12427 00000100:00100000:0.0:1787826023.074840:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049181568:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.074847:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 681 rpc_version 681 00000020:00100000:0.0:1787826023.074859:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.074864:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b5ad80 x1874663049181824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.074878:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049181824:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.074904:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.074928:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.076632:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049181824 00000100:00100000:1.0:1787826023.076660:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049181824 00000100:00100000:1.0:1787826023.076726:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12428 00000100:00100000:1.0:1787826023.076737:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187924:x1874663049181824:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.076961:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187924:x1874663049181824:12345-0@lo:1000:osp_up1-0.0 Request processed in 225us (2055us total) trans 17179869863 rc 0/0 00000100:00100000:1.0:1787826023.076970:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12428 00000100:00100000:0.0:1787826023.077245:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049181824:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.077279:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 682 rpc_version 682 00000020:00100000:0.0:1787826023.077310:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.077319:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b59180 x1874663049182080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.077371:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b59180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049182080:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.077417:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.077444:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.078086:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049182080 00000100:00100000:1.0:1787826023.078095:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049182080 00000100:00100000:1.0:1787826023.078136:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12429 00000100:00100000:1.0:1787826023.078144:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187924:x1874663049182080:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.078303:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187924:x1874663049182080:12345-0@lo:1000:osp_up1-0.0 Request processed in 160us (885us total) trans 17179869864 rc 0/0 00000100:00100000:1.0:1787826023.078310:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12429 00000100:00100000:0.0:1787826023.079166:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.079257:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b59180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049182080:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.079291:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 683 rpc_version 683 00000020:00100000:0.0:1787826023.079321:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.079483:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b58a80 x1874663049182336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.079508:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b58a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049182336:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.079567:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.079594:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.079714:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042930560 00000100:00100000:1.0:1787826023.079722:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042930560 00000100:00100000:1.0:1787826023.079779:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 772 00000100:00100000:1.0:1787826023.079790:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:155721:x1874663042930560:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:1.0:1787826023.079851:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826023.079891:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec05e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee7d expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.079914:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc3:0x0].0x0 (ffff8eb47f8fe200) 00010000:00010000:1.0:1787826023.079929:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826023.079958:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.079977:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080422:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080441:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080449:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080457:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080569:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080579:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080591:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080612:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080622:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080631:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080683:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.080699:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 10 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.080711:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049182464:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826023.080797:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.080826:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049182336 00000100:00100000:1.0:1787826023.080831:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049182336 00000100:00100000:1.0:1787826023.080870:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12430 00000100:00100000:1.0:1787826023.080879:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187924:x1874663049182336:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.082795:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187924:x1874663049182336:12345-0@lo:1000:osp_up1-0.0 Request processed in 1906us (3217us total) trans 17179869865 rc 0/0 00000100:00100000:1.0:1787826023.082811:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12430 00000100:00100000:0.0:1787826023.083016:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b58a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049182336:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.083033:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 684 rpc_version 684 00000020:00100000:0.0:1787826023.083059:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.083066:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b59c00 x1874663049182720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.083087:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b59c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049182720:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.083126:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.083153:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.083249:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049182720 00000100:00100000:1.0:1787826023.083258:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049182720 00000100:00100000:1.0:1787826023.083313:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12431 00000100:00100000:1.0:1787826023.083321:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187924:x1874663049182720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.083610:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187924:x1874663049182720:12345-0@lo:1000:osp_up1-0.0 Request processed in 289us (483us total) trans 17179869866 rc 0/0 00000100:00100000:1.0:1787826023.083617:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12431 00000100:00100000:0.0:1787826023.083790:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b59c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049182720:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.083799:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 685 rpc_version 685 00000020:00100000:0.0:1787826023.083812:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.083817:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b5b480 x1874663049182976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.083830:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049182976:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.083859:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.083881:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.083917:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049182976 00000100:00100000:1.0:1787826023.083921:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049182976 00000100:00100000:1.0:1787826023.083949:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12432 00000100:00100000:1.0:1787826023.083955:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187924:x1874663049182976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.084033:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187924:x1874663049182976:12345-0@lo:1000:osp_up1-0.0 Request processed in 78us (173us total) trans 17179869867 rc 0/0 00000100:00100000:1.0:1787826023.084040:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12432 00000100:00100000:3.0:1787826023.089147:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049182976:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826023.089169:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 686 rpc_version 686 00000020:00100000:3.0:1787826023.089202:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826023.089209:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b46d80 x1874663049183232/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826023.089236:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049183232:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.089843:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.089894:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.090474:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049183232 00000100:00100000:2.0:1787826023.090485:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049183232 00000100:00100000:2.0:1787826023.090562:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12433 00000100:00100000:2.0:1787826023.090574:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187924:x1874663049183232:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.091225:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187924:x1874663049183232:12345-0@lo:1000:osp_up1-0.0 Request processed in 650us (1379us total) trans 17179869868 rc 0/0 00000100:00100000:2.0:1787826023.091236:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12433 00000100:00100000:2.0:1787826023.093318:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049182464:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826023.093391:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.094580:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049183232:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826023.094597:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 687 rpc_version 687 00000020:00100000:3.0:1787826023.094631:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826023.094649:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b46680 x1874663049183488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826023.094674:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049183488:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.094823:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.094860:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.094937:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049183488 00000100:00100000:1.0:1787826023.094945:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049183488 00000100:00100000:1.0:1787826023.095070:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12434 00000100:00100000:1.0:1787826023.095081:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187924:x1874663049183488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.095258:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187924:x1874663049183488:12345-0@lo:1000:osp_up1-0.0 Request processed in 178us (435us total) trans 17179869869 rc 0/0 00000100:00100000:1.0:1787826023.095437:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12434 00000100:00100000:3.0:1787826023.095520:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049183488:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826023.095531:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 688 rpc_version 688 00000020:00100000:3.0:1787826023.095546:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826023.095552:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66d180 x1874663049183744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826023.095567:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049183744:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.095594:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.095616:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.095659:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049183744 00000100:00100000:1.0:1787826023.095664:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049183744 00000100:00100000:1.0:1787826023.095756:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12435 00000100:00100000:1.0:1787826023.095764:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187924:x1874663049183744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.095850:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187924:x1874663049183744:12345-0@lo:1000:osp_up1-0.0 Request processed in 87us (254us total) trans 17179869870 rc 0/0 00000100:00100000:1.0:1787826023.095860:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12435 00000100:00100000:3.0:1787826023.095911:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049183744:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826023.095918:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 689 rpc_version 689 00000020:00100000:3.0:1787826023.095929:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826023.095934:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb3427e4a80 x1874663049184000/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826023.095945:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049184000:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.095967:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.095997:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.096079:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049184000 00000100:00100000:2.0:1787826023.096084:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049184000 00000100:00100000:2.0:1787826023.096117:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12436 00000100:00100000:2.0:1787826023.096123:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187924:x1874663049184000:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.096196:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187924:x1874663049184000:12345-0@lo:1000:osp_up1-0.0 Request processed in 73us (228us total) trans 17179869871 rc 0/0 00000100:00100000:2.0:1787826023.096203:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12436 00000100:00100000:3.0:1787826023.096797:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049184000:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826023.096808:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 690 rpc_version 690 00000020:00100000:3.0:1787826023.096824:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826023.096829:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb3427e6d80 x1874663049184256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826023.096845:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049184256:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.096878:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.097457:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.098941:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.099088:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042930688 00000100:00100000:2.0:1787826023.099099:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042930688 00010000:00010000:2.0:1787826023.099149:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 11 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.099193:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12184 00000100:00100000:2.0:1787826023.099205:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:2392:x1874663042930688:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826023.099221:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.099229:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 11 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.099244:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 11 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.099480:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec06c lrc: 0/0,0 mode: --/PR res: [0x200026560:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee84 expref: 11 pid: 187904 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.099501:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x37:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:2.0:1787826023.099506:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.099517:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.099526:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.099554:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826023.099622:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:2392:x1874663042930688:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 419us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.099634:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12184 00010000:00010000:3.0:1787826023.099780:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.099789:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.099850:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.099858:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.099869:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.099892:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049184384:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787826023.100181:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.100620:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.103773:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049184256 00000100:00100000:0.0:1787826023.103792:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049184256 00000100:00100000:3.0:1787826023.104134:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049184384 00000100:00100000:3.0:1787826023.104149:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049184384 00000100:00100000:3.0:1787826023.104232:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12437 00000100:00100000:3.0:1787826023.104243:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187904:x1874663049184384:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826023.104266:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826023.104544:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec09d expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.104579:0:177386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.104590:0:177386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 30 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.104626:0:177386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.104647:0:177386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 6 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.104662:0:177386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049184512:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826023.104759:0:177386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.114632:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826023.114717:0:177386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049184512:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826023.114767:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 30 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.114783:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x37:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:3.0:1787826023.114786:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826023.114792:0:177386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 30 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.114803:0:177386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 30 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.114810:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19600, rc 0) 00000100:00100000:3.0:1787826023.114876:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187904:x1874663049184384:12345-0@lo:101:mdt00_000.0 Request processed in 10634us (14703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.114886:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12437 00000100:00100000:3.0:1787826023.114949:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049184384:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787826023.114969:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.114992:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.118400:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042930816 00000100:00100000:2.0:1787826023.118419:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042930816 00010000:00010000:2.0:1787826023.118477:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.118527:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12185 00000100:00100000:2.0:1787826023.118538:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042930816:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826023.118556:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.118563:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.118578:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.118606:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec07a lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee8b expref: 7 pid: 187905 timeout: 8189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.118627:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x37:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:2.0:1787826023.118634:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 29 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.118658:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 29 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.118668:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 29 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.118718:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 29 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.118736:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049184640:0@lo:105: 00000100:00100000:1.0:1787826023.118797:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12438 00000100:00100000:1.0:1787826023.118808:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187924:x1874663049184256:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.118827:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.118881:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.119014:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187924:x1874663049184256:12345-0@lo:1000:osp_up1-0.0 Request processed in 203us (22129us total) trans 17179869872 rc 0/0 00000100:00100000:1.0:1787826023.119024:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12438 00000100:00100000:1.0:1787826023.119844:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049184640 00000100:00100000:1.0:1787826023.119855:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049184640 00000100:00100000:1.0:1787826023.119893:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4744 00000100:00100000:1.0:1787826023.119903:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049184640:12345-0@lo:105: 00010000:00010000:1.0:1787826023.119919:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.119933:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.119944:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.119954:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.119963:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.119972:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.120131:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab18000) 00000100:00100000:1.0:1787826023.120322:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049184640:12345-0@lo:105: Request processed in 419us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.120355:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4744 00010000:00010000:1.0:1787826023.120438:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.120450:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.121206:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049184768:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787826023.121959:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.122123:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481768000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.122185:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049184640:0@lo:105: 00010000:00010000:1.0:1787826023.122207:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826023.122481:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049184256:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.122496:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 691 rpc_version 691 00000020:00100000:2.0:1787826023.122522:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.122530:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df16680 x1874663049185024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.122552:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049185024:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.122582:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042930816:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 4040us (7960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.122591:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.122597:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12185 00000100:00100000:1.0:1787826023.122685:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049184768 00000100:00100000:1.0:1787826023.122693:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049184768 00000100:00100000:1.0:1787826023.122793:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049185024 00000100:00100000:1.0:1787826023.122797:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049185024 00000100:00100000:1.0:1787826023.122814:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12439 00000100:00100000:1.0:1787826023.122823:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187904:x1874663049184768:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1787826023.123437:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12440 00000100:00100000:0.0:1787826023.123453:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187924:x1874663049185024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.123636:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187924:x1874663049185024:12345-0@lo:1000:osp_up1-0.0 Request processed in 189us (1046us total) trans 17179869873 rc 0/0 00000100:00100000:0.0:1787826023.123655:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12440 00000100:00100000:2.0:1787826023.123933:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.123970:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049185024:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826023.124058:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 692 rpc_version 692 00000020:00100000:2.0:1787826023.124084:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.124092:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df17b80 x1874663049185280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.124113:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049185280:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.124153:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.124226:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.126295:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187904:x1874663049184768:12345-0@lo:403:mdt00_000.0 Request processed in 3460us (4325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.126314:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12439 00000100:00100000:1.0:1787826023.126386:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049185280 00000100:00100000:1.0:1787826023.126394:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049185280 00000100:00100000:0.0:1787826023.128206:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12441 00000100:00100000:0.0:1787826023.128229:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187924:x1874663049185280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.128709:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187924:x1874663049185280:12345-0@lo:1000:osp_up1-0.0 Request processed in 487us (4553us total) trans 17179869874 rc 0/0 00000100:00100000:0.0:1787826023.128720:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12441 00000100:00100000:0.0:1787826023.128812:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049185280:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.128830:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 693 rpc_version 693 00000020:00100000:0.0:1787826023.128863:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.128871:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b5aa00 x1874663049185536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.128899:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049185536:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.128945:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.128964:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.129010:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049185536 00000100:00100000:0.0:1787826023.129017:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049185536 00000100:00100000:0.0:1787826023.129051:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12442 00000100:00100000:0.0:1787826023.129058:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187924:x1874663049185536:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.129142:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187924:x1874663049185536:12345-0@lo:1000:osp_up1-0.0 Request processed in 85us (197us total) trans 17179869875 rc 0/0 00000100:00100000:0.0:1787826023.129150:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12442 00000100:00100000:0.0:1787826023.129182:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049185536:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.129189:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 694 rpc_version 694 00000020:00100000:0.0:1787826023.129203:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.129208:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b58380 x1874663049185792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.129221:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b58380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049185792:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.129249:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.129261:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.130802:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049185792 00000100:00100000:0.0:1787826023.130816:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049185792 00000100:00100000:0.0:1787826023.130859:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12443 00000100:00100000:0.0:1787826023.130870:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187924:x1874663049185792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.131545:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187924:x1874663049185792:12345-0@lo:1000:osp_up1-0.0 Request processed in 672us (2290us total) trans 17179869876 rc 0/0 00000100:00100000:0.0:1787826023.131557:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12443 00000100:00100000:0.0:1787826023.131610:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b58380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049185792:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.131626:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 695 rpc_version 695 00000020:00100000:0.0:1787826023.131662:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.131670:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b5a300 x1874663049186048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.131701:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049186048:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.131744:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.131767:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.131796:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049186048 00000100:00100000:0.0:1787826023.131801:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049186048 00000100:00100000:0.0:1787826023.131823:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12444 00000100:00100000:0.0:1787826023.131829:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187924:x1874663049186048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.131919:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187924:x1874663049186048:12345-0@lo:1000:osp_up1-0.0 Request processed in 90us (174us total) trans 17179869877 rc 0/0 00000100:00100000:0.0:1787826023.131925:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12444 00000100:00100000:0.0:1787826023.131950:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049186048:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826023.131956:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 696 rpc_version 696 00000020:00100000:0.0:1787826023.131967:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.131972:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b58000 x1874663049186304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.131996:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b58000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049186304:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.132018:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.132026:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.132036:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049186304 00000100:00100000:0.0:1787826023.132039:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049186304 00000100:00100000:0.0:1787826023.132055:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12445 00000100:00100000:0.0:1787826023.132060:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187924:x1874663049186304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.132123:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187924:x1874663049186304:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (103us total) trans 17179869878 rc 0/0 00000100:00100000:0.0:1787826023.132130:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12445 00000100:00100000:0.0:1787826023.132155:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b58000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049186304:0@lo:1000:osp_up1-0.0 00000001:02000400:0.0:1787826023.137593:0:188986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1787826023.139049:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049184768:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1787826023.140559:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].453, 656 off694032 00000040:00080000:1.0:1787826023.140869:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].324, 736 off536928 00000004:00080000:1.0:1787826023.140879:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb481768000 with version 697 00000004:00080000:2.0:1787826023.140929:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 697 rpc_version 697 00000020:00100000:2.0:1787826023.140972:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.140985:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df15880 x1874663049186560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1696/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.141013:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049186560:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.141102:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.141178:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.141754:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049186560 00000100:00100000:3.0:1787826023.141765:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049186560 00000100:00100000:3.0:1787826023.141834:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12446 00000100:00100000:3.0:1787826023.141845:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187924:x1874663049186560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.142938:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187924:x1874663049186560:12345-0@lo:1000:osp_up1-0.0 Request processed in 1090us (1831us total) trans 17179869879 rc 0/0 00000100:00100000:3.0:1787826023.142949:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12446 00000100:00100000:0.0:1787826023.143137:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049186560:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826023.143204:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc3:0x0]: returning size 4096 00010000:00010000:1.0:1787826023.143238:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.143250:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.143261:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.143267:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.143274:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.143283:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.143302:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x37:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:1.0:1787826023.143305:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826023.143309:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.143316:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec096 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.145068:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.145082:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.145090:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145304:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826023.145318:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x37:0x0] 00010000:00010000:0.0:1787826023.145354:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145362:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145369:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145376:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.145380:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145389:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145406:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc3:0x0].0x0 (ffff8eb45edbd900) 00010000:00010000:0.0:1787826023.145409:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.145414:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145420:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec08f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145443:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145450:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145455:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145460:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.145462:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145468:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145475:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.145478:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.145481:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145490:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec081 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.145501:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef249a9c reply state 0000000067f75338 transno 335007449195 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145515:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.145523:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826023.145525:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826023.145529:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826023.145648:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:155721:x1874663042930560:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 65846us (66475us total) trans 335007449195 rc 0/0 00000100:00100000:0.0:1787826023.145659:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 772 00010000:00010000:3.0:1787826023.146231:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826023.146241:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.146257:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826023.146261:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826023.146270:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.146314:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.146357:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826023.146385:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.146394:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec09d lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec0a4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.146411:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826023.146413:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826023.146414:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826023.146423:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826023.146443:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049186688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826023.146501:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.146550:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049186688 00000100:00100000:3.0:1787826023.146557:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049186688 00000100:00100000:3.0:1787826023.146611:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4195 00000100:00100000:3.0:1787826023.146622:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+37:3620:x1874663049186688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826023.146648:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826023.146669:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec0a4 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec09d expref: 37 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.146683:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x37:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:3.0:1787826023.146693:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826023.146736:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+36:3620:x1874663049186688:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.146743:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4195 00000100:00100000:3.0:1787826023.146789:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049186688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826023.185992:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.186138:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042930944 00000100:00100000:1.0:1787826023.186151:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042930944 00000100:00100000:1.0:1787826023.186225:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 773 00000100:00100000:1.0:1787826023.186238:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:155735:x1874663042930944:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826023.186281:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.186310:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec0ab lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee92 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187139:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187160:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187176:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187190:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187202:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187209:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187266:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187274:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187281:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187287:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ec00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.187293:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187301:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187314:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.187318:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.187597:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187606:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec0b2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187623:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187630:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187636:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187650:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.187654:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187660:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187668:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826023.187671:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.187675:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187681:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec0b9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187717:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec0ab lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee92 expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187729:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.187732:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.187736:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec0ab lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee92 expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.187752:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f000, rc 0) 00000100:00100000:1.0:1787826023.187843:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:155735:x1874663042930944:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1606us (1874us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826023.187853:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 773 00000100:00100000:3.0:1787826023.197476:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.197656:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042931072 00000100:00100000:1.0:1787826023.197670:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042931072 00000100:00100000:1.0:1787826023.197753:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 774 00000100:00100000:1.0:1787826023.197766:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:155735:x1874663042931072:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826023.197793:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.197821:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec0c0 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ee99 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.197908:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.197928:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.197941:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.197955:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.197963:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.197969:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198035:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198043:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198051:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198056:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ea00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.198062:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198070:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198083:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.198086:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.198092:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198097:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec0c7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198112:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198119:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198124:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198129:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.198132:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198138:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198145:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826023.198147:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.198150:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198157:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec0ce lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198187:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec0c0 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee99 expref: 12 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198198:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.198200:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.198203:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec0c0 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ee99 expref: 12 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.198213:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ee00, rc 0) 00000100:00100000:1.0:1787826023.198293:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:155735:x1874663042931072:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 530us (840us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826023.198302:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 774 00000100:00100000:3.0:1787826023.237903:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.238380:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042931200 00000100:00100000:0.0:1787826023.238405:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042931200 00000100:00100000:0.0:1787826023.238481:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 775 00000100:00100000:0.0:1787826023.238494:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:155735:x1874663042931200:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826023.238522:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.238552:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eea0 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.238650:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec0dc lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.238670:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec0dc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.238690:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec0dc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826023.238759:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:0.0:1787826023.238764:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826023.238791:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec0dc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.238821:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eea0 expref: 13 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.238843:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec0dc lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eea0 expref: 12 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.238854:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.238857:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826023.238862:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569400, rc 0) 00000100:00100000:0.0:1787826023.238939:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:155735:x1874663042931200:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 446us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.238948:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 775 00000100:00100000:3.0:1787826023.249706:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.249813:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042931456 00000100:00100000:2.0:1787826023.249827:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042931456 00000100:00100000:2.0:1787826023.249893:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 776 00000100:00100000:2.0:1787826023.249903:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:155735:x1874663042931456:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:2.0:1787826023.249973:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.250017:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec0dc lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eea0 expref: 12 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.250037:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826023.250044:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826023.250124:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.250141:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.250153:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.250179:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.250187:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.250200:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826023.251283:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].454, 2152 off696184 00000040:00080000:2.0:1787826023.251413:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].325, 2352 off539280 00000004:00080000:2.0:1787826023.251421:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172840 with version 698 00000004:00080000:2.0:1787826023.251461:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 698 rpc_version 698 00000020:00100000:2.0:1787826023.251506:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.251519:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34bdf7b80 x1874663049186944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.251550:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf7b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049186944:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.251661:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.251703:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.251738:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049186944 00000100:00100000:2.0:1787826023.251747:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049186944 00000100:00100000:2.0:1787826023.251797:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12447 00000100:00100000:2.0:1787826023.251807:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187924:x1874663049186944:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.252253:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187924:x1874663049186944:12345-0@lo:1000:osp_up1-0.0 Request processed in 445us (591us total) trans 17179869880 rc 0/0 00000100:00100000:2.0:1787826023.252263:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12447 00000100:00100000:2.0:1787826023.252400:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf7b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049186944:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.252465:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049187072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826023.252501:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.252546:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049187072 00000100:00100000:2.0:1787826023.252551:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049187072 00000100:00100000:2.0:1787826023.252598:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5681 00000100:00100000:2.0:1787826023.252606:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049187072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826023.252633:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00010000:00010000:3.0:1787826023.253777:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826023.254903:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049187200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826023.255068:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.255076:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049187456:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.255143:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049187712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.255164:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.255197:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.255222:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049187968:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.255238:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049188224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.255272:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.255300:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049188480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.255363:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.255380:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049188992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826023.255411:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.255442:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826023.255450:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049187584:0@lo:400:kworker.0 00000100:00100000:0.0:1787826023.255468:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049187712 00000100:00100000:0.0:1787826023.255482:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049187712 00000100:00100000:1.0:1787826023.255482:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.255514:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049188096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.255549:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.255554:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049187968 00000100:00100000:0.0:1787826023.255561:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049187968 00000100:00100000:1.0:1787826023.255573:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049188608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826023.255602:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049187584 00000100:00100000:0.0:1787826023.255610:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049187584 00000100:00100000:1.0:1787826023.255610:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.255653:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787826023.255668:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049187712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.255680:0:187896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049187456 00000100:00100000:1.0:1787826023.255690:0:187896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049187456 00000100:00100000:1.0:1787826023.255740:0:187896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787826023.255749:0:187896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049187456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.255807:0:187896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049187456:12345-0@lo:400:kworker.0 Request processed in 58us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.255815:0:187896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787826023.255830:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.255867:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049188480 00000100:00100000:3.0:1787826023.255870:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049188736:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.255874:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049188480 00000100:00100000:3.0:1787826023.255916:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.255922:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12448 00000100:00100000:1.0:1787826023.255933:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049188480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.255940:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787826023.255953:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049187328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826023.256606:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049188096 00000100:00100000:2.0:1787826023.256613:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049188096 00000100:00100000:2.0:1787826023.256672:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049188608 00000100:00100000:2.0:1787826023.256677:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049188608 00000100:00100000:2.0:1787826023.256831:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049188224 00000100:00100000:2.0:1787826023.256835:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049188224 00000100:00100000:2.0:1787826023.256861:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6902 00000100:00100000:2.0:1787826023.256869:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049188096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.262102:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049188480:12345-0@lo:400:kworker.0 Request processed in 6162us (6728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.262119:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12448 00000100:00100000:3.0:1787826023.262144:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.262177:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049187200 00000100:00100000:1.0:1787826023.262187:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049187200 00000100:00100000:1.0:1787826023.262220:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049188992 00000100:00100000:1.0:1787826023.262222:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049188992 00000100:00100000:1.0:1787826023.262234:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049187328 00000100:00100000:1.0:1787826023.262237:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049187328 00000100:00100000:1.0:1787826023.262250:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5682 00000100:00100000:1.0:1787826023.262257:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049187200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826023.262279:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826023.272428:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049187200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10162us (17353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.272443:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5682 00000100:00100000:1.0:1787826023.272488:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5683 00000100:00100000:1.0:1787826023.272501:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049188992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826023.272532:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826023.272578:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049188992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (17167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.272584:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5683 00000100:00100000:1.0:1787826023.272598:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5684 00000100:00100000:1.0:1787826023.272605:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049187328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826023.272616:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826023.272654:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049187328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (10520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.272663:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5684 00000100:00100000:1.0:1787826023.272698:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6903 00000100:00100000:1.0:1787826023.272706:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049188608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.272743:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049188608:12345-0@lo:400:kworker.0 Request processed in 38us (17136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.272749:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6903 00000100:00100000:1.0:1787826023.272766:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6904 00000100:00100000:1.0:1787826023.272773:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049188224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.272802:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049188224:12345-0@lo:400:kworker.0 Request processed in 29us (16977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.272808:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6904 00000100:00100000:1.0:1787826023.272875:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049188608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.272888:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049187456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.272912:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049188480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.272923:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975533 gen 2 00000100:00100000:1.0:1787826023.272944:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049188992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826023.272975:0:187906:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787826023.272983:0:187906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787826023.273131:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049188736 00000100:00100000:1.0:1787826023.273139:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049188736 00000100:00100000:1.0:1787826023.273170:0:187906:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787826023.273176:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787826023.273182:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049187968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.273221:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049187968:12345-0@lo:400:kworker.0 Request processed in 39us (17950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.273227:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787826023.273239:0:187906:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787826023.273245:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787826023.273250:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049187584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.273278:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049187584:12345-0@lo:400:kworker.0 Request processed in 27us (17798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.273284:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787826023.273293:0:187906:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787826023.273299:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787826023.273304:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049188736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.273355:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049188736:12345-0@lo:400:kworker.0 Request processed in 51us (17445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.273360:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787826023.273387:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049187584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826023.273398:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049187968:0@lo:400:kworker.0 00000100:00100000:0.0:1787826023.276445:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049187712:12345-0@lo:400:kworker.0 Request processed in 20764us (21232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.276467:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787826023.278105:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826023.278119:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826023.278124:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826023.278128:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826023.278429:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049187328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826023.278447:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049187840:0@lo:400:kworker.0 00010000:00010000:0.0:1787826023.278493:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.278514:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.278529:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.278531:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826023.278559:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.278568:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.278575:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.278577:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049188352:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.278610:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826023.278634:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.278652:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049188864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826023.278681:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.278851:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049187712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.278867:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049188224:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.278882:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049188736:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.278902:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049187200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787826023.279110:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.279125:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.279148:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049189120:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826023.279181:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.279204:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.279794:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049187840 00000100:00100000:3.0:1787826023.279805:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049187840 00000100:00100000:3.0:1787826023.279888:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049188352 00000100:00100000:3.0:1787826023.279892:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049188352 00000100:00100000:3.0:1787826023.279910:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787826023.279919:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049187840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826023.280034:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049187072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 27425us (27530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.280045:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5681 00000100:00100000:1.0:1787826023.280211:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787826023.280238:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049188352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.280868:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049187840:12345-0@lo:400:kworker.0 Request processed in 944us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.280880:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787826023.281558:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049187840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.281600:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049188864 00000100:00100000:3.0:1787826023.281608:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049188864 00000100:00100000:3.0:1787826023.281663:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049189120 00000100:00100000:3.0:1787826023.281666:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049189120 00000100:00100000:3.0:1787826023.281684:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12449 00000100:00100000:3.0:1787826023.281704:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049188864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826023.281749:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444909056 avail 1298669568 00000100:00100000:3.0:1787826023.281811:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049188864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (3128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.281818:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12449 00000100:00100000:3.0:1787826023.281854:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049188864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826023.281878:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12450 00000100:00100000:3.0:1787826023.281885:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:188682:x1874663049189120:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826023.281903:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826023.281932:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec106 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec0ff expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.281963:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec106 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec0ff expref: 38 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.281996:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec106 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec0ff expref: 38 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.282006:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x38:0x0].0x0 (ffff8eb481697800) 00010000:00010000:3.0:1787826023.282009:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826023.282014:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19600, rc 0) 00000100:00100000:3.0:1787826023.282051:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:188682:x1874663049189120:12345-0@lo:101:mdt00_003.0 Request processed in 166us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.282061:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12450 00000100:00100000:0.0:1787826023.282130:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049187072:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787826023.282158:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826023.282184:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049189120:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826023.282204:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282219:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.282258:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eaec0bd2 reply state 00000000a3d861d2 transno 335007449196 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282273:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282279:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x38:0x0].0x0 (ffff8eb47f8fea00) 00010000:00010000:0.0:1787826023.282282:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826023.282286:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826023.282293:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282306:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826023.282321:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x38:0x0] 00000004:00010000:0.0:1787826023.282346:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eaec0bd2 reply state 00000000a3d861d2 transno 335007449196 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282354:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282360:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc4:0x0].0x0 (ffff8eb47f8fe400) 00010000:00010000:0.0:1787826023.282362:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826023.282364:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787826023.282370:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc4:0x0]: returning size 4096 00010000:00010000:0.0:1787826023.282382:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282388:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282395:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282401:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.282406:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282415:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282433:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.282435:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.282439:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282445:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec0e3 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.282461:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eaec0bd2 reply state 00000000a3d861d2 transno 335007449196 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282470:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.282476:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826023.282478:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826023.282481:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787826023.282573:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:155735:x1874663042931456:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 32668us (32888us total) trans 335007449196 rc 0/0 00000100:00100000:0.0:1787826023.282581:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 776 00000100:00100000:1.0:1787826023.289430:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049188352:12345-0@lo:400:kworker.0 Request processed in 9196us (10808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.289448:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787826023.292659:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049188352:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.292801:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049188096:12345-0@lo:400:kworker.0 Request processed in 35930us (37253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.292814:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6902 00000100:00100000:1.0:1787826023.292870:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049188096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826023.311220:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.311298:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042931584 00000100:00100000:0.0:1787826023.311312:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042931584 00000100:00100000:0.0:1787826023.311724:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 777 00000100:00100000:0.0:1787826023.311737:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:155743:x1874663042931584:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826023.311772:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.311799:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec10d lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eea7 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.311885:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.311902:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.311916:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.311927:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.311934:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.311940:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.312105:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec122 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.312115:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec122 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.312122:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec122 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826023.314601:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc4:0x0]: returning size 4096 00000004:00200000:0.0:1787826023.314614:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787826023.314665:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec122 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314691:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314698:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314706:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314712:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.314717:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314726:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314745:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.314750:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.314755:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314761:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec114 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314779:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314786:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314793:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314799:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.314802:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314808:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314815:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826023.314818:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.314820:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314826:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec11b lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314874:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec10d lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eea7 expref: 15 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314888:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec122 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eea7 expref: 14 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.314896:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc4:0x0].0x0 (ffff8eb47f8fe400) 00010000:00010000:0.0:1787826023.314899:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826023.314901:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568200, rc 0) 00000100:00100000:0.0:1787826023.315009:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:155743:x1874663042931584:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 3272us (3801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.315021:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 777 00000100:00100000:3.0:1787826023.330577:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.330674:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042931712 00000100:00100000:0.0:1787826023.330689:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042931712 00000100:00100000:0.0:1787826023.330777:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 778 00000100:00100000:0.0:1787826023.330790:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:155743:x1874663042931712:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826023.330818:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.330845:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec129 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eeae expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.330925:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.330943:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.330957:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826023.331135:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x38:0x0]: returning size 4096 00000004:00200000:0.0:1787826023.331143:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826023.331204:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec129 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 16 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.331228:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 15 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.331240:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x38:0x0].0x0 (ffff8eb47f8fea00) 00010000:00010000:0.0:1787826023.331244:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826023.331249:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569e00, rc 0) 00000100:00100000:0.0:1787826023.331521:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:155743:x1874663042931712:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 731us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.331535:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 778 00000100:00100000:3.0:1787826023.343483:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.343992:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042931840 00000100:00100000:0.0:1787826023.344007:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042931840 00000100:00100000:0.0:1787826023.344078:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 779 00000100:00100000:0.0:1787826023.344089:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155743:x1874663042931840:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826023.344115:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.344142:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00cec137 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eeb5 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344233:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344251:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec106 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec0ff expref: 37 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344261:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344304:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec106 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec0ff expref: 37 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.344321:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d15880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049189248:0@lo:104: 00000100:00100000:0.0:1787826023.344421:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.344465:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.344499:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787826023.344512:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049189248 00000100:00100000:0.0:1787826023.344516:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049189248 00000100:00100000:0.0:1787826023.344545:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4745 00000100:00100000:0.0:1787826023.344553:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049189248:12345-0@lo:104: 00010000:00010000:0.0:1787826023.344567:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344624:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826023.344631:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049189248:12345-0@lo:104: Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.344647:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4745 00010000:00010000:0.0:1787826023.344698:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826023.344704:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344712:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569800 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826023.344718:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.344727:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344756:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344763:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826023.344784:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344792:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569800/0x878a5eea00cec0ff lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec106 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.344818:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826023.344820:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826023.344821:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826023.344833:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049189376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826023.344863:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.344899:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049189376 00000100:00100000:0.0:1787826023.344903:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049189376 00010000:00010000:0.0:1787826023.344922:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec106 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec0ff expref: 38 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.344954:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12186 00000100:00100000:0.0:1787826023.344964:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+38:3620:x1874663049189376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826023.344975:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826023.346009:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d15880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049189248:0@lo:104: 00010000:00010000:0.0:1787826023.346036:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826023.351868:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869880 is committed 00010000:00010000:0.0:1787826023.364288:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec106 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec0ff expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.364321:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x38:0x0].0x0 (ffff8eb481697800) 00010000:00010000:0.0:1787826023.364357:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.364371:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.364395:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.364444:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826023.364552:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049189376:12345-0@lo:103:ldlm_bl.0 Request processed in 19588us (19684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.364564:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12186 00010000:00010000:1.0:1787826023.364575:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.364592:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.364653:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049189376:0@lo:103:ldlm_bl.0 00000004:00200000:1.0:1787826023.364771:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x38:0x0]: returning size 4096 00000004:00200000:1.0:1787826023.364779:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826023.364854:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00cec137 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.364876:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.364884:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x38:0x0].0x0 (ffff8eb481697800) 00010000:00010000:1.0:1787826023.364887:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826023.364890:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568c00, rc 0) 00000100:00100000:1.0:1787826023.364968:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155743:x1874663042931840:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 20880us (21502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.364977:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 779 00000100:00100000:2.0:1787826023.376068:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826023.376161:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042932096 00000100:00100000:3.0:1787826023.376171:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042932096 00000100:00100000:3.0:1787826023.376233:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 780 00000100:00100000:3.0:1787826023.376245:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:155743:x1874663042932096:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:3.0:1787826023.376303:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826023.376412:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec122 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eea7 expref: 15 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.376429:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc4:0x0].0x0 (ffff8eb47f8fe400) 00010000:00010000:3.0:1787826023.376433:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826023.377727:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377758:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377772:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377788:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377801:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377807:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377935:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377944:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377951:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.377975:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.378006:0:188992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 14 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.378016:0:188992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 4/0,1 mode: --/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.378084:0:188992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 14 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.378104:0:188992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 14 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.378128:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b44700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188992:1874663049189504:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826023.378253:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.391416:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b44700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188992:1874663049189504:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826023.391456:0:188992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.401112:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.404137:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042932224 00000100:00100000:0.0:1787826023.404157:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042932224 00010000:00010000:0.0:1787826023.404234:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 15 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.404354:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12187 00000100:00100000:0.0:1787826023.404379:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:2392:x1874663042932224:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826023.404402:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826023.404411:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 15 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.404429:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 15 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.404458:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec130 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x38:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeae expref: 15 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.404490:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x38:0x0].0x0 (ffff8eb47f8fea00) 00010000:00010000:0.0:1787826023.404498:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.404508:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.404516:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.404560:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826023.404662:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:2392:x1874663042932224:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 296us (3570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.404671:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12187 00010000:00010000:3.0:1787826023.404740:0:188992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.404749:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.404815:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.404828:0:188992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.404838:0:188992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.404862:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049189632:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787826023.404934:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.404977:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049189632 00000100:00100000:3.0:1787826023.404983:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049189632 00000100:00100000:3.0:1787826023.405019:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12451 00000100:00100000:3.0:1787826023.405026:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188992:x1874663049189632:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787826023.405044:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826023.405060:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cec168 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec161 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.405084:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.405094:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cec168 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec161 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.405121:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.405149:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 6 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.405165:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049189760:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826023.405218:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.405234:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.424085:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.424634:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042932352 00000100:00100000:2.0:1787826023.424659:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042932352 00010000:00010000:2.0:1787826023.424727:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 7 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.424778:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12188 00000100:00100000:2.0:1787826023.424790:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042932352:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826023.424809:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.424817:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 7 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.424833:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 7 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.424865:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x38:0x0].0x0 (ffff8eb481697800) 00010000:00010000:2.0:1787826023.424873:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cec168 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec161 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.424886:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cec168 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec161 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.426819:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cec168 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec161 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.427159:0:6476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cec168 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec161 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.427194:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6476:1874663049189888:0@lo:105: 00000100:00100000:2.0:1787826023.427678:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.427763:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.427844:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049189888 00000100:00100000:2.0:1787826023.427871:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049189888 00000100:00100000:2.0:1787826023.429145:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4746 00000100:00100000:2.0:1787826023.429162:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6476:x1874663049189888:12345-0@lo:105: 00010000:00010000:2.0:1787826023.429181:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.429195:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.429206:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.429223:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.429232:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.429241:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.430609:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab18000) 00000100:00100000:2.0:1787826023.430745:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6476:x1874663049189888:12345-0@lo:105: Request processed in 1584us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.430758:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4746 00000100:00100000:1.0:1787826023.432592:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6476:1874663049189888:0@lo:105: 00010000:00010000:1.0:1787826023.432632:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826023.432819:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042932352:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 7933us (8651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.432834:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12188 00010000:00010000:0.0:1787826023.433992:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cec13e lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeb5 expref: 6 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.434022:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049189760:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826023.434064:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cec168 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec161 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.434078:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x38:0x0].0x0 (ffff8eb481697800) 00010000:00010000:0.0:1787826023.434082:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.434088:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18400, rc 0) 00000100:00100000:0.0:1787826023.434191:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049189632:12345-0@lo:101:mdt00_004.0 Request processed in 29163us (29255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.434200:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12451 00000100:00100000:2.0:1787826023.435078:0:188992:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869880 gen 2 00000004:00080000:2.0:1787826023.435090:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869850 committed transno 17179869880 00000004:00080000:2.0:1787826023.435111:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869851 committed transno 17179869880 00000004:00080000:2.0:1787826023.435122:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869852 committed transno 17179869880 00000004:00080000:2.0:1787826023.435136:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869853 committed transno 17179869880 00000004:00080000:2.0:1787826023.435147:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869854 committed transno 17179869880 00000004:00080000:2.0:1787826023.435158:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869855 committed transno 17179869880 00000004:00080000:2.0:1787826023.435168:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869856 committed transno 17179869880 00000004:00080000:2.0:1787826023.435177:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869857 committed transno 17179869880 00000004:00080000:2.0:1787826023.435187:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869858 committed transno 17179869880 00000004:00080000:2.0:1787826023.435196:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869859 committed transno 17179869880 00000004:00080000:2.0:1787826023.435204:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869860 committed transno 17179869880 00000004:00080000:2.0:1787826023.435212:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869861 committed transno 17179869880 00000004:00080000:2.0:1787826023.435221:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869862 committed transno 17179869880 00000004:00080000:2.0:1787826023.435232:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869863 committed transno 17179869880 00000004:00080000:2.0:1787826023.435239:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869864 committed transno 17179869880 00000004:00080000:2.0:1787826023.435248:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869865 committed transno 17179869880 00000004:00080000:2.0:1787826023.435257:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869866 committed transno 17179869880 00000004:00080000:2.0:1787826023.435656:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869867 committed transno 17179869880 00000004:00080000:2.0:1787826023.435669:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869868 committed transno 17179869880 00000004:00080000:2.0:1787826023.435681:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869869 committed transno 17179869880 00000004:00080000:2.0:1787826023.435993:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869870 committed transno 17179869880 00000004:00080000:2.0:1787826023.436005:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869871 committed transno 17179869880 00000004:00080000:2.0:1787826023.436017:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869872 committed transno 17179869880 00000004:00080000:2.0:1787826023.436027:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869873 committed transno 17179869880 00000004:00080000:2.0:1787826023.436037:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869874 committed transno 17179869880 00000004:00080000:2.0:1787826023.436049:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869875 committed transno 17179869880 00000004:00080000:2.0:1787826023.436061:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869876 committed transno 17179869880 00000004:00080000:2.0:1787826023.436070:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869877 committed transno 17179869880 00000004:00080000:2.0:1787826023.436079:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869878 committed transno 17179869880 00000004:00080000:2.0:1787826023.436091:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869879 committed transno 17179869880 00000004:00080000:2.0:1787826023.436109:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869880 committed transno 17179869880 00000100:00100000:2.0:1787826023.436131:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049189632:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787826023.436165:0:188992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.438742:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049190016:0@lo:403:mdt00_004.0 00000100:00100000:2.0:1787826023.438862:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.438918:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.441427:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049190016 00000100:00100000:1.0:1787826023.441447:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049190016 00000100:00100000:1.0:1787826023.441517:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12452 00000100:00100000:1.0:1787826023.441531:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049190016:12345-0@lo:403:mdt00_004.0 00000100:00100000:0.0:1787826023.447859:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049190016:12345-0@lo:403:mdt00_004.0 Request processed in 6317us (8984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.447878:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12452 00000100:00100000:0.0:1787826023.448494:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049190016:0@lo:403:mdt00_004.0 00000040:00080000:0.0:1787826023.450077:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].455, 656 off696840 00000040:00080000:0.0:1787826023.450361:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].326, 736 off540016 00000004:00080000:0.0:1787826023.450381:0:188992:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925ea80 with version 699 00000004:00080000:0.0:1787826023.453411:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 699 rpc_version 699 00000020:00100000:0.0:1787826023.453495:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826023.453514:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb448d14a80 x1874663049190272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826023.453549:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049190272:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.453657:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.453857:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.453900:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049190272 00000100:00100000:0.0:1787826023.453910:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049190272 00000100:00100000:0.0:1787826023.453985:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12453 00000100:00100000:0.0:1787826023.453997:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049190272:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.454387:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049190272:12345-0@lo:1000:osp_up1-0.0 Request processed in 390us (728us total) trans 17179869881 rc 0/0 00000100:00100000:0.0:1787826023.454396:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12453 00000100:00100000:0.0:1787826023.454475:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049190272:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787826023.455100:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc4:0x0]: returning size 4096 00010000:00010000:0.0:1787826023.455131:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455144:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455153:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455161:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.455166:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455175:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455195:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x38:0x0].0x0 (ffff8eb47f8fea00) 00010000:00010000:0.0:1787826023.455198:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.455204:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 2/0,0 mode: --/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455211:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00cec15a lrc: 0/0,0 mode: --/EX res: [0x200026560:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455232:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455240:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455248:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455284:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826023.455295:0:188992:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x38:0x0] 00010000:00010000:0.0:1787826023.455307:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826023.455313:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455362:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826023.455366:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.455374:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455409:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455416:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826023.455444:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455451:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18000/0x878a5eea00cec161 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec168 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.455471:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826023.455473:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826023.455474:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826023.456065:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826023.456090:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049190400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826023.456166:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826023.456236:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.457415:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049190400 00000100:00100000:3.0:1787826023.457431:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049190400 00010000:00010000:0.0:1787826023.457599:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.457616:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.457623:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ea00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.457628:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.457647:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.457668:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc4:0x0].0x0 (ffff8eb47f8fe400) 00010000:00010000:0.0:1787826023.457671:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.457676:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.457682:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec153 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.457801:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4196 00000100:00100000:3.0:1787826023.457814:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049190400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826023.457834:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826023.457857:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cec168 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec161 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.457876:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x38:0x0].0x0 (ffff8eb481697800) 00010000:00010000:3.0:1787826023.457887:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826023.457969:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049190400:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.457977:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4196 00010000:00010000:0.0:1787826023.458051:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.458060:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.458067:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.458072:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.458074:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.458084:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.458094:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.458096:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.458100:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.458106:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec145 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.458117:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5066072 reply state 000000008d904434 transno 335007449197 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.458131:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.458140:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826023.458142:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826023.458145:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826023.458238:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049190400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826023.458934:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:155743:x1874663042932096:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 82685us (82869us total) trans 335007449197 rc 0/0 00000100:00100000:0.0:1787826023.458943:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 780 00000100:00100000:2.0:1787826023.487306:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.487768:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042932480 00000100:00100000:0.0:1787826023.487783:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042932480 00000100:00100000:0.0:1787826023.487864:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 781 00000100:00100000:0.0:1787826023.487875:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:155746:x1874663042932480:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826023.487914:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.487943:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec16f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eebc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488030:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488052:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488068:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488083:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488091:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488097:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488158:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488166:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488173:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488180:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.488186:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488195:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488210:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.488213:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.488218:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488225:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec176 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488241:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488248:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488254:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488271:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.488274:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488280:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488287:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826023.488290:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.488294:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488301:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec17d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488359:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec16f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eebc expref: 16 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488370:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.488373:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.488377:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec16f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eebc expref: 16 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.488387:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568c00, rc 0) 00000100:00100000:0.0:1787826023.488475:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:155746:x1874663042932480:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 602us (1187us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826023.489757:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 781 00000100:00100000:3.0:1787826023.491209:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.491366:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042932608 00000100:00100000:1.0:1787826023.491384:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042932608 00000100:00100000:1.0:1787826023.491447:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 782 00000100:00100000:1.0:1787826023.491459:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:155746:x1874663042932608:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826023.491620:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.491660:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec184 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eec3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.491883:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.491900:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.491913:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.491925:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.491933:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.491940:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.491992:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492000:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492007:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492013:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.492019:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492031:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492047:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.492050:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.492055:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492062:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec18b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492083:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492090:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492095:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492101:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ea00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.492103:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492109:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492116:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826023.492118:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.492121:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492127:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec192 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492160:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec184 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eec3 expref: 16 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492171:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.492174:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.492178:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec184 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eec3 expref: 16 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.492188:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ec00, rc 0) 00000100:00100000:1.0:1787826023.492287:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:155746:x1874663042932608:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 829us (1087us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826023.492296:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 782 00000100:00100000:3.0:1787826023.495957:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.496130:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042932736 00000100:00100000:0.0:1787826023.496144:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042932736 00000100:00100000:0.0:1787826023.496226:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 783 00000100:00100000:0.0:1787826023.496239:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+15:155746:x1874663042932736:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826023.496274:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.496304:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eeca expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.496438:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec1a0 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.496464:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec1a0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.496477:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec1a0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826023.496558:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:0.0:1787826023.496563:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826023.496588:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec1a0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.496619:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeca expref: 17 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.496653:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec1a0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeca expref: 16 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.496664:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.496668:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826023.496673:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568000, rc 0) 00000100:00100000:0.0:1787826023.496755:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+16:155746:x1874663042932736:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 518us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.496762:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 783 00000100:00100000:3.0:1787826023.507648:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.507821:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042932992 00000100:00100000:0.0:1787826023.507835:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042932992 00000100:00100000:0.0:1787826023.507905:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 784 00000100:00100000:0.0:1787826023.507917:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+16:155746:x1874663042932992:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826023.508001:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826023.508039:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec1a0 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeca expref: 16 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.508065:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.508072:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826023.508149:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.508166:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.508177:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.508189:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.508197:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.508204:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826023.509482:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].456, 2152 off698992 00000040:00080000:0.0:1787826023.509583:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].327, 2352 off542368 00000004:00080000:0.0:1787826023.509590:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925ed80 with version 700 00000004:00080000:1.0:1787826023.509756:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 700 rpc_version 700 00000020:00100000:1.0:1787826023.509809:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.509822:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b46680 x1874663049190656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.509851:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049190656:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.509941:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.509984:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.510133:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049190656 00000100:00100000:2.0:1787826023.510143:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049190656 00000100:00100000:2.0:1787826023.510207:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12454 00000100:00100000:2.0:1787826023.510218:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049190656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.511140:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049190656:12345-0@lo:1000:osp_up1-0.0 Request processed in 918us (1193us total) trans 17179869882 rc 0/0 00000100:00100000:1.0:1787826023.511152:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12454 00000100:00100000:2.0:1787826023.511276:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049190656:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826023.511474:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.511493:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.511513:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.511536:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 3/0,1 mode: --/PW res: [0x200026560:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.511543:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.511550:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.511587:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.511596:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.511606:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.511627:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049190784:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826023.511684:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.511761:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.511804:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049190784 00000100:00100000:2.0:1787826023.511887:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049190784 00000100:00100000:2.0:1787826023.511968:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12455 00000100:00100000:2.0:1787826023.511978:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049190784:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826023.512000:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.512020:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec1ca lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec1c3 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.512045:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec1ca lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec1c3 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.512058:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec1ca lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec1c3 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.512068:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x39:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:2.0:1787826023.512072:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.512077:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511a00, rc 0) 00000100:00100000:2.0:1787826023.512131:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049190784:12345-0@lo:101:mdt00_003.0 Request processed in 154us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.512137:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12455 00000100:00100000:1.0:1787826023.512214:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049190784:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826023.512231:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512241:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826023.512270:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a666c4cb reply state 00000000bd2995a5 transno 335007449198 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512283:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512289:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x39:0x0].0x0 (ffff8eb449543e00) 00010000:00010000:1.0:1787826023.512292:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826023.512295:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826023.512301:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512308:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826023.512319:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x39:0x0] 00000004:00010000:1.0:1787826023.512350:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a666c4cb reply state 00000000bd2995a5 transno 335007449198 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512358:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512364:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc5:0x0].0x0 (ffff8eb449543200) 00010000:00010000:1.0:1787826023.512366:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826023.512368:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826023.512375:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc5:0x0]: returning size 4096 00010000:00010000:1.0:1787826023.512384:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512390:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512397:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512403:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.512408:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512416:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512429:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.512430:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.512434:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512440:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec1a7 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826023.512457:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a666c4cb reply state 00000000bd2995a5 transno 335007449198 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512466:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.512471:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826023.512474:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826023.512476:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826023.512570:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+17:155746:x1874663042932992:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 4652us (4945us total) trans 335007449198 rc 0/0 00000100:00100000:1.0:1787826023.512580:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 784 00000100:00100000:3.0:1787826023.558491:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.558597:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042933120 00000100:00100000:2.0:1787826023.558612:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042933120 00000100:00100000:2.0:1787826023.558702:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 785 00000100:00100000:2.0:1787826023.558716:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+17:155747:x1874663042933120:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826023.558752:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.558781:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec1d1 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eed1 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.558885:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.558906:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.558921:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.558935:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.558945:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.558952:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559065:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec1e6 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559074:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec1e6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559082:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec1e6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826023.559619:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc5:0x0]: returning size 4096 00000004:00200000:2.0:1787826023.559627:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826023.559662:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec1e6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559678:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559686:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559694:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559701:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.559706:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559714:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559730:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826023.559733:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.559738:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559744:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec1d8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559761:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559767:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559773:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559780:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.559783:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559789:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559795:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826023.559797:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.559800:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559805:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec1df lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.559986:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec1d1 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed1 expref: 19 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.560002:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec1e6 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed1 expref: 18 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.560009:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc5:0x0].0x0 (ffff8eb449543200) 00010000:00010000:2.0:1787826023.560011:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826023.560014:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510200, rc 0) 00000100:00100000:2.0:1787826023.560187:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+18:155747:x1874663042933120:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1471us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.560198:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 785 00000100:00100000:3.0:1787826023.568216:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.568373:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042933248 00000100:00100000:1.0:1787826023.568388:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042933248 00000100:00100000:1.0:1787826023.568471:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 786 00000100:00100000:1.0:1787826023.568485:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+18:155747:x1874663042933248:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826023.568513:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.568544:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec1ed lrc: 2/0,0 mode: --/CR res: [0x200026560:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eed8 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.568631:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.568659:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.568672:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826023.568738:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x39:0x0]: returning size 4096 00000004:00200000:1.0:1787826023.568745:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826023.568790:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec1ed lrc: 0/0,0 mode: --/CR res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 20 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.568941:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 19 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.568958:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x39:0x0].0x0 (ffff8eb449543e00) 00010000:00010000:1.0:1787826023.568962:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826023.568966:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ea00, rc 0) 00000100:00100000:1.0:1787826023.570278:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:155747:x1874663042933248:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1784us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.570293:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 786 00000100:00100000:2.0:1787826023.574078:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.574168:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042933376 00000100:00100000:1.0:1787826023.574181:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042933376 00000100:00100000:1.0:1787826023.574271:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 787 00000100:00100000:1.0:1787826023.574285:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155747:x1874663042933376:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826023.574314:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.574373:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec1fb lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eedf expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.574461:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.574481:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec1ca lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec1c3 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.574491:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.574535:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec1ca lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec1c3 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.574555:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b47100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188682:1874663049190912:0@lo:104: 00000100:00100000:1.0:1787826023.574626:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.574692:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.574836:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049190912 00000100:00100000:2.0:1787826023.574841:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049190912 00000100:00100000:2.0:1787826023.574881:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4747 00000100:00100000:2.0:1787826023.574888:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:188682:x1874663049190912:12345-0@lo:104: 00010000:00010000:2.0:1787826023.574904:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.574979:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826023.574985:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:188682:x1874663049190912:12345-0@lo:104: Request processed in 98us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.574993:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4747 00010000:00010000:3.0:1787826023.575119:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826023.575128:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.575137:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569600 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826023.575145:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826023.575155:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.575188:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.575194:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826023.575231:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.575239:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569600/0x878a5eea00cec1c3 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec1ca expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.575275:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826023.575276:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826023.575278:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826023.575287:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826023.575301:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049191040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826023.575376:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.575413:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049191040 00000100:00100000:3.0:1787826023.575418:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049191040 00010000:00010000:3.0:1787826023.575441:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec1ca lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec1c3 expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.575468:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12189 00000100:00100000:3.0:1787826023.575475:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3617:x1874663049191040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826023.575489:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826023.576279:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b47100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188682:1874663049190912:0@lo:104: 00010000:00010000:3.0:1787826023.576313:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826023.578987:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869882 is committed 00010000:00010000:3.0:1787826023.579245:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec1ca lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec1c3 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.579281:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x39:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:3.0:1787826023.579288:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.579299:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.579309:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.579947:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826023.580127:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.580140:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826023.580222:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x39:0x0]: returning size 4096 00000004:00200000:1.0:1787826023.580229:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826023.580303:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec1fb lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.580350:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 7 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.580360:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x39:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:1.0:1787826023.580363:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826023.580367:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f000, rc 0) 00000100:00100000:1.0:1787826023.580453:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155747:x1874663042933376:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 6169us (6388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.580465:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 787 00000100:00100000:3.0:1787826023.580577:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049191040:12345-0@lo:103:ldlm_bl.0 Request processed in 5101us (5199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.580588:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12189 00000100:00100000:3.0:1787826023.584046:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.584227:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042933632 00000100:00100000:2.0:1787826023.584242:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042933632 00000100:00100000:2.0:1787826023.584386:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 788 00000100:00100000:2.0:1787826023.584400:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:155747:x1874663042933632:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:2.0:1787826023.584479:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.584520:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec1e6 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed1 expref: 19 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584549:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc5:0x0].0x0 (ffff8eb449543200) 00010000:00010000:2.0:1787826023.584555:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826023.584587:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584604:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584615:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584631:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584651:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584657:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584768:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584777:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584783:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.584804:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.585124:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 18 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.585133:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 4/0,1 mode: --/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.585177:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 18 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.585200:0:187905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 18 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.585218:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049191168:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826023.585777:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049191040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826023.586129:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.591168:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.591301:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049191168:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826023.591363:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.591628:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042933760 00000100:00100000:0.0:1787826023.591648:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042933760 00010000:00010000:0.0:1787826023.591776:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 19 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.591930:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12190 00000100:00100000:0.0:1787826023.591943:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:2391:x1874663042933760:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826023.591965:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826023.591975:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 19 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.591989:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 19 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.592018:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec1f4 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x39:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eed8 expref: 19 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.592040:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x39:0x0].0x0 (ffff8eb449543e00) 00010000:00010000:0.0:1787826023.592046:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.592058:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.592065:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.592100:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826023.592178:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+18:2391:x1874663042933760:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 237us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.592187:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12190 00010000:00010000:3.0:1787826023.593756:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.593776:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.593863:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.593874:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.593889:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.593919:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049191296:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787826023.594005:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.594055:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.594249:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049191296 00000100:00100000:2.0:1787826023.594267:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049191296 00000100:00100000:2.0:1787826023.594346:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12456 00000100:00100000:2.0:1787826023.594358:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187905:x1874663049191296:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826023.594380:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.594399:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cec22c lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec225 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.594431:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 6 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.594441:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cec22c lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec225 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.594469:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 6 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.594485:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 6 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.594498:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049191424:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826023.594573:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.599131:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.599222:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042933888 00000100:00100000:1.0:1787826023.599237:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042933888 00010000:00010000:1.0:1787826023.599308:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 7 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.599471:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12191 00000100:00100000:2.0:1787826023.599486:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042933888:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826023.599506:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.599515:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 7 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.599532:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 7 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.599563:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x39:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:2.0:1787826023.599571:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cec22c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec225 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.599586:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cec22c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec225 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.599597:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cec22c lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec225 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.599649:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cec22c lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec225 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.599666:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049191552:0@lo:105: 00000100:00100000:2.0:1787826023.599926:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.599987:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172c00 going to sleep for 11 seconds 00010000:00010000:3.0:1787826023.600097:0:177390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec202 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eedf expref: 7 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.600119:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049191424:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826023.600151:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cec22c lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec225 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.600161:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x39:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:3.0:1787826023.600164:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826023.600167:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511e00, rc 0) 00000100:00100000:3.0:1787826023.600228:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049191296:12345-0@lo:101:mdt00_001.0 Request processed in 5873us (6223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.600237:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12456 00000100:00100000:1.0:1787826023.600308:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049191552 00000100:00100000:1.0:1787826023.600315:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049191552 00000100:00100000:1.0:1787826023.600402:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4748 00000100:00100000:1.0:1787826023.600411:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049191552:12345-0@lo:105: 00010000:00010000:1.0:1787826023.600425:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.600436:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.600447:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.600456:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.600464:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.600473:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.600492:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab18400) 00000100:00100000:1.0:1787826023.600533:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049191552:12345-0@lo:105: Request processed in 124us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.600543:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4748 00000100:00100000:2.0:1787826023.600938:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049191552:0@lo:105: 00010000:00010000:2.0:1787826023.600954:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826023.601016:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042933888:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1533us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.601024:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12191 00000100:00100000:2.0:1787826023.601064:0:187905:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869882 gen 2 00000004:00080000:2.0:1787826023.601070:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869881 committed transno 17179869882 00000004:00080000:2.0:1787826023.601092:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869882 committed transno 17179869882 00000100:00100000:2.0:1787826023.601109:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049191296:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826023.601127:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.603549:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049191680:0@lo:403:mdt00_001.0 00000100:00100000:2.0:1787826023.603675:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.603735:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.604297:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049191680 00000100:00100000:3.0:1787826023.604309:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049191680 00000100:00100000:3.0:1787826023.604401:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12457 00000100:00100000:3.0:1787826023.604413:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049191680:12345-0@lo:403:mdt00_001.0 00000100:00100000:2.0:1787826023.608365:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049191680:12345-0@lo:403:mdt00_001.0 Request processed in 3908us (4644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.608393:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12457 00000100:00100000:0.0:1787826023.609532:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049191680:0@lo:403:mdt00_001.0 00000040:00080000:1.0:1787826023.611557:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].457, 656 off699648 00000040:00080000:1.0:1787826023.611962:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].328, 736 off543104 00000004:00080000:1.0:1787826023.611971:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb479b53600 with version 701 00000004:00080000:2.0:1787826023.612100:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 701 rpc_version 701 00000020:00100000:2.0:1787826023.612150:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.612165:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472974e00 x1874663049191936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.612196:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049191936:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.612481:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.612589:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.612658:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049191936 00000100:00100000:3.0:1787826023.612670:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049191936 00000100:00100000:3.0:1787826023.612937:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12458 00000100:00100000:3.0:1787826023.612951:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049191936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826023.613848:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049191936:12345-0@lo:1000:osp_up1-0.0 Request processed in 895us (1364us total) trans 17179869883 rc 0/0 00000100:00100000:3.0:1787826023.613861:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12458 00000100:00100000:1.0:1787826023.614149:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049191936:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826023.614225:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc5:0x0]: returning size 4096 00010000:00010000:2.0:1787826023.614308:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614556:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614568:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614575:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.614581:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614590:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614611:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x39:0x0].0x0 (ffff8eb449543e00) 00010000:00010000:2.0:1787826023.614614:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826023.614620:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 2/0,0 mode: --/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614626:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec21e lrc: 0/0,0 mode: --/EX res: [0x200026560:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614656:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614665:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.614672:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616195:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826023.616220:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x39:0x0] 00010000:00010000:2.0:1787826023.616240:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616252:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616268:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616275:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.616279:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616289:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616308:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc5:0x0].0x0 (ffff8eb449543200) 00010000:00010000:2.0:1787826023.616311:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826023.616316:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616345:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec217 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616373:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616380:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616387:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616392:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.616394:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616400:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616408:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826023.616411:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.616414:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616420:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec209 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826023.616433:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002427bedd reply state 00000000c63b78dd transno 335007449199 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616446:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.616454:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826023.616456:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826023.616460:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826023.616582:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:155747:x1874663042933632:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 32179us (32546us total) trans 335007449199 rc 0/0 00000100:00100000:2.0:1787826023.616593:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 788 00010000:00010000:0.0:1787826023.620781:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826023.620803:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.620818:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826023.620827:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.620838:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.623127:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.623148:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826023.623188:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.623197:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab18400/0x878a5eea00cec225 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec22c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.623232:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.623234:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.623236:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826023.623582:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049192064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826023.623686:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.623920:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049192064 00000100:00100000:2.0:1787826023.623931:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049192064 00000100:00100000:2.0:1787826023.624001:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4197 00000100:00100000:2.0:1787826023.624013:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3619:x1874663049192064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826023.624029:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.624059:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cec22c lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec225 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.624077:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x39:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:2.0:1787826023.624089:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826023.624135:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049192064:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.624143:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4197 00000100:00100000:3.0:1787826023.624238:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049192064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826023.644438:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.644791:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042934016 00000100:00100000:1.0:1787826023.644806:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042934016 00000100:00100000:1.0:1787826023.645412:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 789 00000100:00100000:1.0:1787826023.645429:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:155748:x1874663042934016:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826023.645462:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.645490:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec233 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eee6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645579:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645596:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645609:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645623:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645631:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645648:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645707:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645715:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645722:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645729:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.645735:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645742:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645762:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.645765:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.645770:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645777:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec23a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645796:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645802:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645808:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645812:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.645815:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645820:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645828:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826023.645830:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.645833:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645838:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec241 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645871:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec233 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eee6 expref: 20 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645883:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.645885:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.645889:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec233 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eee6 expref: 20 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.645898:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ec00, rc 0) 00000100:00100000:1.0:1787826023.646212:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:155748:x1874663042934016:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 693us (1695us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826023.646221:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 789 00000100:00100000:3.0:1787826023.650199:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.650296:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042934144 00000100:00100000:0.0:1787826023.650311:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042934144 00000100:00100000:0.0:1787826023.650418:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 790 00000100:00100000:0.0:1787826023.650431:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:155748:x1874663042934144:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826023.650459:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.650486:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec248 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eeed expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650569:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650586:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650600:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650614:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650622:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650628:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650705:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650715:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650722:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650730:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.650736:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650745:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650759:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.650763:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.650769:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650777:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec24f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650794:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650802:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650808:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650814:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.650817:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650823:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650830:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826023.650833:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.650836:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650843:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec256 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650875:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec248 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeed expref: 20 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650886:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.650888:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.650892:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec248 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eeed expref: 20 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.650909:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568000, rc 0) 00000100:00100000:0.0:1787826023.651660:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:155748:x1874663042934144:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1225us (1469us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826023.651672:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 790 00000100:00100000:3.0:1787826023.655068:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.655158:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042934272 00000100:00100000:1.0:1787826023.655175:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042934272 00000100:00100000:1.0:1787826023.655252:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 791 00000100:00100000:1.0:1787826023.655541:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+19:155748:x1874663042934272:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826023.655569:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.655596:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec25d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eef4 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.655729:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec264 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.655748:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec264 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.655763:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec264 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826023.655829:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:1.0:1787826023.655833:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826023.655857:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec264 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.655888:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec25d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eef4 expref: 21 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.655914:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec264 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eef4 expref: 20 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.655925:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.655928:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826023.655932:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f200, rc 0) 00000100:00100000:1.0:1787826023.659757:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+20:155748:x1874663042934272:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 4202us (4683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.659775:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 791 00000100:00100000:3.0:1787826023.663833:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.663988:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042934528 00000100:00100000:1.0:1787826023.664007:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042934528 00000100:00100000:1.0:1787826023.664099:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 792 00000100:00100000:1.0:1787826023.664181:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+20:155748:x1874663042934528:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826023.664270:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826023.664307:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec264 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eef4 expref: 20 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.664367:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.664375:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826023.664461:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.664480:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.664492:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.664505:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.664514:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.664522:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826023.668977:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].458, 2152 off701800 00000040:00080000:1.0:1787826023.669084:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].329, 2352 off545456 00000004:00080000:1.0:1787826023.669092:0:188992:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6b13c0 with version 702 00000004:00080000:2.0:1787826023.669178:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 702 rpc_version 702 00000020:00100000:2.0:1787826023.669231:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.669246:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472974a80 x1874663049192320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.669493:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049192320:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.669594:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.669825:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.669888:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049192320 00000100:00100000:0.0:1787826023.669899:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049192320 00000100:00100000:0.0:1787826023.670006:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12459 00000100:00100000:0.0:1787826023.670018:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049192320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.670919:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049192320:12345-0@lo:1000:osp_up1-0.0 Request processed in 900us (1322us total) trans 17179869884 rc 0/0 00000100:00100000:0.0:1787826023.670931:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12459 00000100:00100000:1.0:1787826023.671083:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049192320:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826023.671302:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.671350:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.671365:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.671388:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.671396:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.671404:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.671450:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.671458:0:188992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.671469:0:188992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.671491:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b59c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049192448:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787826023.671543:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.671968:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.672051:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049192448 00000100:00100000:2.0:1787826023.672060:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049192448 00000100:00100000:2.0:1787826023.672158:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12460 00000100:00100000:2.0:1787826023.672168:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188992:x1874663049192448:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787826023.672191:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.672213:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec28e lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec287 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.672239:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec28e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec287 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.672251:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec28e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec287 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.672271:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3a:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:2.0:1787826023.672274:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.672278:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510a00, rc 0) 00000100:00100000:2.0:1787826023.672345:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188992:x1874663049192448:12345-0@lo:101:mdt00_004.0 Request processed in 178us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.672352:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12460 00000100:00100000:3.0:1787826023.672519:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b59c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049192448:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787826023.672537:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672548:0:188992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826023.672575:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae1f67e7 reply state 0000000094c0da9c transno 335007449200 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672589:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672597:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3a:0x0].0x0 (ffff8eb481697600) 00010000:00010000:3.0:1787826023.672599:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826023.672603:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826023.672610:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672631:0:188992:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826023.672652:0:188992:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3a:0x0] 00000004:00010000:3.0:1787826023.672662:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae1f67e7 reply state 0000000094c0da9c transno 335007449200 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672672:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672679:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc6:0x0].0x0 (ffff8eb481697100) 00010000:00010000:3.0:1787826023.672682:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826023.672684:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826023.672699:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc6:0x0]: returning size 4096 00010000:00010000:3.0:1787826023.672710:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672717:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672724:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672730:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826023.672735:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672743:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672760:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826023.672763:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826023.672767:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672773:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec26b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826023.672790:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae1f67e7 reply state 0000000094c0da9c transno 335007449200 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672797:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.672801:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826023.672803:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826023.672804:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826023.672881:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+21:155748:x1874663042934528:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 8771us (9058us total) trans 335007449200 rc 0/0 00000100:00100000:3.0:1787826023.672887:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 792 00000100:00100000:3.0:1787826023.680196:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826023.680501:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826023.680530:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.680594:0:187895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042934656 00000100:00100000:0.0:1787826023.680607:0:187895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042934656 00000100:00100000:0.0:1787826023.680703:0:187895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:0.0:1787826023.680715:0:187895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042934656:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826023.680801:0:187895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042934656:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.680810:0:187895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:3.0:1787826023.681519:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.681613:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042935040 00000100:00100000:1.0:1787826023.681620:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042935040 00000100:00100000:1.0:1787826023.681676:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 793 00000100:00100000:1.0:1787826023.681688:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+21:155749:x1874663042935040:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826023.681719:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.681749:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec295 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eefb expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.681844:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.681861:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.681875:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.681888:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.681896:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.681903:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682001:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec2aa lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682010:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec2aa lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682017:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec2aa lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682095:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042934784 00000100:00100000:2.0:1787826023.682101:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042934784 00000004:00200000:1.0:1787826023.682122:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc6:0x0]: returning size 4096 00000004:00200000:1.0:1787826023.682128:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1787826023.682151:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042934912 00000004:00010000:1.0:1787826023.682153:0:188682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec2aa lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682154:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042934912 00010000:00010000:1.0:1787826023.682172:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682181:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682186:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6905 00010000:00010000:1.0:1787826023.682189:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682194:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042934784:12345-192.168.203.47@tcp:400:kworker.0 00010000:00010000:1.0:1787826023.682196:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.682201:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682209:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682222:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.682225:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.682230:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682236:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec29c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682250:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042934784:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 58us (2071us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826023.682265:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682266:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6905 00010000:00010000:1.0:1787826023.682271:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682277:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682283:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ec00 already unused, calling callback (ffffffffc1a414f0) 00000100:00100000:2.0:1787826023.682283:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6906 00010000:00010000:1.0:1787826023.682287:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682289:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042934912:12345-192.168.203.47@tcp:400:kworker.0 00010000:00010000:1.0:1787826023.682294:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682301:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826023.682304:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.682307:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682313:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042934912:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (1782us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826023.682314:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec2a3 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.682339:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6906 00010000:00010000:1.0:1787826023.682358:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec295 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eefb expref: 23 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682372:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec2aa lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eefb expref: 22 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.682380:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc6:0x0].0x0 (ffff8eb481697100) 00010000:00010000:1.0:1787826023.682382:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826023.682386:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e600, rc 0) 00000100:00100000:1.0:1787826023.682432:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+22:155749:x1874663042935040:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 748us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.682439:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 793 00000100:00080000:0.0:1787826023.683575:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826023.683585:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826023.690551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.690878:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042935168 00000100:00100000:1.0:1787826023.690892:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042935168 00000100:00100000:1.0:1787826023.690975:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 794 00000100:00100000:1.0:1787826023.690987:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+22:155749:x1874663042935168:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826023.691014:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.691040:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec2b1 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef02 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.691122:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.691139:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.691152:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826023.691217:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x3a:0x0]: returning size 4096 00000004:00200000:1.0:1787826023.691224:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826023.691284:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec2b1 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 24 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.691310:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 23 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.691321:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3a:0x0].0x0 (ffff8eb481697600) 00010000:00010000:1.0:1787826023.691346:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826023.691351:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f400, rc 0) 00000100:00100000:1.0:1787826023.691437:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:155749:x1874663042935168:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 452us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.691449:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 794 00000100:00100000:3.0:1787826023.701139:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.701254:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042935296 00000100:00100000:2.0:1787826023.701279:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042935296 00000100:00100000:2.0:1787826023.701400:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 795 00000100:00100000:2.0:1787826023.701414:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155749:x1874663042935296:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826023.701441:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.701468:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec2bf lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef09 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.701549:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.701568:0:188992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec28e lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec287 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.701578:0:188992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.701622:0:188992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec28e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec287 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.701651:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:188992:1874663049192576:0@lo:104: 00000100:00100000:2.0:1787826023.701852:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.701938:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.705040:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049192576 00000100:00100000:1.0:1787826023.705061:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049192576 00000100:00100000:1.0:1787826023.705608:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4749 00000100:00100000:1.0:1787826023.705626:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188992:x1874663049192576:12345-0@lo:104: 00010000:00010000:1.0:1787826023.705661:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.705951:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826023.705960:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188992:x1874663049192576:12345-0@lo:104: Request processed in 339us (4107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.705968:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4749 00000100:00100000:3.0:1787826023.705977:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:188992:1874663049192576:0@lo:104: 00010000:00010000:1.0:1787826023.706031:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826023.706039:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.706050:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19400 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826023.706057:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826023.706068:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.706112:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.706120:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826023.706150:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.706158:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19400/0x878a5eea00cec287 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec28e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.706189:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.706191:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.706192:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826023.706201:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826023.706217:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049192704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826023.706319:0:188992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.706508:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.706555:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049192704 00000100:00100000:1.0:1787826023.706562:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049192704 00010000:00010000:1.0:1787826023.706593:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec28e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec287 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.706622:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12192 00000100:00100000:1.0:1787826023.706632:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3619:x1874663049192704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826023.706657:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787826023.716999:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869884 is committed 00010000:00010000:2.0:1787826023.717183:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec28e lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec287 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.717211:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3a:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:2.0:1787826023.717217:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.717229:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.717237:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.717476:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826023.717631:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049192704:12345-0@lo:103:ldlm_bl.0 Request processed in 10997us (11121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.717652:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12192 00010000:00010000:3.0:1787826023.720124:0:188992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.720148:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826023.720265:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x3a:0x0]: returning size 4096 00000004:00200000:3.0:1787826023.720272:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826023.720402:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec2bf lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 8 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.720431:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.720443:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3a:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:3.0:1787826023.720446:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826023.720451:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:3.0:1787826023.720562:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155749:x1874663042935296:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 19149us (19436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.720575:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 795 00000100:00100000:1.0:1787826023.724118:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049192704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826023.724142:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.724190:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042935552 00000100:00100000:2.0:1787826023.724198:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042935552 00000100:00100000:2.0:1787826023.724266:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 796 00000100:00100000:2.0:1787826023.724278:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:155749:x1874663042935552:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:2.0:1787826023.724372:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.724410:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec2aa lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eefb expref: 23 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724435:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc6:0x0].0x0 (ffff8eb481697100) 00010000:00010000:2.0:1787826023.724442:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826023.724474:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724503:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724518:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724530:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724539:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724545:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724659:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724668:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724675:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724696:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724706:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 22 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724715:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724759:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 22 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.724776:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 22 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.724793:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049192832:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826023.724897:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.733818:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049192832:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826023.733859:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.734794:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.734876:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042935680 00000100:00100000:0.0:1787826023.734886:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042935680 00010000:00010000:0.0:1787826023.734937:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 23 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.734985:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12193 00000100:00100000:0.0:1787826023.734996:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:2391:x1874663042935680:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826023.735015:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826023.735023:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 23 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.735037:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 23 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.735065:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00cec2b8 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef02 expref: 23 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.735083:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3a:0x0].0x0 (ffff8eb481697600) 00010000:00010000:0.0:1787826023.735088:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.735099:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.735108:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.735146:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826023.735215:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+22:2391:x1874663042935680:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 220us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.735223:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12193 00010000:00010000:1.0:1787826023.735367:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.735379:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.735440:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.735450:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.735534:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.735562:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049192960:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787826023.735613:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.736390:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6b1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.736507:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049192960 00000100:00100000:2.0:1787826023.736516:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049192960 00000100:00100000:2.0:1787826023.737194:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12461 00000100:00100000:2.0:1787826023.737210:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049192960:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787826023.737235:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.737279:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec2f0 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec2e9 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.737315:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 6 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.737352:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec2f0 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec2e9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.737392:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 6 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.737410:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 6 pid: 188992 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.737431:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049193088:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826023.737532:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.740773:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826023.740872:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042935808 00000100:00100000:3.0:1787826023.740884:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042935808 00010000:00010000:3.0:1787826023.740936:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 7 pid: 188992 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.740992:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12194 00000100:00100000:3.0:1787826023.741005:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042935808:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826023.741028:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826023.741036:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 7 pid: 188992 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.741051:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 7 pid: 188992 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.741080:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3a:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:3.0:1787826023.741087:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec2f0 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec2e9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.741101:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec2f0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec2e9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.741111:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec2f0 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec2e9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.741160:0:9496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec2f0 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec2e9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.741176:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9496:1874663049193216:0@lo:105: 00000100:00100000:3.0:1787826023.741238:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826023.741299:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.741366:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049193216 00000100:00100000:2.0:1787826023.741370:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049193216 00000100:00100000:2.0:1787826023.741408:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4750 00000100:00100000:2.0:1787826023.741417:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:9496:x1874663049193216:12345-0@lo:105: 00010000:00010000:2.0:1787826023.741430:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.741441:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.741450:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.741458:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.741465:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.741472:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.741487:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb479b3f200) 00000100:00100000:2.0:1787826023.741539:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:9496:x1874663049193216:12345-0@lo:105: Request processed in 122us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.741547:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4750 00000100:00100000:2.0:1787826023.741592:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9496:1874663049193216:0@lo:105: 00010000:00010000:2.0:1787826023.741616:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826023.741675:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042935808:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 672us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.741682:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12194 00010000:00010000:1.0:1787826023.742096:0:177390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec2c6 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef09 expref: 6 pid: 188992 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.742119:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049193088:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826023.742141:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec2f0 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec2e9 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.742151:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3a:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:1.0:1787826023.742154:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826023.742157:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510a00, rc 0) 00000100:00100000:1.0:1787826023.742209:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049192960:12345-0@lo:101:mdt00_000.0 Request processed in 5005us (6595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.742217:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12461 00000100:00100000:0.0:1787826023.742293:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869884 gen 2 00000004:00080000:0.0:1787826023.742300:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869883 committed transno 17179869884 00000004:00080000:0.0:1787826023.742362:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869884 committed transno 17179869884 00000100:00100000:0.0:1787826023.742380:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049192960:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787826023.742397:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.743191:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049193344:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1787826023.743255:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.743285:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.743668:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049193344 00000100:00100000:2.0:1787826023.743679:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049193344 00000100:00100000:2.0:1787826023.743735:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12462 00000100:00100000:2.0:1787826023.743745:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049193344:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787826023.746101:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049193344:12345-0@lo:403:mdt00_000.0 Request processed in 2347us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.746114:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12462 00000100:00100000:0.0:1787826023.746273:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049193344:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1787826023.747461:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].459, 944 off702744 00000040:00080000:0.0:1787826023.747716:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].330, 1024 off546480 00000004:00080000:0.0:1787826023.747724:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34896b780 with version 703 00000004:00080000:2.0:1787826023.748853:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 703 rpc_version 703 00000020:00100000:2.0:1787826023.748907:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.748920:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c142300 x1874663049193600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.748951:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049193600:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.749053:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.749154:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826023.754968:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049193600 00000100:00100000:3.0:1787826023.754992:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049193600 00000100:00100000:0.0:1787826023.755234:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12463 00000100:00100000:0.0:1787826023.755265:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049193600:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.759825:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049193600:12345-0@lo:1000:osp_up1-0.0 Request processed in 4559us (10761us total) trans 17179869885 rc 0/0 00000100:00100000:0.0:1787826023.759845:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12463 00000100:00100000:2.0:1787826023.760128:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049193600:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787826023.760903:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc6:0x0]: returning size 4096 00010000:00010000:0.0:1787826023.760941:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.760956:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.760965:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.760972:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.760978:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.760987:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761009:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3a:0x0].0x0 (ffff8eb481697600) 00010000:00010000:0.0:1787826023.761012:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.761017:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761024:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec2e2 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761047:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761055:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761063:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761101:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826023.761114:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3a:0x0] 00010000:00010000:0.0:1787826023.761123:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761130:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761137:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761142:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.761145:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761152:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761160:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc6:0x0].0x0 (ffff8eb481697100) 00010000:00010000:0.0:1787826023.761163:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.761167:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761173:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec2db lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761190:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761196:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761203:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761208:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.761211:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761217:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761225:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.761228:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.761231:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761236:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec2cd lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.761263:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000115e387f reply state 00000000430a5bad transno 335007449201 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761279:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.761288:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826023.761290:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826023.761294:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826023.761418:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:155749:x1874663042935552:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 37136us (37276us total) trans 335007449201 rc 0/0 00000100:00100000:0.0:1787826023.761428:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 796 00010000:00010000:1.0:1787826023.761721:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826023.761731:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.761739:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826023.761744:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826023.761758:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.761803:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.761810:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826023.761848:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.761855:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f200/0x878a5eea00cec2e9 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec2f0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.761878:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.761880:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.761882:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826023.761892:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826023.761912:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049193728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826023.761986:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.762041:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049193728 00000100:00100000:1.0:1787826023.762051:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049193728 00000100:00100000:1.0:1787826023.762108:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4198 00000100:00100000:1.0:1787826023.762118:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049193728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826023.762134:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826023.762155:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cec2f0 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec2e9 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.762176:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3a:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:1.0:1787826023.762186:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826023.762219:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049193728:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.762227:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4198 00000100:00100000:1.0:1787826023.762290:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049193728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826023.797756:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.797935:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042935936 00000100:00100000:1.0:1787826023.797949:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042935936 00000100:00100000:1.0:1787826023.798036:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 797 00000100:00100000:1.0:1787826023.798048:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:155750:x1874663042935936:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826023.798082:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.798109:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec2f7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef10 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798195:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798214:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798226:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798239:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798264:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798273:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798381:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798390:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798396:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798402:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.798407:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798415:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798430:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.798433:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.798438:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798445:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec2fe lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798462:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798469:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798475:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798481:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.798484:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798490:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798498:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826023.798500:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.798503:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798509:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec305 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798729:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec2f7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef10 expref: 24 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798741:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.798743:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.798747:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec2f7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef10 expref: 24 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.798757:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f200, rc 0) 00000100:00100000:1.0:1787826023.798829:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:155750:x1874663042935936:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 783us (1090us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826023.798839:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 797 00000100:00100000:1.0:1787826023.803880:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826023.807517:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042936064 00000100:00100000:3.0:1787826023.807540:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042936064 00000100:00100000:2.0:1787826023.811369:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 798 00000100:00100000:2.0:1787826023.811403:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:155750:x1874663042936064:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826023.811436:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.811470:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec30c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef17 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811561:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811581:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811595:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811607:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811614:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811619:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811681:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811887:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811894:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811900:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.811906:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811914:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811930:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826023.811933:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.811939:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811946:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec313 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811966:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811972:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811978:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811983:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.811985:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811991:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.811998:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826023.812001:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.812004:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.812010:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec31a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.812043:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec30c lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef17 expref: 24 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.812053:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826023.812055:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.812058:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec30c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef17 expref: 24 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.812067:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:2.0:1787826023.812166:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:155750:x1874663042936064:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 780us (8300us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826023.812174:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 798 00000100:00100000:2.0:1787826023.820009:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.820096:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042936192 00000100:00100000:0.0:1787826023.820109:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042936192 00000100:00100000:0.0:1787826023.820187:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 799 00000100:00100000:0.0:1787826023.820200:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+23:155750:x1874663042936192:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826023.820228:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.820257:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef1e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.820399:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec328 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.820419:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec328 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.820433:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec328 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826023.820501:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:0.0:1787826023.820506:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826023.820533:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec328 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.820566:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef1e expref: 25 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.820589:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec328 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef1e expref: 24 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.820598:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.820602:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826023.820607:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569600, rc 0) 00000100:00100000:0.0:1787826023.820713:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+24:155750:x1874663042936192:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 515us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.820721:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 799 00000100:00100000:3.0:1787826023.825537:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.826277:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042936448 00000100:00100000:0.0:1787826023.826293:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042936448 00000100:00100000:0.0:1787826023.826407:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 800 00000100:00100000:0.0:1787826023.826420:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+24:155750:x1874663042936448:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826023.826496:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826023.826533:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec328 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef1e expref: 24 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.826559:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.826566:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826023.826846:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.826864:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.826876:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.826890:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.826900:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.826907:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826023.830218:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].460, 2152 off704896 00000040:00080000:0.0:1787826023.835977:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].331, 2352 off548832 00000004:00080000:0.0:1787826023.835997:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3436a5a80 with version 704 00000004:00080000:2.0:1787826023.836317:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 704 rpc_version 704 00000020:00100000:2.0:1787826023.836447:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826023.836461:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c143800 x1874663049193984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826023.836488:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049193984:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826023.836558:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.836801:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.837171:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049193984 00000100:00100000:0.0:1787826023.837186:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049193984 00000100:00100000:0.0:1787826023.837278:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12464 00000100:00100000:0.0:1787826023.837290:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049193984:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.838880:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049193984:12345-0@lo:1000:osp_up1-0.0 Request processed in 1582us (2311us total) trans 17179869886 rc 0/0 00000100:00100000:0.0:1787826023.838896:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12464 00000100:00100000:2.0:1787826023.840995:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049193984:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826023.841236:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.841414:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.841430:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.841457:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.841466:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.841472:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.841520:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.841528:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.841539:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.841566:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049194112:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826023.841669:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.841834:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.841987:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049194112 00000100:00100000:1.0:1787826023.841998:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049194112 00000100:00100000:1.0:1787826023.842066:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12465 00000100:00100000:1.0:1787826023.842078:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049194112:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826023.842104:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.842127:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec352 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec34b expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.842154:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec352 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec34b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.842168:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec352 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec34b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.842178:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3b:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:1.0:1787826023.842181:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.842185:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f200, rc 0) 00000100:00100000:1.0:1787826023.842416:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049194112:12345-0@lo:101:mdt00_003.0 Request processed in 339us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.842424:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12465 00000100:00100000:2.0:1787826023.842539:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049194112:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826023.842559:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842573:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826023.842604:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1bccca1 reply state 00000000f2dad4a2 transno 335007449202 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842631:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842648:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3b:0x0].0x0 (ffff8eb449543100) 00010000:00010000:2.0:1787826023.842651:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826023.842655:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826023.842663:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842671:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826023.842684:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3b:0x0] 00000004:00010000:2.0:1787826023.842828:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1bccca1 reply state 00000000f2dad4a2 transno 335007449202 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842839:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842846:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc7:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:2.0:1787826023.842848:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826023.842852:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787826023.842860:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc7:0x0]: returning size 4096 00010000:00010000:2.0:1787826023.842871:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842878:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842886:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842892:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.842898:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842906:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842918:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826023.842920:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.842924:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842930:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec32f lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826023.842950:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1bccca1 reply state 00000000f2dad4a2 transno 335007449202 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842960:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.842966:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826023.842969:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826023.842972:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787826023.843191:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+25:155750:x1874663042936448:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 16771us (17670us total) trans 335007449202 rc 0/0 00000100:00100000:2.0:1787826023.843201:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 800 00000100:00100000:3.0:1787826023.860061:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.860200:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042936576 00000100:00100000:2.0:1787826023.860214:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042936576 00000100:00100000:2.0:1787826023.860313:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 801 00000100:00100000:2.0:1787826023.860367:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+25:155751:x1874663042936576:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826023.860402:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.860429:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec359 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef25 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860516:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860534:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860546:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860558:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860566:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860573:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860691:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec36e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860700:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec36e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860708:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec36e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826023.860820:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc7:0x0]: returning size 4096 00000004:00200000:2.0:1787826023.860827:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826023.860851:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec36e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860865:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860873:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860880:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860886:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.860891:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860898:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860912:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826023.860916:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.860922:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860928:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec360 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860944:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860950:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860956:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860962:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826023.860965:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860970:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860977:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826023.860979:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826023.860982:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.860988:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec367 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.861014:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec359 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef25 expref: 27 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.861029:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec36e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef25 expref: 26 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.861037:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc7:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:2.0:1787826023.861039:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826023.861042:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00000100:00100000:2.0:1787826023.861131:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+26:155751:x1874663042936576:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 808us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.861140:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 801 00000100:00100000:1.0:1787826023.864056:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.864233:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042936704 00000100:00100000:2.0:1787826023.864256:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042936704 00000100:00100000:2.0:1787826023.865893:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 802 00000100:00100000:2.0:1787826023.865909:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+26:155751:x1874663042936704:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826023.865935:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.865965:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec375 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef2c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.866047:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 3/1,0 mode: --/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.866064:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.866077:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826023.866144:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x3b:0x0]: returning size 4096 00000004:00200000:2.0:1787826023.866151:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826023.866192:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec375 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 28 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.866215:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 27 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.866224:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3b:0x0].0x0 (ffff8eb449543100) 00010000:00010000:2.0:1787826023.866227:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826023.866231:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:2.0:1787826023.866321:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155751:x1874663042936704:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 413us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.866365:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 802 00000100:00100000:3.0:1787826023.871778:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.871942:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042936832 00000100:00100000:2.0:1787826023.871955:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042936832 00000100:00100000:2.0:1787826023.872040:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 803 00000100:00100000:2.0:1787826023.872053:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155751:x1874663042936832:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826023.872082:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.872110:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cec383 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef33 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.872195:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.872214:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec352 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec34b expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.872225:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.872291:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec352 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec34b expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.872310:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188682:1874663049194240:0@lo:104: 00000100:00100000:2.0:1787826023.872420:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826023.872470:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.872549:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049194240 00000100:00100000:1.0:1787826023.872555:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049194240 00000100:00100000:1.0:1787826023.872596:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4751 00000100:00100000:1.0:1787826023.872604:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188682:x1874663049194240:12345-0@lo:104: 00010000:00010000:1.0:1787826023.872628:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.872707:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826023.872714:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188682:x1874663049194240:12345-0@lo:104: Request processed in 112us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.872721:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4751 00010000:00010000:1.0:1787826023.872746:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826023.872752:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.872761:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826023.872767:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826023.872776:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.872805:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.872813:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826023.872835:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.872843:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a569200/0x878a5eea00cec34b lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec352 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.872869:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.872871:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.872873:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826023.872885:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049194368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826023.872919:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.872954:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049194368 00000100:00100000:1.0:1787826023.872958:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049194368 00010000:00010000:1.0:1787826023.872978:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec352 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec34b expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.873004:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12195 00000100:00100000:1.0:1787826023.873011:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3618:x1874663049194368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826023.873027:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826023.873876:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188682:1874663049194240:0@lo:104: 00010000:00010000:3.0:1787826023.873905:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826023.876986:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869886 is committed 00010000:00010000:0.0:1787826023.884596:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec352 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec34b expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.884705:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3b:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:0.0:1787826023.884713:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.884724:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.884733:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.884854:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826023.884979:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049194368:12345-0@lo:103:ldlm_bl.0 Request processed in 11965us (12055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.884991:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12195 00000100:00100000:1.0:1787826023.885855:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049194368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826023.887182:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.887202:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826023.887939:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x3b:0x0]: returning size 4096 00000004:00200000:3.0:1787826023.887950:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826023.888025:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cec383 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.888051:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 7 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.888061:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3b:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:3.0:1787826023.888064:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826023.888068:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511800, rc 0) 00000100:00100000:3.0:1787826023.888227:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155751:x1874663042936832:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 16175us (16464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.888240:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 803 00000100:00100000:1.0:1787826023.892999:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.893112:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042937088 00000100:00100000:0.0:1787826023.893126:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042937088 00000100:00100000:0.0:1787826023.893254:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 804 00000100:00100000:0.0:1787826023.893275:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155751:x1874663042937088:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:0.0:1787826023.893616:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826023.893674:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec36e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef25 expref: 27 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893710:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc7:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:0.0:1787826023.893717:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826023.893752:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893770:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893783:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893797:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893807:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893815:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893936:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893945:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893952:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893975:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893986:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 26 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.893996:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.894045:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 26 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.894065:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 26 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.894082:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049194496:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826023.894349:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.899217:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826023.899539:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042937216 00000100:00100000:2.0:1787826023.899553:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042937216 00010000:00010000:2.0:1787826023.899612:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 27 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.899749:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12196 00000100:00100000:2.0:1787826023.899763:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:2392:x1874663042937216:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826023.899783:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826023.899792:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 27 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.899806:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 27 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.899835:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3b:0x0].0x0 (ffff8eb449543100) 00010000:00010000:2.0:1787826023.899841:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.899852:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.899864:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.899887:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826023.900001:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:2392:x1874663042937216:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 240us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.900011:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12196 00010000:00010000:0.0:1787826023.900175:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec37c lrc: 0/0,0 mode: --/PR res: [0x200026560:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef2c expref: 26 pid: 187905 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.900197:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049194496:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826023.900222:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.900232:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.900238:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.900315:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.900343:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.900356:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.900381:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049194624:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1787826023.900442:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.900472:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.900723:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049194624 00000100:00100000:2.0:1787826023.900730:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049194624 00000100:00100000:2.0:1787826023.900776:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12466 00000100:00100000:2.0:1787826023.900784:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049194624:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787826023.900804:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826023.900824:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec3b4 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec3ad expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.900852:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 6 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.900862:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec3b4 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec3ad expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.900890:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 6 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826023.900905:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 6 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826023.900923:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049194752:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826023.900978:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826023.905443:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.905649:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042937344 00000100:00100000:1.0:1787826023.905663:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042937344 00010000:00010000:1.0:1787826023.905731:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 7 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.905782:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12197 00000100:00100000:1.0:1787826023.905795:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042937344:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826023.905816:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826023.905825:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 7 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.905842:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 7 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.905872:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3b:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:1.0:1787826023.905879:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec3b4 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec3ad expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.905893:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec3b4 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec3ad expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.905906:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec3b4 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec3ad expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.905950:0:8420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec3b4 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec3ad expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826023.905967:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8420:1874663049194880:0@lo:105: 00000100:00100000:1.0:1787826023.906034:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.906129:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6b1c00 going to sleep for 11 seconds 00010000:00010000:0.0:1787826023.906435:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cec38a lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef33 expref: 7 pid: 188682 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.906456:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049194752:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826023.906486:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec3b4 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec3ad expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.906495:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3b:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:0.0:1787826023.906498:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.906501:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511a00, rc 0) 00000100:00100000:0.0:1787826023.906555:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049194624:12345-0@lo:101:mdt00_000.0 Request processed in 5770us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.906564:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12466 00000100:00100000:1.0:1787826023.906664:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869886 gen 2 00000004:00080000:1.0:1787826023.906671:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869885 committed transno 17179869886 00000004:00080000:1.0:1787826023.906706:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869886 committed transno 17179869886 00000100:00100000:1.0:1787826023.906724:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049194624:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787826023.906742:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.906754:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826023.906895:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787826023.906914:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049194880 00000100:00100000:3.0:1787826023.906921:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049194880 00000100:00100000:3.0:1787826023.906967:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4752 00000100:00100000:3.0:1787826023.906975:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8420:x1874663049194880:12345-0@lo:105: 00010000:00010000:3.0:1787826023.906985:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.906996:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.907005:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.907012:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.907020:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.907028:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.907086:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34a568400) 00000100:00100000:3.0:1787826023.907143:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8420:x1874663049194880:12345-0@lo:105: Request processed in 169us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826023.907149:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4752 00000100:00100000:2.0:1787826023.907438:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8420:1874663049194880:0@lo:105: 00010000:00010000:2.0:1787826023.907452:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826023.907514:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042937344:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1719us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826023.907523:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12197 00010000:00010000:0.0:1787826023.908619:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.908768:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826023.910001:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049195008:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1787826023.910102:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826023.910213:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826023.910503:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049195008 00000100:00100000:1.0:1787826023.910514:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049195008 00000100:00100000:1.0:1787826023.910605:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12467 00000100:00100000:1.0:1787826023.910616:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049195008:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787826023.913935:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049195008:12345-0@lo:403:mdt00_000.0 Request processed in 3304us (3817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.913952:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12467 00000100:00100000:2.0:1787826023.914059:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049195008:0@lo:403:mdt00_000.0 00000040:00080000:2.0:1787826023.915918:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].461, 656 off705552 00000040:00080000:2.0:1787826023.916155:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].332, 736 off549568 00000004:00080000:2.0:1787826023.916163:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172c00 with version 705 00000004:00080000:1.0:1787826023.916598:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 705 rpc_version 705 00000020:00100000:1.0:1787826023.916653:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826023.916666:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b43800 x1874663049195264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826023.916707:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049195264:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826023.916807:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.916847:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826023.917048:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049195264 00000100:00100000:0.0:1787826023.917058:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049195264 00000100:00100000:0.0:1787826023.917127:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12468 00000100:00100000:0.0:1787826023.917139:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049195264:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826023.917566:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049195264:12345-0@lo:1000:osp_up1-0.0 Request processed in 427us (757us total) trans 17179869887 rc 0/0 00000100:00100000:0.0:1787826023.917576:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12468 00000100:00100000:1.0:1787826023.918183:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049195264:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787826023.920764:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc7:0x0]: returning size 4096 00010000:00010000:0.0:1787826023.920809:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920824:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920834:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920841:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.920847:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920856:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920881:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3b:0x0].0x0 (ffff8eb449543100) 00010000:00010000:0.0:1787826023.920884:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.920890:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920897:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3a6 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920923:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920932:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920940:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920968:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826023.920981:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3b:0x0] 00010000:00010000:0.0:1787826023.920991:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.920997:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921003:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921009:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.921012:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921019:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921028:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc7:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:0.0:1787826023.921030:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826023.921034:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921039:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec39f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921058:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921065:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921070:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921075:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826023.921078:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921085:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921093:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.921095:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826023.921099:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921109:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec391 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826023.921122:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce3b24b9 reply state 00000000d95d8d63 transno 335007449203 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921136:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.921143:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826023.921145:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826023.921149:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826023.921284:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155751:x1874663042937088:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 28006us (28295us total) trans 335007449203 rc 0/0 00000100:00100000:0.0:1787826023.921295:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 804 00010000:00010000:1.0:1787826023.921618:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826023.921628:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.921646:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826023.921651:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826023.921660:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.921718:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.921725:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826023.921758:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.921766:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34a568400/0x878a5eea00cec3ad lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec3b4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.921790:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.921791:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826023.921794:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826023.921803:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826023.921823:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049195392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826023.921895:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826023.921954:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049195392 00000100:00100000:1.0:1787826023.921963:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049195392 00000100:00100000:1.0:1787826023.922023:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4199 00000100:00100000:1.0:1787826023.922035:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049195392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826023.922050:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826023.922071:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cec3b4 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec3ad expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.922085:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3b:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:1.0:1787826023.922095:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826023.922127:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049195392:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826023.922134:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4199 00000100:00100000:1.0:1787826023.922177:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049195392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826023.944623:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.944850:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042937472 00000100:00100000:1.0:1787826023.944864:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042937472 00000100:00100000:1.0:1787826023.944953:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 805 00000100:00100000:1.0:1787826023.944967:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155752:x1874663042937472:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826023.945002:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826023.945028:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3bb lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef3a expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.945113:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.945129:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.945141:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.945153:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.945161:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.945167:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.945228:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.945237:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946355:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946372:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.946378:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946388:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946407:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.946410:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.946416:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946423:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cec3c2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946446:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946454:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946460:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946466:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826023.946469:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946598:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946608:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826023.946611:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.946615:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946620:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3c9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.946678:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3bb lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef3a expref: 28 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.947585:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.947589:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826023.947597:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3bb lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef3a expref: 28 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.947612:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f200, rc 0) 00000100:00100000:1.0:1787826023.949859:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155752:x1874663042937472:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 4877us (5233us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826023.949877:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 805 00000100:00100000:2.0:1787826023.969084:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826023.969843:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042937600 00000100:00100000:3.0:1787826023.969859:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042937600 00000100:00100000:3.0:1787826023.969950:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 806 00000100:00100000:3.0:1787826023.969963:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155752:x1874663042937600:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826023.969995:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826023.970025:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec3d0 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef41 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970108:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970125:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970138:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970151:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970159:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970166:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970223:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970231:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970238:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970245:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826023.970251:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970272:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970285:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826023.970289:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826023.970293:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970300:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec3d7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970316:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970368:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970384:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970390:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826023.970392:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970399:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970407:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826023.970410:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826023.970414:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970422:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec3de lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970454:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec3d0 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef41 expref: 28 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970465:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826023.970468:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826023.970472:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec3d0 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef41 expref: 28 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826023.970481:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18400, rc 0) 00000100:00100000:3.0:1787826023.970564:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155752:x1874663042937600:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 603us (1494us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826023.970572:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 806 00000100:00100000:2.0:1787826023.981702:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826023.981819:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042937728 00000100:00100000:0.0:1787826023.981834:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042937728 00000100:00100000:0.0:1787826023.981914:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 807 00000100:00100000:0.0:1787826023.981925:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+27:155752:x1874663042937728:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826023.981953:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826023.981979:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef48 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.982068:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3ec lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.982086:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3ec lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.982103:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3ec lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826023.982169:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:0.0:1787826023.982174:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826023.982199:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3ec lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.982230:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef48 expref: 29 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.982252:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3ec lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef48 expref: 28 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826023.983866:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826023.983870:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826023.983875:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568800, rc 0) 00000100:00100000:0.0:1787826023.983992:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+28:155752:x1874663042937728:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 2063us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826023.984004:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 807 00000100:00100000:0.0:1787826023.997651:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826023.997822:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042937984 00000100:00100000:1.0:1787826023.997836:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042937984 00000100:00100000:1.0:1787826023.997913:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 808 00000100:00100000:1.0:1787826023.997926:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+28:155752:x1874663042937984:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826023.998002:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826023.998037:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568800/0x878a5eea00cec3ec lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef48 expref: 28 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.998061:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826023.998067:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826023.998142:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.998158:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.998169:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.998180:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.998190:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826023.998196:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826024.000435:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].462, 2152 off707704 00000040:00080000:0.0:1787826024.000559:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].333, 2352 off551920 00000004:00080000:0.0:1787826024.000569:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6b10c0 with version 706 00000004:00080000:1.0:1787826024.000669:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 706 rpc_version 706 00000020:00100000:1.0:1787826024.000788:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826024.000802:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477dd7480 x1874663049195648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826024.000832:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049195648:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826024.000925:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.001006:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.001063:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049195648 00000100:00100000:0.0:1787826024.001074:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049195648 00000100:00100000:0.0:1787826024.001176:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12469 00000100:00100000:0.0:1787826024.001189:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049195648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826024.001988:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049195648:12345-0@lo:1000:osp_up1-0.0 Request processed in 798us (1059us total) trans 17179869888 rc 0/0 00000100:00100000:0.0:1787826024.001998:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12469 00000100:00100000:2.0:1787826024.002153:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049195648:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826024.002422:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.002443:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.002456:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.002479:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.002486:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.002494:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.002533:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.002541:0:187906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.002551:0:187906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.002572:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187906:1874663049195776:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787826024.002620:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.003064:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049195776 00000100:00100000:1.0:1787826024.003074:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049195776 00000100:00100000:1.0:1787826024.003139:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12470 00000100:00100000:1.0:1787826024.003150:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187906:x1874663049195776:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787826024.003174:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.003200:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00cec416 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec40f expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.003228:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00cec416 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec40f expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.003243:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00cec416 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec40f expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.003266:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3c:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:1.0:1787826024.003269:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.003274:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e200, rc 0) 00000100:00100000:1.0:1787826024.003319:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187906:x1874663049195776:12345-0@lo:101:mdt00_002.0 Request processed in 171us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.003349:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12470 00000100:00100000:3.0:1787826024.003497:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.003528:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187906:1874663049195776:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787826024.003552:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.003563:0:187906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826024.003595:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d56182df reply state 000000000ff10dc4 transno 335007449204 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.003610:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.003618:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3c:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:3.0:1787826024.003621:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826024.003625:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826024.003642:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.003651:0:187906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826024.003664:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3c:0x0] 00000004:00010000:3.0:1787826024.003672:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d56182df reply state 000000000ff10dc4 transno 335007449204 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.003681:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.004905:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc8:0x0].0x0 (ffff8eb481697300) 00010000:00010000:3.0:1787826024.004910:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826024.004914:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826024.004924:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc8:0x0]: returning size 4096 00010000:00010000:3.0:1787826024.004939:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.004946:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.004954:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.004959:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.004964:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.004977:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.004991:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.004993:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.004998:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.005004:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec3f3 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826024.005025:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d56182df reply state 000000000ff10dc4 transno 335007449204 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.005037:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.005043:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826024.005045:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826024.005046:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826024.005186:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+29:155752:x1874663042937984:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 7258us (7555us total) trans 335007449204 rc 0/0 00000100:00100000:3.0:1787826024.005195:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 808 00000100:00100000:2.0:1787826024.032537:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826024.032669:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042938112 00000100:00100000:1.0:1787826024.032682:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042938112 00000100:00100000:1.0:1787826024.032782:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 809 00000100:00100000:1.0:1787826024.032795:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+29:155753:x1874663042938112:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826024.032826:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.032853:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec41d lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef4f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.032932:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.032948:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.032961:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.032972:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.032980:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.032986:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033079:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec432 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033087:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec432 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033094:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec432 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826024.033194:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc8:0x0]: returning size 4096 00000004:00200000:1.0:1787826024.033200:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787826024.033223:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec432 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033238:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033244:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033252:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033272:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.033277:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033285:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033299:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826024.033303:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.033308:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033314:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec424 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033384:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033391:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033397:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033402:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.033405:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033411:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033418:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826024.033421:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.033424:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033430:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec42b lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033460:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec41d lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef4f expref: 31 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033473:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec432 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef4f expref: 30 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.033480:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc8:0x0].0x0 (ffff8eb481697300) 00010000:00010000:1.0:1787826024.033482:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826024.033485:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e800, rc 0) 00000100:00100000:1.0:1787826024.033568:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+30:155753:x1874663042938112:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 776us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.033577:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 809 00000100:00080000:0.0:1787826024.033683:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826024.050165:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.050482:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042938240 00000100:00100000:0.0:1787826024.050495:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042938240 00000100:00100000:0.0:1787826024.050567:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 810 00000100:00100000:0.0:1787826024.050579:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+30:155753:x1874663042938240:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826024.050604:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.050632:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec439 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef56 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.050718:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.050734:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.050748:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826024.050816:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x3c:0x0]: returning size 4096 00000004:00200000:0.0:1787826024.050822:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826024.050863:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cec439 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 32 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.050885:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 31 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.050899:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3c:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:0.0:1787826024.050903:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826024.050907:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569400, rc 0) 00000100:00100000:0.0:1787826024.050988:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155753:x1874663042938240:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 411us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.050996:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 810 00000100:00100000:3.0:1787826024.064494:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.064623:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042938368 00000100:00100000:0.0:1787826024.064645:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042938368 00000100:00100000:0.0:1787826024.064756:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 811 00000100:00100000:0.0:1787826024.064769:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155753:x1874663042938368:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826024.064798:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.064824:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00cec447 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef5d expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.064904:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.064921:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00cec416 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec40f expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.064930:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.064971:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00cec416 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec40f expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.064988:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049195904:0@lo:104: 00000100:00100000:0.0:1787826024.065050:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.065103:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1abc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.065281:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049195904 00000100:00100000:3.0:1787826024.065287:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049195904 00000100:00100000:3.0:1787826024.065375:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4753 00000100:00100000:3.0:1787826024.065383:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049195904:12345-0@lo:104: 00010000:00010000:3.0:1787826024.065398:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.065463:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826024.065470:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049195904:12345-0@lo:104: Request processed in 89us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.065477:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4753 00010000:00010000:3.0:1787826024.065502:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826024.065508:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.065518:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826024.065524:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826024.065534:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.065564:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.065572:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826024.065594:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.065601:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec40f lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec416 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.065624:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826024.065626:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826024.065628:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826024.065711:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826024.065725:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049196032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.065760:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.065934:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049195904:0@lo:104: 00010000:00010000:1.0:1787826024.065961:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787826024.066122:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826024.066417:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049196032 00000100:00100000:3.0:1787826024.066425:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049196032 00010000:00010000:3.0:1787826024.066455:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00cec416 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec40f expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.066490:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12198 00000100:00100000:3.0:1787826024.066498:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3619:x1874663049196032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.066514:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787826024.069200:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869888 is committed 00010000:00010000:3.0:1787826024.069677:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00cec416 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec40f expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.069780:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3c:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:3.0:1787826024.069788:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.069801:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.069810:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.069989:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826024.070103:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049196032:12345-0@lo:103:ldlm_bl.0 Request processed in 3602us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.070115:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12198 00000100:00100000:0.0:1787826024.070244:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049196032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826024.071471:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.071640:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826024.071802:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x3c:0x0]: returning size 4096 00000004:00200000:1.0:1787826024.071810:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826024.071876:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00cec447 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.071903:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.071914:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3c:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:1.0:1787826024.071917:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826024.071921:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568800, rc 0) 00000100:00100000:1.0:1787826024.072016:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155753:x1874663042938368:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 7249us (7547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.072026:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 811 00000100:00100000:2.0:1787826024.075866:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.075989:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042938624 00000100:00100000:0.0:1787826024.076003:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042938624 00000100:00100000:0.0:1787826024.076123:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 812 00000100:00100000:0.0:1787826024.076137:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155753:x1874663042938624:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:0.0:1787826024.076220:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.076267:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec432 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef4f expref: 31 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076292:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc8:0x0].0x0 (ffff8eb481697300) 00010000:00010000:0.0:1787826024.076299:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826024.076364:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076390:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076401:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076415:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076425:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076433:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076557:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076567:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076575:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076597:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076607:0:188992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 30 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076616:0:188992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 4/0,1 mode: --/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076668:0:188992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 30 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.076695:0:188992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 30 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.076713:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188992:1874663049196160:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826024.076829:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.080114:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826024.080246:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042938752 00000100:00100000:1.0:1787826024.080259:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042938752 00010000:00010000:1.0:1787826024.080312:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 31 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.080411:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12199 00000100:00100000:1.0:1787826024.080423:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:2391:x1874663042938752:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826024.080442:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826024.080451:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 31 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.080467:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 31 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.080631:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3c:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:1.0:1787826024.080646:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.080659:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.080668:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.080767:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826024.080846:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:2391:x1874663042938752:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 423us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.080855:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12199 00010000:00010000:0.0:1787826024.080984:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cec440 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef56 expref: 30 pid: 187904 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.081004:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188992:1874663049196160:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826024.081034:0:188992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.081044:0:188992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.081051:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.081107:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.081115:0:188992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.081127:0:188992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.081148:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049196288:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1787826024.081202:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.081239:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.081296:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049196288 00000100:00100000:1.0:1787826024.081303:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049196288 00000100:00100000:1.0:1787826024.081367:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12471 00000100:00100000:1.0:1787826024.081783:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188992:x1874663049196288:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787826024.081803:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.081824:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec471 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.081852:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.081862:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.081890:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.081905:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 6 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.081918:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049196416:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826024.081998:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6b1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.087131:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049196416:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826024.087185:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.087200:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3c:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:1.0:1787826024.087204:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826024.087209:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.087229:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.087237:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ec00, rc 0) 00000100:00100000:1.0:1787826024.087346:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049196288:12345-0@lo:101:mdt00_004.0 Request processed in 5544us (6121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.087357:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12471 00000100:00100000:2.0:1787826024.088381:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.088661:0:188992:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869888 gen 2 00000004:00080000:0.0:1787826024.088670:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869887 committed transno 17179869888 00000004:00080000:0.0:1787826024.088717:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869888 committed transno 17179869888 00000100:00100000:0.0:1787826024.088738:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049196288:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787826024.088769:0:188992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.088783:0:188992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.089518:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042938880 00000100:00100000:1.0:1787826024.089531:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042938880 00010000:00010000:1.0:1787826024.089586:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 7 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.089649:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12200 00000100:00100000:1.0:1787826024.089661:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2391:x1874663042938880:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826024.089681:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826024.089699:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 7 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.089716:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 7 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.089746:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568800/0x878a5eea00cec44e lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef5d expref: 7 pid: 187906 timeout: 8190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.089770:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3c:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:1.0:1787826024.089778:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.089791:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.089801:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.089844:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.089859:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049196544:0@lo:105: 00000100:00100000:1.0:1787826024.089931:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.089981:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6b1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.090293:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049196544 00000100:00100000:0.0:1787826024.090299:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049196544 00000100:00100000:0.0:1787826024.090360:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4754 00000100:00100000:0.0:1787826024.090368:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049196544:12345-0@lo:105: 00010000:00010000:0.0:1787826024.090389:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.090400:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.090410:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.090419:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.090426:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.090434:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.090462:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb4724ec400) 00000100:00100000:0.0:1787826024.090517:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6477:x1874663049196544:12345-0@lo:105: Request processed in 149us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.090523:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4754 00010000:00010000:2.0:1787826024.090653:0:188992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.090665:0:188992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.091513:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049196672:0@lo:403:mdt00_004.0 00000100:00100000:2.0:1787826024.091585:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.091616:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.091941:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049196672 00000100:00100000:0.0:1787826024.091949:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049196672 00000100:00100000:0.0:1787826024.092007:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12472 00000100:00100000:0.0:1787826024.092016:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049196672:12345-0@lo:403:mdt00_004.0 00000100:00100000:1.0:1787826024.093530:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6477:1874663049196544:0@lo:105: 00010000:00010000:1.0:1787826024.093572:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826024.093675:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042938880:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 4012us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.093813:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12200 00000100:00100000:0.0:1787826024.096468:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049196672:12345-0@lo:403:mdt00_004.0 Request processed in 4437us (4867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.096487:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12472 00000100:00100000:2.0:1787826024.097297:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049196672:0@lo:403:mdt00_004.0 00000040:00080000:2.0:1787826024.099039:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].463, 656 off708360 00000040:00080000:2.0:1787826024.099278:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].334, 736 off552656 00000004:00080000:2.0:1787826024.099285:0:188992:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172840 with version 707 00000004:00080000:1.0:1787826024.100154:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 707 rpc_version 707 00000020:00100000:1.0:1787826024.100210:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826024.100227:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4774f3b80 x1874663049196928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826024.100466:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049196928:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826024.101005:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.101107:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6b1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.101163:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049196928 00000100:00100000:3.0:1787826024.101174:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049196928 00000100:00100000:3.0:1787826024.101283:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12473 00000100:00100000:3.0:1787826024.101295:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049196928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826024.101832:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049196928:12345-0@lo:1000:osp_up1-0.0 Request processed in 537us (825us total) trans 17179869889 rc 0/0 00000100:00100000:3.0:1787826024.101847:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12473 00000100:00100000:0.0:1787826024.101972:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049196928:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826024.102181:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc8:0x0]: returning size 4096 00010000:00010000:2.0:1787826024.102211:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102223:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102232:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102238:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.102243:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102251:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102287:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3c:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:2.0:1787826024.102290:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826024.102295:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 2/0,0 mode: --/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102302:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cec46a lrc: 0/0,0 mode: --/EX res: [0x200026560:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102322:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102348:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102355:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102394:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826024.102406:0:188992:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3c:0x0] 00010000:00010000:2.0:1787826024.102415:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102422:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102427:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102432:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.102435:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102442:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102450:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc8:0x0].0x0 (ffff8eb481697300) 00010000:00010000:2.0:1787826024.102452:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826024.102455:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102460:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00cec463 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102486:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102493:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102498:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102503:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.102506:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102511:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102519:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.102521:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.102524:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102534:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569600/0x878a5eea00cec455 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.102545:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d27bec1 reply state 000000000a0c27c8 transno 335007449205 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102560:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.102568:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.102570:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.102573:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826024.102673:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155753:x1874663042938624:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 26536us (26822us total) trans 335007449205 rc 0/0 00000100:00100000:2.0:1787826024.102691:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 812 00010000:00010000:0.0:1787826024.102995:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826024.103004:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.103013:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec400 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826024.103018:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826024.103028:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.103067:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.103075:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826024.103113:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.103121:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ec400/0x878a5eea00cec471 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec478 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.103141:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.103143:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.103145:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826024.103154:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826024.103172:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049197056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.103231:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.103286:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049197056 00000100:00100000:0.0:1787826024.103294:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049197056 00000100:00100000:0.0:1787826024.103582:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4200 00000100:00100000:0.0:1787826024.103598:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049197056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826024.103615:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.103648:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00cec478 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec471 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.103664:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3c:0x0].0x0 (ffff8eb47f8fdf00) 00010000:00010000:0.0:1787826024.103673:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826024.103719:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049197056:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.103726:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4200 00000100:00100000:0.0:1787826024.103802:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049197056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826024.120407:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.120614:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042939008 00000100:00100000:3.0:1787826024.120627:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042939008 00000100:00100000:3.0:1787826024.120725:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 813 00000100:00100000:3.0:1787826024.120738:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155754:x1874663042939008:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826024.120773:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.120802:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec47f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef64 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.120886:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.120903:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.120916:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.120928:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.120935:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.120942:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.120999:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121011:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121018:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121026:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.121032:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121041:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121057:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.121060:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.121066:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121073:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec486 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121087:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121094:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121101:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121107:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.121111:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121116:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121123:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826024.121126:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.121129:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121135:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec48d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121165:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec47f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef64 expref: 32 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121176:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.121179:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.121182:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec47f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef64 expref: 32 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.121192:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19200, rc 0) 00000100:00100000:3.0:1787826024.121263:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155754:x1874663042939008:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 527us (871us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826024.121270:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 813 00000100:00100000:2.0:1787826024.125124:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826024.125251:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042939136 00000100:00100000:1.0:1787826024.125277:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042939136 00000100:00100000:1.0:1787826024.125415:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 814 00000100:00100000:1.0:1787826024.125430:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155754:x1874663042939136:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826024.125458:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.125496:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec494 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef6b expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125582:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125598:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125610:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125623:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125642:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125649:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125708:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125716:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125723:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125734:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.125739:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125747:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125760:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826024.125763:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.125767:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125774:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00cec49b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125791:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125798:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125804:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125809:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.125812:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125818:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125829:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826024.125831:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.125834:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125840:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4a2 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125871:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec494 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef6b expref: 32 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125882:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826024.125884:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.125888:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec494 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef6b expref: 32 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.125897:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e000, rc 0) 00000100:00100000:1.0:1787826024.125976:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155754:x1874663042939136:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 549us (867us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826024.125984:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 814 00000100:00100000:0.0:1787826024.133495:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.133677:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042939264 00000100:00100000:2.0:1787826024.133700:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042939264 00000100:00100000:2.0:1787826024.133779:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 815 00000100:00100000:2.0:1787826024.133792:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+31:155754:x1874663042939264:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826024.133819:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.133846:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef72 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.133930:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4b0 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.133951:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4b0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.133964:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4b0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826024.134025:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826024.134028:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826024.134052:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4b0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.134081:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef72 expref: 33 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.134105:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4b0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef72 expref: 32 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.134115:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.134118:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826024.134122:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:2.0:1787826024.134205:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+32:155754:x1874663042939264:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 416us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.134213:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 815 00000100:00100000:3.0:1787826024.142598:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826024.142784:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042939520 00000100:00100000:1.0:1787826024.142799:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042939520 00000100:00100000:1.0:1787826024.142884:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 816 00000100:00100000:1.0:1787826024.142897:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+32:155754:x1874663042939520:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826024.142976:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826024.143011:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4b0 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef72 expref: 32 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.143042:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826024.143047:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826024.143119:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.143134:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.143146:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.143157:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.143168:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.143174:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826024.144680:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].464, 2152 off710512 00000040:00080000:1.0:1787826024.144773:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].335, 2352 off555008 00000004:00080000:1.0:1787826024.144780:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6b1000 with version 708 00000004:00080000:2.0:1787826024.145074:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 708 rpc_version 708 00000020:00100000:2.0:1787826024.145122:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826024.145135:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb343e56680 x1874663049197312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826024.145167:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049197312:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826024.145261:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.145313:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.145717:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049197312 00000100:00100000:3.0:1787826024.145728:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049197312 00000100:00100000:3.0:1787826024.145798:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12474 00000100:00100000:3.0:1787826024.145809:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049197312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826024.146465:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049197312:12345-0@lo:1000:osp_up1-0.0 Request processed in 655us (1201us total) trans 17179869890 rc 0/0 00000100:00100000:2.0:1787826024.146859:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049197312:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787826024.147019:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147037:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147051:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147073:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 3/0,1 mode: --/PW res: [0x200026560:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147080:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147087:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147128:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147136:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147146:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.147166:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049197440:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1787826024.147214:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.147273:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049197440 00000100:00100000:2.0:1787826024.147280:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049197440 00000100:00100000:2.0:1787826024.147350:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12475 00000100:00100000:2.0:1787826024.147360:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187905:x1874663049197440:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826024.147391:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.147411:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec4da lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec4d3 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147434:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec4da lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec4d3 expref: 10 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147447:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec4da lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec4d3 expref: 10 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147457:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3d:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:2.0:1787826024.147460:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.147465:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:2.0:1787826024.147624:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187905:x1874663049197440:12345-0@lo:101:mdt00_001.0 Request processed in 264us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.147638:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12475 00000100:00100000:2.0:1787826024.147668:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826024.147813:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049197440:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826024.147831:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147842:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.147871:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4c0cbc5 reply state 000000004d8c1573 transno 335007449206 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147884:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147891:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:2.0:1787826024.147894:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.147898:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826024.147904:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147912:0:187905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826024.147925:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3d:0x0] 00000004:00010000:2.0:1787826024.147931:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4c0cbc5 reply state 000000004d8c1573 transno 335007449206 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147940:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147946:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc9:0x0].0x0 (ffff8eb449aac800) 00010000:00010000:2.0:1787826024.147949:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.147951:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787826024.147957:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc9:0x0]: returning size 4096 00010000:00010000:2.0:1787826024.147966:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147972:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147980:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147986:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.147991:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.147999:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.148012:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.148015:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.148020:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.148026:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e000/0x878a5eea00cec4b7 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.148042:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4c0cbc5 reply state 000000004d8c1573 transno 335007449206 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.148052:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.148059:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.148061:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.148063:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787826024.148155:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+33:155754:x1874663042939520:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 5258us (5686us total) trans 335007449206 rc 0/0 00000100:00100000:2.0:1787826024.148163:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 816 00000100:00100000:3.0:1787826024.148817:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12474 00000100:00100000:0.0:1787826024.159567:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.159741:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042939648 00000100:00100000:2.0:1787826024.159756:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042939648 00000100:00100000:2.0:1787826024.159830:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 817 00000100:00100000:2.0:1787826024.159840:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+33:155755:x1874663042939648:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826024.159870:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.159897:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec4e1 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef79 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.159983:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160001:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160014:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160025:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160033:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160040:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160138:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec4f6 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160145:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec4f6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160157:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec4f6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826024.160540:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc9:0x0]: returning size 4096 00000004:00200000:2.0:1787826024.160547:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826024.160570:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec4f6 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160584:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160591:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160600:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160607:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.160612:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160620:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160644:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.160648:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.160654:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160661:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec4e8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160797:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160806:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160811:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160816:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.160819:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160825:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160833:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.160836:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.160839:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160844:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec4ef lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160877:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec4e1 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef79 expref: 35 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160891:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec4f6 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef79 expref: 34 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.160905:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc9:0x0].0x0 (ffff8eb449aac800) 00010000:00010000:2.0:1787826024.160907:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826024.160910:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715e00, rc 0) 00000100:00100000:2.0:1787826024.161058:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+34:155755:x1874663042939648:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1217us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.161067:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 817 00000100:00100000:2.0:1787826024.164849:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.164952:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042939776 00000100:00100000:3.0:1787826024.164967:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042939776 00000100:00100000:3.0:1787826024.165081:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 818 00000100:00100000:3.0:1787826024.165093:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+34:155755:x1874663042939776:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826024.165119:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.165145:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec4fd lrc: 2/0,0 mode: --/CR res: [0x200026560:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef80 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.165222:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.165238:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.165250:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826024.165667:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x3d:0x0]: returning size 4096 00000004:00200000:3.0:1787826024.165674:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826024.165803:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec4fd lrc: 0/0,0 mode: --/CR res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 36 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.165828:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 35 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.165843:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:3.0:1787826024.165846:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826024.165850:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18800, rc 0) 00000100:00100000:3.0:1787826024.165976:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155755:x1874663042939776:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 884us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.165985:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 818 00000100:00100000:2.0:1787826024.170611:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826024.170812:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042939904 00000100:00100000:1.0:1787826024.170826:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042939904 00000100:00100000:1.0:1787826024.170945:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 819 00000100:00100000:1.0:1787826024.170958:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155755:x1874663042939904:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826024.170985:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.171016:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec50b lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef87 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.171097:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.171116:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec4da lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec4d3 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.171126:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.171170:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec4da lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec4d3 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.171190:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049197568:0@lo:104: 00000100:00100000:1.0:1787826024.171279:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.171377:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.171677:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049197568 00000100:00100000:0.0:1787826024.171695:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049197568 00000100:00100000:0.0:1787826024.171745:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4755 00000100:00100000:0.0:1787826024.171755:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049197568:12345-0@lo:104: 00010000:00010000:0.0:1787826024.171769:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.171847:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826024.171854:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049197568:12345-0@lo:104: Request processed in 102us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.171861:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4755 00010000:00010000:0.0:1787826024.171891:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826024.171899:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.171908:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826024.171915:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826024.171925:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.171962:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.171970:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826024.171995:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.172008:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441510200/0x878a5eea00cec4d3 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec4da expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.172033:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.172035:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.172037:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826024.172051:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049197696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.172085:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.172123:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049197696 00000100:00100000:0.0:1787826024.172127:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049197696 00010000:00010000:0.0:1787826024.172149:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec4da lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec4d3 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.172175:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12201 00000100:00100000:0.0:1787826024.172182:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3618:x1874663049197696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826024.172193:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826024.172961:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049197568:0@lo:104: 00010000:00010000:3.0:1787826024.172993:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826024.176666:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869890 is committed 00010000:00010000:0.0:1787826024.176943:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec4da lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec4d3 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.176969:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3d:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:0.0:1787826024.176976:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.176988:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.176996:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.177080:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826024.177199:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049197696:12345-0@lo:103:ldlm_bl.0 Request processed in 5013us (5109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.177213:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12201 00000100:00100000:1.0:1787826024.177398:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049197696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.177617:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.177628:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826024.177784:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x3d:0x0]: returning size 4096 00000004:00200000:3.0:1787826024.177791:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826024.177844:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec50b lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.177863:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.177872:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3d:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:3.0:1787826024.177876:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826024.177879:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ea00, rc 0) 00000100:00100000:3.0:1787826024.177988:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155755:x1874663042939904:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 7032us (7397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.177997:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 819 00000100:00100000:2.0:1787826024.181140:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.181222:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042940160 00000100:00100000:0.0:1787826024.181235:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042940160 00000100:00100000:0.0:1787826024.181359:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 820 00000100:00100000:0.0:1787826024.181380:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155755:x1874663042940160:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:0.0:1787826024.181449:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.181767:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec4f6 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef79 expref: 35 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.181792:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc9:0x0].0x0 (ffff8eb449aac800) 00010000:00010000:0.0:1787826024.181798:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826024.181828:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.181845:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.181856:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.181869:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.181878:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.181891:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.182001:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.182011:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.182018:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.182039:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.182049:0:188992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 34 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.182057:0:188992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 4/0,1 mode: --/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.182096:0:188992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 34 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.182113:0:188992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 34 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.182130:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188992:1874663049197824:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826024.182232:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826024.185726:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.186197:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188992:1874663049197824:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826024.186239:0:188992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.186314:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042940288 00000100:00100000:1.0:1787826024.186350:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042940288 00010000:00010000:1.0:1787826024.186410:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 35 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.186448:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12202 00000100:00100000:1.0:1787826024.186460:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:2391:x1874663042940288:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826024.186599:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826024.186610:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 35 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.186625:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 35 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.186662:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec504 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef80 expref: 35 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.186682:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:1.0:1787826024.186697:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.186709:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.186718:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.186743:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826024.186813:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+34:2391:x1874663042940288:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 355us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.186820:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12202 00010000:00010000:2.0:1787826024.187056:0:188992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.187067:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.187130:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.187138:0:188992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.187150:0:188992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.187174:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049197952:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787826024.187234:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.187274:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.188028:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049197952 00000100:00100000:1.0:1787826024.188039:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049197952 00000100:00100000:1.0:1787826024.188094:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12476 00000100:00100000:1.0:1787826024.188104:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188992:x1874663049197952:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787826024.188125:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.188148:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec535 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.188185:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.188195:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.188225:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.188240:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 6 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.188254:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049198080:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826024.190408:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.191469:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049198080:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826024.191527:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.191542:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3d:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:1.0:1787826024.191545:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826024.191550:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.191560:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.191573:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f000, rc 0) 00000100:00100000:1.0:1787826024.191698:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049197952:12345-0@lo:101:mdt00_004.0 Request processed in 3594us (4462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.191708:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12476 00000100:00100000:2.0:1787826024.192163:0:188992:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869890 gen 2 00000004:00080000:2.0:1787826024.192173:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869889 committed transno 17179869890 00000004:00080000:2.0:1787826024.192201:0:188992:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869890 committed transno 17179869890 00000100:00100000:2.0:1787826024.192222:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049197952:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787826024.192244:0:188992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.193014:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.193110:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042940416 00000100:00100000:0.0:1787826024.193120:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042940416 00010000:00010000:0.0:1787826024.193167:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 7 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.193212:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12203 00000100:00100000:0.0:1787826024.193223:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042940416:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826024.193240:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.193248:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 7 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.193268:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 7 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.193294:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec512 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef87 expref: 7 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.193316:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3d:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:0.0:1787826024.193366:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.193388:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.193404:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.193448:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.193465:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049198208:0@lo:105: 00000100:00100000:0.0:1787826024.193536:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.193587:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.193610:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049198208 00000100:00100000:0.0:1787826024.193614:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049198208 00000100:00100000:0.0:1787826024.193661:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4756 00000100:00100000:0.0:1787826024.193670:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049198208:12345-0@lo:105: 00010000:00010000:2.0:1787826024.194315:0:188992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.194523:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.194534:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.194545:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.194554:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.194563:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.194574:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.194596:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb481715000) 00000100:00100000:0.0:1787826024.194835:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049198208:12345-0@lo:105: Request processed in 1163us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.194845:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4756 00000100:00100000:1.0:1787826024.194944:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049198208:0@lo:105: 00010000:00010000:1.0:1787826024.194967:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826024.195028:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042940416:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1804us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.195036:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12203 00010000:00010000:2.0:1787826024.195785:0:188992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.195802:0:188992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.197070:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049198336:0@lo:403:mdt00_004.0 00000100:00100000:2.0:1787826024.197160:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.197273:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.198606:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049198336 00000100:00100000:3.0:1787826024.198706:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049198336 00000100:00100000:3.0:1787826024.198835:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12477 00000100:00100000:3.0:1787826024.198850:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049198336:12345-0@lo:403:mdt00_004.0 00000100:00100000:3.0:1787826024.201848:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188992:x1874663049198336:12345-0@lo:403:mdt00_004.0 Request processed in 2988us (4674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.201865:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12477 00000100:00100000:2.0:1787826024.201972:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049198336:0@lo:403:mdt00_004.0 00000040:00080000:2.0:1787826024.203842:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].465, 656 off711168 00000040:00080000:2.0:1787826024.204090:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].336, 736 off555744 00000004:00080000:2.0:1787826024.204099:0:188992:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172c00 with version 709 00000004:00080000:0.0:1787826024.204206:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 709 rpc_version 709 00000020:00100000:0.0:1787826024.204250:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826024.204705:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c142300 x1874663049198592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826024.204739:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049198592:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826024.204828:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.204912:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.204966:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049198592 00000100:00100000:3.0:1787826024.204975:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049198592 00000100:00100000:3.0:1787826024.205044:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12478 00000100:00100000:3.0:1787826024.205056:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049198592:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826024.206039:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049198592:12345-0@lo:1000:osp_up1-0.0 Request processed in 979us (1204us total) trans 17179869891 rc 0/0 00000100:00100000:3.0:1787826024.206052:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12478 00000100:00100000:0.0:1787826024.206199:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049198592:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826024.206552:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bc9:0x0]: returning size 4096 00010000:00010000:2.0:1787826024.206583:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.206594:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.206603:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.206609:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.206963:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.206975:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.206998:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:2.0:1787826024.207002:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826024.207008:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 2/0,0 mode: --/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207015:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec52e lrc: 0/0,0 mode: --/EX res: [0x200026560:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207035:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207043:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207049:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207125:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826024.207137:0:188992:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3d:0x0] 00010000:00010000:2.0:1787826024.207147:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207154:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207160:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207165:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.207169:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207175:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207182:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc9:0x0].0x0 (ffff8eb449aac800) 00010000:00010000:2.0:1787826024.207185:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826024.207188:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207194:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec527 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207210:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207216:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207222:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207230:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ece00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.207234:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207239:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207246:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.207248:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.207252:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207268:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec519 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.207280:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da103759 reply state 00000000474ff68e transno 335007449207 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207295:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.207304:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.207306:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.207309:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826024.207450:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155755:x1874663042940160:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 26076us (26320us total) trans 335007449207 rc 0/0 00000100:00100000:2.0:1787826024.207460:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 820 00010000:00010000:1.0:1787826024.209001:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826024.209019:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.209033:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826024.209041:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826024.209052:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.209109:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.209118:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787826024.209196:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049198720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.209291:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.209436:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049198720 00000100:00100000:3.0:1787826024.209445:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049198720 00000100:00100000:3.0:1787826024.209524:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4201 00000100:00100000:3.0:1787826024.209537:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3619:x1874663049198720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.209552:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826024.209578:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec53c lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec535 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.209605:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3d:0x0].0x0 (ffff8eb449aac900) 00010000:00010000:3.0:1787826024.209639:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826024.209905:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.209920:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715000/0x878a5eea00cec535 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec53c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.209940:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826024.209942:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826024.209944:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826024.210159:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049198720:12345-0@lo:103:ldlm_bl.0 Request processed in 623us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.210168:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4201 00000100:00100000:0.0:1787826024.210242:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049198720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826024.224850:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.225004:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042940544 00000100:00100000:2.0:1787826024.225019:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042940544 00000100:00100000:2.0:1787826024.225142:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 821 00000100:00100000:2.0:1787826024.225155:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155756:x1874663042940544:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826024.225188:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.225217:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec543 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef8e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225454:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225472:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225764:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225783:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225793:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225801:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225863:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225871:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225878:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225886:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.225892:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225900:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225916:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.225920:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.225926:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225933:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec54a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225949:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225956:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225962:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225967:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.225970:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225977:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.225989:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.225991:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.225994:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.226000:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec551 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.226037:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec543 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef8e expref: 36 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.226050:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.226052:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.226056:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec543 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef8e expref: 36 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.226067:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715800, rc 0) 00000100:00100000:2.0:1787826024.226215:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155756:x1874663042940544:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1061us (1378us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826024.226226:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 821 00000100:00100000:0.0:1787826024.234153:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.234267:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042940672 00000100:00100000:3.0:1787826024.234282:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042940672 00000100:00100000:3.0:1787826024.234463:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 822 00000100:00100000:3.0:1787826024.234476:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155756:x1874663042940672:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826024.234516:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.234546:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec558 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef95 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234653:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234670:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234694:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234709:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234717:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234728:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234784:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234792:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234799:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234806:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.234811:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234820:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234835:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.234840:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.234845:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234852:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec55f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234867:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234873:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234879:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234885:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.234888:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234894:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234902:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826024.234905:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.234908:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234914:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec566 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234945:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec558 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef95 expref: 36 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234956:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.234958:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.234962:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec558 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef95 expref: 36 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.234972:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19200, rc 0) 00000100:00100000:3.0:1787826024.235061:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155756:x1874663042940672:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 587us (922us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826024.235070:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 822 00000100:00100000:2.0:1787826024.241893:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.241976:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042940800 00000100:00100000:0.0:1787826024.241988:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042940800 00000100:00100000:0.0:1787826024.242086:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 823 00000100:00100000:0.0:1787826024.242098:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+35:155756:x1874663042940800:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826024.242123:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.242150:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec56d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6ef9c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.242233:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec574 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.242251:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec574 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.242264:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec574 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826024.242321:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:0.0:1787826024.242342:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826024.242365:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec574 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.242396:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec56d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef9c expref: 37 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.242417:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec574 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef9c expref: 36 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.242427:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826024.242430:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826024.242435:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ecc00, rc 0) 00000100:00100000:0.0:1787826024.242529:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+36:155756:x1874663042940800:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 432us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.242537:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 823 00000100:00100000:2.0:1787826024.246138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.246226:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042941056 00000100:00100000:3.0:1787826024.246238:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042941056 00000100:00100000:3.0:1787826024.246320:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 824 00000100:00100000:3.0:1787826024.246368:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+36:155756:x1874663042941056:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:3.0:1787826024.246468:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826024.246505:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec574 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6ef9c expref: 36 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.246528:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.246535:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826024.246614:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.246640:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.246651:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.246664:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.246676:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.246684:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826024.247655:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].466, 2152 off713320 00000040:00080000:3.0:1787826024.247750:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].338, 2352 off559408 00000004:00080000:3.0:1787826024.247757:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be53a80 with version 710 00000004:00080000:0.0:1787826024.248381:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 710 rpc_version 710 00000020:00100000:0.0:1787826024.248442:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826024.248456:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477df6a00 x1874663049198976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826024.248564:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049198976:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826024.248745:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.248795:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.248880:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049198976 00000100:00100000:1.0:1787826024.248889:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049198976 00000100:00100000:1.0:1787826024.248988:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12479 00000100:00100000:1.0:1787826024.248998:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049198976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826024.249892:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049198976:12345-0@lo:1000:osp_up1-0.0 Request processed in 892us (1145us total) trans 17179869892 rc 0/0 00000100:00100000:1.0:1787826024.249904:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12479 00000100:00100000:0.0:1787826024.250051:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049198976:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787826024.251907:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.252094:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.252115:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.252144:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.252152:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.252160:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.252209:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.252217:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.252228:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.253121:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049199104:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787826024.253224:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.253377:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049199104 00000100:00100000:1.0:1787826024.253389:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049199104 00000100:00100000:1.0:1787826024.253743:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12480 00000100:00100000:1.0:1787826024.253758:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049199104:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826024.253792:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.253821:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec59e lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec597 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.253853:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec59e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec597 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.253866:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec59e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec597 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.253881:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3e:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:1.0:1787826024.253885:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.253889:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ea00, rc 0) 00000100:00100000:1.0:1787826024.258356:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049199104:12345-0@lo:101:mdt00_003.0 Request processed in 4553us (5083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.258375:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12480 00000100:00100000:2.0:1787826024.262580:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826024.262738:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049199104:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826024.262775:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262794:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.262835:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed88ec60 reply state 0000000005136ea5 transno 335007449208 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262854:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262863:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3e:0x0].0x0 (ffff8eb449aac700) 00010000:00010000:2.0:1787826024.262867:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.262873:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826024.262880:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262889:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826024.262904:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3e:0x0] 00000004:00010000:2.0:1787826024.262916:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed88ec60 reply state 0000000005136ea5 transno 335007449208 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262926:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262933:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bca:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:2.0:1787826024.262936:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.262938:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787826024.262946:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bca:0x0]: returning size 4096 00010000:00010000:2.0:1787826024.262958:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262965:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262975:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262982:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.262987:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.262997:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.263011:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.263013:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.263018:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.263106:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec57b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.263128:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed88ec60 reply state 0000000005136ea5 transno 335007449208 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.263139:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.263146:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.263148:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.263151:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787826024.263594:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155756:x1874663042941056:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 17225us (17465us total) trans 335007449208 rc 0/0 00000100:00100000:2.0:1787826024.263606:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 824 00010000:00010000:3.0:1787826024.277215:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826024.291429:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.295602:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042941184 00000100:00100000:3.0:1787826024.295626:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042941184 00000100:00100000:3.0:1787826024.296008:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 825 00000100:00100000:3.0:1787826024.296022:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+37:155761:x1874663042941184:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826024.296055:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.296086:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec5a5 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efa3 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.296177:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.296196:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.296210:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.296224:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.296233:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.296239:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.300860:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec5ba lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.300889:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec5ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.300904:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec5ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826024.301039:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bca:0x0]: returning size 4096 00000004:00200000:3.0:1787826024.301047:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826024.301076:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec5ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301094:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301102:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301110:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301117:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.301122:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301130:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301147:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.301151:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.301157:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301163:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec5ac lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301181:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301188:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301194:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301199:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.301203:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301209:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301217:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826024.301219:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.301222:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301229:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5b3 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301275:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec5a5 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efa3 expref: 39 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301294:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec5ba lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efa3 expref: 38 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.301302:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bca:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:3.0:1787826024.301305:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826024.301308:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19000, rc 0) 00000100:00100000:3.0:1787826024.301465:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+38:155761:x1874663042941184:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 5444us (10050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.301477:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 825 00000100:00100000:0.0:1787826024.313407:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.313533:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042941312 00000100:00100000:2.0:1787826024.313546:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042941312 00000100:00100000:2.0:1787826024.313614:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 826 00000100:00100000:2.0:1787826024.313626:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+38:155761:x1874663042941312:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826024.313666:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.313704:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec5c1 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efaa expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.313784:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.313801:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.313812:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826024.313870:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x3e:0x0]: returning size 4096 00000004:00200000:2.0:1787826024.313876:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826024.313928:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec5c1 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 40 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.313949:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 39 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.313959:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3e:0x0].0x0 (ffff8eb449aac700) 00010000:00010000:2.0:1787826024.313963:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826024.313966:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715800, rc 0) 00000100:00100000:2.0:1787826024.314045:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155761:x1874663042941312:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 422us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.314055:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 826 00000100:00100000:2.0:1787826024.327472:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.335453:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042941440 00000100:00100000:3.0:1787826024.335476:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042941440 00000100:00100000:3.0:1787826024.335573:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 827 00000100:00100000:3.0:1787826024.335587:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155761:x1874663042941440:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826024.335615:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.335654:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cec5cf lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efb1 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.335749:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.335768:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec59e lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec597 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.335777:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.335825:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec59e lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec597 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.335845:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188682:1874663049199232:0@lo:104: 00000100:00100000:3.0:1787826024.336424:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.336494:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be533c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.336623:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049199232 00000100:00100000:1.0:1787826024.336641:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049199232 00000100:00100000:1.0:1787826024.336705:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4757 00000100:00100000:1.0:1787826024.336715:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188682:x1874663049199232:12345-0@lo:104: 00010000:00010000:1.0:1787826024.336733:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.336817:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826024.336824:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188682:x1874663049199232:12345-0@lo:104: Request processed in 112us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.336832:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4757 00010000:00010000:2.0:1787826024.337164:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826024.337175:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.337186:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826024.337192:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.337202:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.337243:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.337250:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826024.337292:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.337300:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715c00/0x878a5eea00cec597 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec59e expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.337367:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826024.337370:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826024.337371:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826024.337428:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826024.337447:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049199360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.337502:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.337650:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049199360 00000100:00100000:2.0:1787826024.337657:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049199360 00010000:00010000:2.0:1787826024.337700:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec59e lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec597 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.337733:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12204 00000100:00100000:2.0:1787826024.337743:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3619:x1874663049199360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826024.337757:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826024.339280:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188682:1874663049199232:0@lo:104: 00010000:00010000:3.0:1787826024.339320:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826024.348557:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869892 is committed 00010000:00010000:2.0:1787826024.348826:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec59e lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec597 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.348855:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3e:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:2.0:1787826024.348863:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.348875:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.348895:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.348938:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826024.349061:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049199360:12345-0@lo:103:ldlm_bl.0 Request processed in 11318us (11556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.349073:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12204 00000100:00100000:0.0:1787826024.349307:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049199360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.349627:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.349648:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826024.349731:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x3e:0x0]: returning size 4096 00000004:00200000:3.0:1787826024.349739:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826024.349796:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cec5cf lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.349815:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 7 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.349824:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3e:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:3.0:1787826024.349827:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826024.349830:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19600, rc 0) 00000100:00100000:3.0:1787826024.349905:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155761:x1874663042941440:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 14321us (22449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.349914:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 827 00000100:00100000:0.0:1787826024.358446:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.358585:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042941696 00000100:00100000:3.0:1787826024.358603:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042941696 00000100:00100000:3.0:1787826024.358712:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 828 00000100:00100000:3.0:1787826024.358729:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155761:x1874663042941696:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:0.0:1787826024.359022:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.359065:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec5ba lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efa3 expref: 39 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359090:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bca:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:0.0:1787826024.359096:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826024.359129:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359145:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359157:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359173:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359186:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359193:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359311:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359320:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359363:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359394:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359406:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 38 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359414:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359459:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 38 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.359482:0:187905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 38 pid: 188992 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.359498:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049199488:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826024.359610:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.361975:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826024.362127:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049199488:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826024.362167:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.370155:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042941824 00000100:00100000:2.0:1787826024.370179:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042941824 00010000:00010000:2.0:1787826024.370263:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 39 pid: 188992 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.370309:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12205 00000100:00100000:2.0:1787826024.370321:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:2392:x1874663042941824:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826024.370381:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826024.370390:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 39 pid: 188992 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.370408:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 39 pid: 188992 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.370436:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec5c8 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efaa expref: 39 pid: 188992 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.370459:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3e:0x0].0x0 (ffff8eb449aac700) 00010000:00010000:2.0:1787826024.370465:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.370476:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.370496:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.370529:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826024.370626:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+38:2392:x1874663042941824:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 296us (8652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.370644:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12205 00010000:00010000:3.0:1787826024.370978:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.370994:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.371060:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.371069:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.371081:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.371106:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049199616:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787826024.371180:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.371233:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be533c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.371267:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049199616 00000100:00100000:1.0:1787826024.371277:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049199616 00000100:00100000:1.0:1787826024.371355:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12481 00000100:00100000:1.0:1787826024.371366:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187905:x1874663049199616:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787826024.371402:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.371427:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec5f9 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.371462:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 6 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.371473:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.371520:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 6 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.371533:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 6 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.371548:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049199744:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826024.385166:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.403692:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.403796:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042941952 00000100:00100000:3.0:1787826024.403812:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042941952 00010000:00010000:3.0:1787826024.403883:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 7 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.403943:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12206 00000100:00100000:1.0:1787826024.403951:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049199744:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826024.403964:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2391:x1874663042941952:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.403984:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826024.403993:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 7 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.404006:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.404015:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 7 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.405072:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3e:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:1.0:1787826024.405081:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826024.405090:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.405112:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.405122:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e600, rc 0) 00000100:00100000:1.0:1787826024.405226:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049199616:12345-0@lo:101:mdt00_001.0 Request processed in 33862us (34045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.405236:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12481 00000100:00100000:2.0:1787826024.405284:0:187905:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869892 gen 2 00000004:00080000:2.0:1787826024.405296:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869891 committed transno 17179869892 00000004:00080000:2.0:1787826024.405319:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869892 committed transno 17179869892 00000100:00100000:2.0:1787826024.405378:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049199616:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826024.405403:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.405414:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.407773:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cec5d6 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb1 expref: 7 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.407800:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3e:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:3.0:1787826024.407808:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.407818:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.407828:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.408019:0:8420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.408035:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8420:1874663049199872:0@lo:105: 00000100:00100000:3.0:1787826024.408105:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.408158:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.408868:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049199872 00000100:00100000:0.0:1787826024.408887:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049199872 00000100:00100000:0.0:1787826024.409030:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4758 00000100:00100000:0.0:1787826024.409043:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8420:x1874663049199872:12345-0@lo:105: 00010000:00010000:0.0:1787826024.409063:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.409076:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.409087:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.409097:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.409105:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.409121:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.409164:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab19200) 00000100:00100000:0.0:1787826024.409283:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8420:x1874663049199872:12345-0@lo:105: Request processed in 242us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.409291:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4758 00010000:00010000:2.0:1787826024.409370:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.409383:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.410030:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8420:1874663049199872:0@lo:105: 00010000:00010000:3.0:1787826024.410059:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826024.410130:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042941952:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 6173us (6463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.410142:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12206 00000100:00100000:2.0:1787826024.410223:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049200000:0@lo:403:mdt00_001.0 00000100:00100000:2.0:1787826024.412243:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.412649:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049200000 00000100:00100000:3.0:1787826024.412663:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049200000 00000100:00100000:3.0:1787826024.412819:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12482 00000100:00100000:3.0:1787826024.412833:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049200000:12345-0@lo:403:mdt00_001.0 00000100:00100000:2.0:1787826024.416373:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.417810:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049200000:12345-0@lo:403:mdt00_001.0 Request processed in 4967us (5565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.417828:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12482 00000100:00100000:2.0:1787826024.418021:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049200000:0@lo:403:mdt00_001.0 00000040:00080000:3.0:1787826024.419984:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].467, 656 off713976 00000040:00080000:3.0:1787826024.420239:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].339, 736 off560144 00000004:00080000:3.0:1787826024.420247:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be530c0 with version 711 00000004:00080000:0.0:1787826024.420841:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 711 rpc_version 711 00000020:00100000:0.0:1787826024.420902:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826024.420917:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b5b800 x1874663049200256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826024.420955:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049200256:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826024.421046:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.421123:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.421177:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049200256 00000100:00100000:3.0:1787826024.421187:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049200256 00000100:00100000:3.0:1787826024.421499:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12483 00000100:00100000:3.0:1787826024.421512:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049200256:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826024.421983:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049200256:12345-0@lo:1000:osp_up1-0.0 Request processed in 472us (935us total) trans 17179869893 rc 0/0 00000100:00100000:3.0:1787826024.421994:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12483 00000100:00100000:0.0:1787826024.422174:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049200256:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787826024.422465:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bca:0x0]: returning size 4096 00010000:00010000:1.0:1787826024.422500:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422512:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422520:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422526:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ede00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.422531:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422539:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422560:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3e:0x0].0x0 (ffff8eb449aac700) 00010000:00010000:1.0:1787826024.422563:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826024.422567:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422578:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec5f2 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422597:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422605:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422612:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422750:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826024.422761:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3e:0x0] 00010000:00010000:1.0:1787826024.422770:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422777:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422784:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422789:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eca00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.422792:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422798:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422811:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bca:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:1.0:1787826024.422814:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826024.422817:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422823:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec5eb lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422839:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422845:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422851:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422856:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.422859:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422865:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422872:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826024.422875:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.422878:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422883:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec5dd lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826024.422898:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd55b696 reply state 000000002510d34b transno 335007449209 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422912:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.422919:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826024.422921:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826024.422925:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826024.423023:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155761:x1874663042941696:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 64297us (64592us total) trans 335007449209 rc 0/0 00000100:00100000:1.0:1787826024.423032:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 828 00010000:00010000:0.0:1787826024.424903:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826024.424922:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.424936:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826024.424944:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826024.424955:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.425018:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.425025:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826024.425100:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049200384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826024.425181:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.433397:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049200384 00000100:00100000:2.0:1787826024.433420:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049200384 00000100:00100000:2.0:1787826024.433524:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4202 00000100:00100000:2.0:1787826024.433536:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049200384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826024.433557:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826024.433590:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec600 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec5f9 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.433618:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3e:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:2.0:1787826024.433640:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826024.434415:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.434431:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19200/0x878a5eea00cec5f9 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec600 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.434458:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.434461:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.434464:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826024.443561:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049200384:12345-0@lo:103:ldlm_bl.0 Request processed in 10011us (18364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.443580:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4202 00000100:00100000:0.0:1787826024.445734:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.446174:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042942080 00000100:00100000:2.0:1787826024.446189:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042942080 00000100:00100000:2.0:1787826024.446280:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 829 00000100:00100000:2.0:1787826024.446291:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155765:x1874663042942080:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826024.446346:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.446375:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec607 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efb8 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446464:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446482:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446495:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446510:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446518:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446525:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446583:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446596:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446605:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446611:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.446616:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446624:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446648:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.446652:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.446657:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446663:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec60e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446678:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446684:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446690:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446694:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.446698:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446704:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446711:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.446713:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.446717:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446722:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec615 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446756:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec607 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb8 expref: 40 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446767:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.446771:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.446775:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec607 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efb8 expref: 40 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.446786:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715800, rc 0) 00000100:00100000:2.0:1787826024.446887:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155765:x1874663042942080:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 596us (1166us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826024.447981:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 829 00000100:00100000:3.0:1787826024.450426:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.450816:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042942208 00000100:00100000:2.0:1787826024.450829:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042942208 00000100:00100000:2.0:1787826024.451367:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 830 00000100:00100000:2.0:1787826024.451382:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155765:x1874663042942208:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826024.451410:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.451441:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec61c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efbf expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451529:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451548:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451562:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451576:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451584:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451591:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451657:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451666:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451674:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451681:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.451686:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451695:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451709:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.451712:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.451717:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451724:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec623 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451741:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451747:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451753:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451758:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.451761:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451766:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.451772:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.451774:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.451778:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.452313:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec62a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.452400:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec61c lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efbf expref: 40 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.452414:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.452416:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.452421:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec61c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efbf expref: 40 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.452435:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:2.0:1787826024.452522:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155765:x1874663042942208:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1143us (2111us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826024.452530:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 830 00000100:00100000:3.0:1787826024.454905:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.455944:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042942336 00000100:00100000:2.0:1787826024.455958:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042942336 00000100:00100000:2.0:1787826024.456036:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 831 00000100:00100000:2.0:1787826024.456048:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+39:155765:x1874663042942336:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826024.456075:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.456102:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efc6 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.456195:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec638 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.456218:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec638 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.456232:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec638 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.456642:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049200384:0@lo:103:ldlm_bl.0 00000004:00200000:0.0:1787826024.460795:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:0.0:1787826024.460809:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826024.460859:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec638 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.460915:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efc6 expref: 41 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.460939:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec638 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efc6 expref: 40 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.460950:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826024.460953:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826024.460958:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511800, rc 0) 00000100:00100000:0.0:1787826024.461113:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+40:155765:x1874663042942336:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 5065us (6218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.461125:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 831 00000100:00100000:0.0:1787826024.466873:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.470617:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042942592 00000100:00100000:2.0:1787826024.470652:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042942592 00000100:00100000:0.0:1787826024.474745:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 832 00000100:00100000:0.0:1787826024.474766:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+40:155765:x1874663042942592:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826024.474850:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.474887:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec638 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efc6 expref: 40 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.474910:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826024.474917:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826024.474995:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.475011:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.475022:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.475034:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.475045:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.475051:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826024.479462:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].468, 2152 off716128 00000040:00080000:0.0:1787826024.479568:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].340, 2352 off562496 00000004:00080000:0.0:1787826024.479576:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34e1ab0c0 with version 712 00000004:00080000:1.0:1787826024.482519:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 712 rpc_version 712 00000020:00100000:1.0:1787826024.482594:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826024.482609:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4774f0000 x1874663049200640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826024.482657:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049200640:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826024.482786:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.482834:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826024.483263:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049200640 00000100:00100000:2.0:1787826024.483275:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049200640 00000100:00100000:2.0:1787826024.483375:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12484 00000100:00100000:2.0:1787826024.483389:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049200640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826024.484180:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049200640:12345-0@lo:1000:osp_up1-0.0 Request processed in 790us (1390us total) trans 17179869894 rc 0/0 00000100:00100000:2.0:1787826024.484192:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12484 00000100:00100000:1.0:1787826024.484705:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049200640:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826024.484956:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.484976:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.484989:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.485014:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.485021:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.485027:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.485067:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.485074:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.485085:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.485105:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b59500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049200768:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1787826024.485497:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.485541:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.485793:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049200768 00000100:00100000:1.0:1787826024.485805:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049200768 00000100:00100000:1.0:1787826024.485867:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12485 00000100:00100000:1.0:1787826024.485879:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187904:x1874663049200768:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787826024.485906:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.485930:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00cec662 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec65b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.485957:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00cec662 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec65b expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.485970:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00cec662 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec65b expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.485981:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3f:0x0].0x0 (ffff8eb45edbd900) 00010000:00010000:1.0:1787826024.485984:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.485989:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e000, rc 0) 00000100:00100000:1.0:1787826024.486059:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187904:x1874663049200768:12345-0@lo:101:mdt00_000.0 Request processed in 182us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.486066:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12485 00000100:00100000:0.0:1787826024.487456:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b59500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049200768:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787826024.487488:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487503:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826024.487544:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d394b36e reply state 000000009c828d7d transno 335007449210 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487558:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487566:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3f:0x0].0x0 (ffff8eb449543a00) 00010000:00010000:0.0:1787826024.487569:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826024.487573:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826024.487580:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487588:0:187904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826024.487602:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3f:0x0] 00000004:00010000:0.0:1787826024.487610:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d394b36e reply state 000000009c828d7d transno 335007449210 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487618:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487625:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcb:0x0].0x0 (ffff8eb449543800) 00010000:00010000:0.0:1787826024.487627:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826024.487637:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787826024.487644:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcb:0x0]: returning size 4096 00010000:00010000:0.0:1787826024.487655:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487662:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487669:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487677:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826024.487909:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487920:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487935:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826024.487937:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826024.487942:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487948:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec63f lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826024.487966:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d394b36e reply state 000000009c828d7d transno 335007449210 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487982:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.487989:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826024.487991:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826024.487994:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787826024.488114:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+41:155765:x1874663042942592:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 13350us (21252us total) trans 335007449210 rc 0/0 00000100:00100000:0.0:1787826024.488124:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 832 00000100:00100000:3.0:1787826024.506920:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.507046:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042942720 00000100:00100000:2.0:1787826024.507060:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042942720 00000100:00100000:2.0:1787826024.507135:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 833 00000100:00100000:2.0:1787826024.507148:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+41:155769:x1874663042942720:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826024.507185:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.507215:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec669 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efcd expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507322:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507377:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507408:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507423:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507431:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507438:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507545:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec67e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507553:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec67e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507560:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec67e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826024.507692:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcb:0x0]: returning size 4096 00000004:00200000:2.0:1787826024.507698:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826024.507722:0:188682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec67e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507735:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507741:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507754:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507761:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.507766:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507776:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507791:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.507794:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.507800:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507806:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec670 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507822:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507828:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507833:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507838:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.507841:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507850:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507856:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.507859:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.507861:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507867:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec677 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507900:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec669 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efcd expref: 43 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507914:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec67e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efcd expref: 42 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.507923:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcb:0x0].0x0 (ffff8eb449543800) 00010000:00010000:2.0:1787826024.507925:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826024.507928:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511800, rc 0) 00000100:00100000:2.0:1787826024.508005:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+42:155769:x1874663042942720:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 860us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.508014:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 833 00000100:00100000:3.0:1787826024.514640:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.514881:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042942848 00000100:00100000:0.0:1787826024.514894:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042942848 00000100:00100000:0.0:1787826024.514980:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 834 00000100:00100000:0.0:1787826024.514993:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+42:155769:x1874663042942848:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826024.515020:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.515048:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec685 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efd4 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.515259:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 3/1,0 mode: --/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.515278:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.515296:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826024.515513:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x3f:0x0]: returning size 4096 00000004:00200000:0.0:1787826024.515520:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826024.515668:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec685 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 44 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.515704:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 43 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.515716:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3f:0x0].0x0 (ffff8eb449543a00) 00010000:00010000:1.0:1787826024.515720:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826024.515724:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ec600, rc 0) 00000100:00100000:1.0:1787826024.515892:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155769:x1874663042942848:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 900us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.515905:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 834 00000100:00100000:0.0:1787826024.518705:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.519026:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042942976 00000100:00100000:2.0:1787826024.519039:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042942976 00000100:00100000:2.0:1787826024.519121:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 835 00000100:00100000:2.0:1787826024.519133:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155769:x1874663042942976:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826024.519162:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.519192:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec693 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efdb expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.519284:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.519301:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00cec662 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec65b expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.519311:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.519809:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00cec662 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec65b expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.519830:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:187904:1874663049200896:0@lo:104: 00000100:00100000:2.0:1787826024.519915:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.519969:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.520066:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787826024.520087:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049200896 00000100:00100000:0.0:1787826024.520093:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049200896 00000100:00100000:0.0:1787826024.520151:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4759 00000100:00100000:0.0:1787826024.520162:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a46d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187904:x1874663049200896:12345-0@lo:104: 00010000:00010000:0.0:1787826024.520176:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.520258:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826024.520268:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a46d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187904:x1874663049200896:12345-0@lo:104: Request processed in 110us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.520275:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4759 00010000:00010000:0.0:1787826024.520382:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826024.520389:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.520398:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ece00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826024.520404:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826024.520414:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.520597:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.520605:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826024.520640:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.520648:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724ece00/0x878a5eea00cec65b lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec662 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.520675:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.520676:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.520678:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826024.520687:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826024.520702:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049201024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.520743:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.520783:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049201024 00000100:00100000:0.0:1787826024.520788:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049201024 00010000:00010000:0.0:1787826024.520811:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00cec662 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec65b expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.520850:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12207 00000100:00100000:0.0:1787826024.520858:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3617:x1874663049201024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826024.520870:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826024.522415:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:187904:1874663049200896:0@lo:104: 00010000:00010000:2.0:1787826024.522622:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826024.526505:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869894 is committed 00010000:00010000:1.0:1787826024.526737:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00cec662 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec65b expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.526767:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3f:0x0].0x0 (ffff8eb45edbd900) 00010000:00010000:1.0:1787826024.526774:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.526784:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.526793:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.526837:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826024.527033:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049201024:12345-0@lo:103:ldlm_bl.0 Request processed in 6172us (6286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.527046:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12207 00010000:00010000:0.0:1787826024.527321:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.527374:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826024.527466:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x3f:0x0]: returning size 4096 00000004:00200000:0.0:1787826024.527474:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826024.527531:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cec693 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.527559:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 7 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.527568:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3f:0x0].0x0 (ffff8eb45edbd900) 00010000:00010000:0.0:1787826024.527572:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826024.527574:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510200, rc 0) 00000100:00100000:0.0:1787826024.527811:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155769:x1874663042942976:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 8678us (9118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.527821:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 835 00000100:00100000:3.0:1787826024.533891:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049201024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.534162:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.534554:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042943232 00000100:00100000:3.0:1787826024.534564:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042943232 00000100:00100000:3.0:1787826024.534656:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 836 00000100:00100000:3.0:1787826024.534671:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155769:x1874663042943232:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:3.0:1787826024.534758:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826024.534794:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec67e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efcd expref: 43 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.534817:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcb:0x0].0x0 (ffff8eb449543800) 00010000:00010000:3.0:1787826024.534823:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826024.534851:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.534867:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.534877:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.534888:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.534898:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.534904:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.535011:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.535020:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.535032:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.535054:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.535064:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 42 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.535073:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.535112:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 42 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.535128:0:187906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 42 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.535671:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:187906:1874663049201152:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826024.535940:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.557965:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.558074:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042943360 00000100:00100000:0.0:1787826024.558086:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042943360 00010000:00010000:0.0:1787826024.558143:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 43 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.558208:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12208 00000100:00100000:0.0:1787826024.558221:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:2392:x1874663042943360:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826024.558242:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.558249:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 5/0,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 43 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.558265:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 43 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.558292:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3f:0x0].0x0 (ffff8eb449543a00) 00010000:00010000:0.0:1787826024.558299:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.558311:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.558319:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.558402:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826024.558475:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:2392:x1874663042943360:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 255us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.558484:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12208 00010000:00010000:3.0:1787826024.558879:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec68c lrc: 0/0,0 mode: --/PR res: [0x200026560:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efd4 expref: 42 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.558901:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:187906:1874663049201152:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826024.558931:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.558941:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.558949:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.559013:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.559022:0:187906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.559034:0:187906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.559059:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187906:1874663049201280:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787826024.559120:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.559234:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.561367:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049201280 00000100:00100000:0.0:1787826024.561389:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049201280 00000100:00100000:0.0:1787826024.561468:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12486 00000100:00100000:0.0:1787826024.561478:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187906:x1874663049201280:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787826024.561502:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.561528:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec6bd expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.561566:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 6 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.561576:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.562375:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 6 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.562408:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 6 pid: 187904 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.562426:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b59500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049201408:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826024.564003:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.576547:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.577073:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b59500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049201408:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826024.577125:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.577149:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3f:0x0].0x0 (ffff8eb45edbd900) 00010000:00010000:0.0:1787826024.577153:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826024.577157:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.577169:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.577177:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ece00, rc 0) 00000100:00100000:0.0:1787826024.577281:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187906:x1874663049201280:12345-0@lo:101:mdt00_002.0 Request processed in 15804us (18160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.577291:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12486 00000100:00100000:2.0:1787826024.577747:0:187906:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869894 gen 2 00000004:00080000:2.0:1787826024.577755:0:187906:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869893 committed transno 17179869894 00000004:00080000:2.0:1787826024.577785:0:187906:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869894 committed transno 17179869894 00000100:00100000:2.0:1787826024.577800:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187906:1874663049201280:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787826024.577821:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.577836:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.582130:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042943488 00000100:00100000:3.0:1787826024.582146:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042943488 00010000:00010000:3.0:1787826024.582199:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 7 pid: 187904 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.582249:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12209 00000100:00100000:3.0:1787826024.582259:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042943488:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.582273:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826024.582280:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 7 pid: 187904 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.582294:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 7 pid: 187904 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.582322:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cec69a lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efdb expref: 7 pid: 187904 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.582358:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3f:0x0].0x0 (ffff8eb45edbd900) 00010000:00010000:3.0:1787826024.582366:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.582376:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.582384:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.582419:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 6 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.582432:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725ea680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049201536:0@lo:105: 00000100:00100000:3.0:1787826024.582494:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.582532:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.584621:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049201536 00000100:00100000:0.0:1787826024.584649:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049201536 00000100:00100000:0.0:1787826024.584746:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4760 00000100:00100000:0.0:1787826024.584760:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049201536:12345-0@lo:105: 00010000:00010000:0.0:1787826024.584782:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.584796:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.584805:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.584815:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.584823:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.584832:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.584870:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab19c00) 00010000:00010000:2.0:1787826024.584938:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.584957:0:187906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.584988:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049201536:12345-0@lo:105: Request processed in 227us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.584998:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4760 00000100:00100000:3.0:1787826024.585525:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725ea680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049201536:0@lo:105: 00010000:00010000:3.0:1787826024.585550:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826024.585605:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042943488:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 3345us (9065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.585675:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12209 00000100:00100000:2.0:1787826024.585757:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187906:1874663049201664:0@lo:403:mdt00_002.0 00000100:00100000:2.0:1787826024.585830:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.586000:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.586247:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049201664 00000100:00100000:1.0:1787826024.586256:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049201664 00000100:00100000:1.0:1787826024.586306:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12487 00000100:00100000:1.0:1787826024.586316:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187906:x1874663049201664:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1787826024.590073:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187906:x1874663049201664:12345-0@lo:403:mdt00_002.0 Request processed in 3747us (4232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.590087:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12487 00000100:00100000:2.0:1787826024.590211:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187906:1874663049201664:0@lo:403:mdt00_002.0 00000040:00080000:2.0:1787826024.591471:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].469, 656 off716784 00000040:00080000:2.0:1787826024.591659:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].341, 736 off563232 00000004:00080000:2.0:1787826024.591666:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172c00 with version 713 00000004:00080000:1.0:1787826024.592095:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 713 rpc_version 713 00000020:00100000:1.0:1787826024.592131:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826024.592141:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4774f0700 x1874663049201920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826024.592164:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049201920:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826024.592221:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.592255:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.592304:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049201920 00000100:00100000:3.0:1787826024.592320:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049201920 00000100:00100000:0.0:1787826024.592607:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12488 00000100:00100000:0.0:1787826024.592623:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049201920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826024.592871:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049201920:12345-0@lo:1000:osp_up1-0.0 Request processed in 254us (649us total) trans 17179869895 rc 0/0 00000100:00100000:0.0:1787826024.592879:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12488 00000100:00100000:1.0:1787826024.593091:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049201920:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826024.593154:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcb:0x0]: returning size 4096 00010000:00010000:2.0:1787826024.593176:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593186:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593195:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593201:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.593206:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593214:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593230:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3f:0x0].0x0 (ffff8eb449543a00) 00010000:00010000:2.0:1787826024.593233:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826024.593238:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593244:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec6b6 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593259:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593267:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593273:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593295:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826024.593303:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x3f:0x0] 00010000:00010000:2.0:1787826024.593309:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593314:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593321:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.593377:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826024.593390:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.593415:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826024.593422:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593461:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc1a414f0) 00000004:00010000:3.0:1787826024.593464:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593468:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593493:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593506:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcb:0x0].0x0 (ffff8eb449543800) 00010000:00010000:2.0:1787826024.593509:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826024.593513:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593520:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec6af lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.593525:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.593536:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826024.593537:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593548:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593555:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.593566:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593573:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.593582:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19c00/0x878a5eea00cec6bd lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec6c4 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593583:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593616:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593640:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.593643:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.593646:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593653:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec6a1 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.593663:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000441533bc reply state 000000008cb500ec transno 335007449211 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593675:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.593682:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.593685:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.593687:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826024.593756:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155769:x1874663042943232:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 59086us (59596us total) trans 335007449211 rc 0/0 00000100:00100000:2.0:1787826024.593764:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 836 00010000:00010000:3.0:1787826024.593810:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826024.593813:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826024.593816:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826024.594037:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049202048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.594078:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.594118:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049202048 00000100:00100000:0.0:1787826024.594124:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049202048 00000100:00100000:0.0:1787826024.594167:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4203 00000100:00100000:0.0:1787826024.594176:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3619:x1874663049202048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826024.594188:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.594208:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6c4 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec6bd expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.594225:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x3f:0x0].0x0 (ffff8eb45edbd900) 00010000:00010000:0.0:1787826024.594243:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826024.594276:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049202048:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.594282:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4203 00000100:00100000:0.0:1787826024.594317:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049202048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826024.627447:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.627599:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042943616 00000100:00100000:2.0:1787826024.627610:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042943616 00000100:00100000:2.0:1787826024.627680:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 837 00000100:00100000:2.0:1787826024.627690:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155772:x1874663042943616:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826024.627716:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.627741:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec6cb lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efe2 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627808:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627822:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627833:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627843:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627850:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627856:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627911:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627919:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627925:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627931:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.627936:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627947:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627960:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.627963:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.627966:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627973:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec6d2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627987:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.627994:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.628000:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.628005:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.628007:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.628013:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.628019:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.628021:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.628024:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.628030:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6d9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.628056:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec6cb lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efe2 expref: 44 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.628189:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.628194:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.628200:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec6cb lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efe2 expref: 44 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.628211:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:2.0:1787826024.628276:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155772:x1874663042943616:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 586us (839us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826024.628283:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 837 00000100:00100000:2.0:1787826024.638528:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.638640:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042943744 00000100:00100000:0.0:1787826024.638651:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042943744 00000100:00100000:0.0:1787826024.638715:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 838 00000100:00100000:0.0:1787826024.638725:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155772:x1874663042943744:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826024.638744:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.638762:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec6e0 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6efe9 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638824:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638838:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638849:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638861:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638869:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638875:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638930:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638937:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638943:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638948:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826024.638953:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638960:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638970:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826024.638973:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826024.638978:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638985:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec6e7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.638999:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639006:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639011:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639016:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ece00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826024.639019:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639025:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639033:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826024.639035:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826024.639038:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639043:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cec6ee lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639147:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec6e0 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efe9 expref: 44 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639165:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826024.639168:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826024.639172:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec6e0 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6efe9 expref: 44 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.639182:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed200, rc 0) 00000100:00100000:0.0:1787826024.639392:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155772:x1874663042943744:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 666us (874us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826024.639399:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 838 00000100:00100000:0.0:1787826024.649472:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.649622:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042943872 00000100:00100000:2.0:1787826024.649642:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042943872 00000100:00100000:2.0:1787826024.649703:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 839 00000100:00100000:2.0:1787826024.649714:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+43:155772:x1874663042943872:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826024.649731:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.649750:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec6f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eff0 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.649818:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6fc lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.649836:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6fc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.649846:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6fc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826024.649901:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826024.649905:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826024.649923:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6fc lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.649947:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec6f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eff0 expref: 45 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.649965:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6fc lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eff0 expref: 44 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.649975:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.649978:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826024.649981:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511a00, rc 0) 00000100:00100000:2.0:1787826024.650046:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+44:155772:x1874663042943872:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 333us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.650053:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 839 00000100:00100000:1.0:1787826024.662479:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.662589:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042944128 00000100:00100000:2.0:1787826024.662599:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042944128 00000100:00100000:2.0:1787826024.662674:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 840 00000100:00100000:2.0:1787826024.662685:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+44:155772:x1874663042944128:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:2.0:1787826024.662738:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826024.662763:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec6fc lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eff0 expref: 44 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.662784:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.662788:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826024.662839:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.662853:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.662863:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.662875:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.662885:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.662904:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826024.663984:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].470, 2152 off718936 00000040:00080000:2.0:1787826024.664060:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].342, 2352 off565584 00000004:00080000:2.0:1787826024.664066:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34925e0c0 with version 714 00000004:00080000:1.0:1787826024.665758:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 714 rpc_version 714 00000020:00100000:1.0:1787826024.665802:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826024.665813:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b41180 x1874663049202304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826024.665836:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049202304:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826024.665916:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.665954:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.666039:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049202304 00000100:00100000:3.0:1787826024.666056:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049202304 00000100:00100000:3.0:1787826024.666160:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12489 00000100:00100000:3.0:1787826024.666174:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049202304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826024.670779:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049202304:12345-0@lo:1000:osp_up1-0.0 Request processed in 4597us (4852us total) trans 17179869896 rc 0/0 00000100:00100000:3.0:1787826024.670801:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12489 00000100:00100000:1.0:1787826024.670930:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049202304:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787826024.671140:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.671157:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.671174:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.671193:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.671201:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.671208:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.671245:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.671252:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.671262:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.671281:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049202432:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1787826024.671381:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.671416:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.671437:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049202432 00000100:00100000:0.0:1787826024.671450:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049202432 00000100:00100000:0.0:1787826024.671528:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12490 00000100:00100000:0.0:1787826024.671539:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187905:x1874663049202432:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787826024.671566:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.671592:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec726 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec71f expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.671626:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec726 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec71f expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.671654:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec726 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec71f expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.671664:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x40:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:0.0:1787826024.671668:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826024.671673:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed200, rc 0) 00000100:00100000:0.0:1787826024.671742:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187905:x1874663049202432:12345-0@lo:101:mdt00_001.0 Request processed in 205us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.671749:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12490 00000100:00100000:1.0:1787826024.671809:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049202432:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787826024.671827:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671838:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826024.671857:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c3be7e8 reply state 000000000d00883a transno 335007449212 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671875:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671884:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x40:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:1.0:1787826024.671897:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826024.671901:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826024.671908:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671916:0:187905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826024.671927:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x40:0x0] 00000004:00010000:1.0:1787826024.671934:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c3be7e8 reply state 000000000d00883a transno 335007449212 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671943:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671950:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcc:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:1.0:1787826024.671952:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826024.671954:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826024.671958:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcc:0x0]: returning size 4096 00010000:00010000:1.0:1787826024.671966:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671972:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671979:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.671988:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.671992:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.672001:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.672011:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826024.672013:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.672016:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.672023:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec703 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826024.672043:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c3be7e8 reply state 000000000d00883a transno 335007449212 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.672052:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.672059:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826024.672062:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826024.672064:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826024.672251:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:155772:x1874663042944128:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 9565us (9778us total) trans 335007449212 rc 0/0 00000100:00100000:1.0:1787826024.672260:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 840 00000100:00100000:1.0:1787826024.709610:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.709893:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042944256 00000100:00100000:0.0:1787826024.709910:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042944256 00000100:00100000:0.0:1787826024.710035:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 841 00000100:00100000:0.0:1787826024.710050:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+45:155775:x1874663042944256:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826024.710085:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.710112:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec72d lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6eff7 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.710201:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.710217:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.710229:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.710243:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.710252:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.710259:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710728:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec742 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710741:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec742 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710749:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec742 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826024.710866:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcc:0x0]: returning size 4096 00000004:00200000:1.0:1787826024.710871:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787826024.710894:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec742 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710908:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710916:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710923:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710929:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.710933:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710941:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710955:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826024.710959:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.710964:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710976:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cec734 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710993:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.710999:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.711005:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.711011:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.711013:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.711019:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.711026:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826024.711028:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.711031:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.711037:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cec73b lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.711065:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cec72d lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eff7 expref: 47 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.711085:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec742 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eff7 expref: 46 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.711093:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcc:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:1.0:1787826024.711096:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826024.711099:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f200, rc 0) 00000100:00100000:1.0:1787826024.711197:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+46:155775:x1874663042944256:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 1149us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.711206:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 841 00000100:00100000:0.0:1787826024.724911:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.728038:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042944384 00000100:00100000:2.0:1787826024.728061:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042944384 00000100:00100000:2.0:1787826024.728224:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 842 00000100:00100000:2.0:1787826024.728238:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+46:155775:x1874663042944384:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826024.728264:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826024.728290:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec749 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6effe expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.728386:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.728403:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.728417:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826024.728481:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x40:0x0]: returning size 4096 00000004:00200000:2.0:1787826024.728488:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826024.728872:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec749 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 48 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.728897:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 47 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.728908:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x40:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826024.728911:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826024.728915:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715c00, rc 0) 00000100:00100000:2.0:1787826024.729001:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155775:x1874663042944384:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 766us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.729010:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 842 00000100:00100000:2.0:1787826024.732674:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826024.733034:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042944512 00000100:00100000:1.0:1787826024.733048:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042944512 00000100:00100000:1.0:1787826024.733127:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 843 00000100:00100000:1.0:1787826024.733140:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155775:x1874663042944512:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:1.0:1787826024.733168:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.733197:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cec757 lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f005 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.734094:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.734115:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec726 lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec71f expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.734124:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.734171:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec726 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec71f expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.734192:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049202560:0@lo:104: 00000100:00100000:1.0:1787826024.734557:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.734613:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.734766:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049202560 00000100:00100000:0.0:1787826024.734773:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049202560 00000100:00100000:0.0:1787826024.734864:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4761 00000100:00100000:0.0:1787826024.734874:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049202560:12345-0@lo:104: 00010000:00010000:0.0:1787826024.734890:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.734965:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826024.734972:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187905:x1874663049202560:12345-0@lo:104: Request processed in 99us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.734980:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4761 00000100:00100000:1.0:1787826024.735055:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187905:1874663049202560:0@lo:104: 00010000:00010000:1.0:1787826024.735079:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.735129:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826024.735139:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.735155:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826024.735161:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.735171:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.735204:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.735211:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826024.735244:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.735261:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb481715800/0x878a5eea00cec71f lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec726 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.735284:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826024.735287:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826024.735288:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826024.735883:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049202688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826024.735931:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.736051:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049202688 00000100:00100000:2.0:1787826024.736057:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049202688 00010000:00010000:2.0:1787826024.736086:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec726 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec71f expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.736121:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12210 00000100:00100000:2.0:1787826024.736130:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049202688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826024.736146:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787826024.744875:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869896 is committed 00010000:00010000:2.0:1787826024.749955:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec726 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec71f expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.749989:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x40:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:2.0:1787826024.749996:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.750009:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.750019:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.750208:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826024.750430:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049202688:12345-0@lo:103:ldlm_bl.0 Request processed in 14297us (14494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.750443:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12210 00010000:00010000:1.0:1787826024.750879:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.750891:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826024.750977:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x40:0x0]: returning size 4096 00000004:00200000:1.0:1787826024.750983:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826024.751044:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00cec757 lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.751063:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.751073:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x40:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:1.0:1787826024.751076:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826024.751079:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f400, rc 0) 00000100:00100000:1.0:1787826024.751190:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155775:x1874663042944512:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 18051us (18530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.751199:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 843 00000100:00100000:0.0:1787826024.751302:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049202688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826024.756120:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.756233:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042944768 00000100:00100000:2.0:1787826024.756247:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042944768 00000100:00100000:2.0:1787826024.756774:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 844 00000100:00100000:2.0:1787826024.756789:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155775:x1874663042944768:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:2.0:1787826024.756869:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826024.756906:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f200/0x878a5eea00cec742 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6eff7 expref: 47 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.756930:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcc:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:2.0:1787826024.756937:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826024.756967:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.756985:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757003:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757017:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757030:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757038:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757151:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757160:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757168:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757191:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757201:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 46 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757211:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 4/0,1 mode: --/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757270:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 46 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.757288:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 46 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.757306:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049202816:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826024.758476:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826024.764461:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187904:1874663049202816:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826024.764504:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.765681:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.766012:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042944896 00000100:00100000:2.0:1787826024.766024:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042944896 00010000:00010000:2.0:1787826024.766079:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 47 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.766122:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12211 00000100:00100000:2.0:1787826024.766134:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:2392:x1874663042944896:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826024.766152:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826024.766161:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 47 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.766176:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 47 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.766206:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec750 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x40:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6effe expref: 47 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.766231:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x40:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826024.766237:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,1 mode: --/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.766259:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.766268:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.766304:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826024.767363:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.767390:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.767468:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.767475:0:187904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.767495:0:187904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.767523:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049202944:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787826024.767592:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.767645:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.767679:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049202944 00000100:00100000:1.0:1787826024.767687:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049202944 00000100:00100000:1.0:1787826024.767739:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12491 00000100:00100000:1.0:1787826024.767749:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187904:x1874663049202944:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787826024.767768:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.767787:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec781 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.767822:0:177386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.767831:0:177386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.767859:0:177386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.767873:0:177386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 6 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.767885:0:177386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049203072:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826024.767976:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+46:2392:x1874663042944896:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1842us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.767987:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12211 00000100:00100000:1.0:1787826024.768577:0:177386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.783486:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826024.783694:0:177386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177386:1874663049203072:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826024.783700:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042945024 00000100:00100000:2.0:1787826024.783711:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042945024 00010000:00010000:1.0:1787826024.783742:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.783758:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x40:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:2.0:1787826024.783762:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 7 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.783763:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826024.783782:0:177386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.783796:0:177386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.783812:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e800, rc 0) 00000100:00100000:2.0:1787826024.783842:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12212 00000100:00100000:2.0:1787826024.783863:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2390:x1874663042945024:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826024.783894:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826024.783906:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 7 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.783928:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 7 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.783977:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049202944:12345-0@lo:101:mdt00_000.0 Request processed in 16228us (16383us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826024.783985:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00cec75e lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f005 expref: 7 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.783989:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12491 00010000:00010000:2.0:1787826024.784020:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x40:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:2.0:1787826024.784029:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.784047:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.784062:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.784122:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 6 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.784134:0:187904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869896 gen 2 00000004:00080000:0.0:1787826024.784142:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869895 committed transno 17179869896 00000100:00100000:2.0:1787826024.784152:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049203200:0@lo:105: 00000004:00080000:0.0:1787826024.784166:0:187904:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869896 committed transno 17179869896 00000100:00100000:0.0:1787826024.784184:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049202944:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787826024.784201:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.784213:0:187904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.784230:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.784287:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049203200 00000100:00100000:1.0:1787826024.784292:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049203200 00000100:00100000:2.0:1787826024.784318:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.784354:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4762 00000100:00100000:1.0:1787826024.784363:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049203200:12345-0@lo:105: 00010000:00010000:1.0:1787826024.784374:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.784385:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.784394:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 5/0,1 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.784403:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.784410:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.784419:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 6/0,1 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.784456:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb479b3fc00) 00000100:00100000:1.0:1787826024.784487:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:10369:x1874663049203200:12345-0@lo:105: Request processed in 125us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.784493:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4762 00000100:00100000:2.0:1787826024.784551:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10369:1874663049203200:0@lo:105: 00010000:00010000:2.0:1787826024.784570:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826024.784642:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042945024:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 787us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.784650:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12212 00010000:00010000:2.0:1787826024.784677:0:187904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.784693:0:187904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.788239:0:187904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049203328:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787826024.788383:0:187904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.788433:0:187904:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb443e5b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.788888:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049203328 00000100:00100000:0.0:1787826024.788899:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049203328 00000100:00100000:0.0:1787826024.788968:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12492 00000100:00100000:0.0:1787826024.788980:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049203328:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787826024.798972:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187904:x1874663049203328:12345-0@lo:403:mdt00_000.0 Request processed in 9979us (10586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.798993:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12492 00000100:00100000:2.0:1787826024.799269:0:187904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187904:1874663049203328:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1787826024.803911:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].471, 944 off719880 00000040:00080000:3.0:1787826024.804195:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].343, 1024 off566608 00000004:00080000:3.0:1787826024.804203:0:187904:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb443e5b900 with version 715 00000004:00080000:0.0:1787826024.809763:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 715 rpc_version 715 00000020:00100000:1.0:1787826024.814714:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826024.814739:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb448d14700 x1874663049203584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826024.815040:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049203584:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826024.815138:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.815188:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826024.815260:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049203584 00000100:00100000:3.0:1787826024.815272:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049203584 00000100:00100000:3.0:1787826024.815368:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12493 00000100:00100000:3.0:1787826024.815387:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049203584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826024.815773:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049203584:12345-0@lo:1000:osp_up1-0.0 Request processed in 386us (633us total) trans 17179869897 rc 0/0 00000100:00100000:3.0:1787826024.815781:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12493 00000100:00100000:2.0:1787826024.816088:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049203584:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1787826024.816211:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcc:0x0]: returning size 4096 00010000:00010000:3.0:1787826024.816237:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816257:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816267:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816273:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.816278:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816291:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816309:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x40:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:3.0:1787826024.816312:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826024.816317:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 2/0,0 mode: --/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816573:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec77a lrc: 0/0,0 mode: --/EX res: [0x200026560:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816595:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816604:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816612:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816644:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787826024.816655:0:187904:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x40:0x0] 00010000:00010000:3.0:1787826024.816664:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816671:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816677:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816688:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.816691:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816698:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816708:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcc:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:3.0:1787826024.816710:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826024.816713:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816719:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec773 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816734:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816741:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816747:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816753:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.816755:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816761:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816773:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.816776:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.816779:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816785:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec765 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826024.816796:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000639477b3 reply state 0000000029aef2f0 transno 335007449213 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816811:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.816818:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826024.816821:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826024.816824:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826024.816955:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155775:x1874663042944768:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 60166us (60849us total) trans 335007449213 rc 0/0 00000100:00100000:3.0:1787826024.816963:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 844 00010000:00010000:0.0:1787826024.817024:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826024.817032:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.817041:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fc00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826024.817045:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826024.817054:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.817089:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.817096:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826024.817127:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.817134:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3fc00/0x878a5eea00cec781 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec788 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.817154:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.817155:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826024.817157:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826024.817193:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049203712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826024.817245:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.817358:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049203712 00000100:00100000:0.0:1787826024.817365:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049203712 00000100:00100000:0.0:1787826024.817416:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4204 00000100:00100000:0.0:1787826024.817424:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049203712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826024.817438:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.817459:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00cec788 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec781 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.817472:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x40:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:0.0:1787826024.817481:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826024.817521:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049203712:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.817527:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4204 00000100:00100000:3.0:1787826024.817779:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049203712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826024.847990:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826024.851758:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042945152 00000100:00100000:2.0:1787826024.851772:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042945152 00000100:00100000:0.0:1787826024.851948:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 845 00000100:00100000:0.0:1787826024.851963:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155781:x1874663042945152:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826024.851994:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.852019:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec78f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f00c expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852096:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852113:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852126:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852137:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852145:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852153:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852200:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852207:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852214:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852221:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826024.852226:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852233:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852246:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826024.852249:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826024.852253:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852259:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec796 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852275:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852280:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852287:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852292:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826024.852295:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852301:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852308:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826024.852311:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826024.852314:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852320:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec79d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852408:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec78f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f00c expref: 48 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852419:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826024.852421:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826024.852425:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec78f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f00c expref: 48 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.852435:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed400, rc 0) 00000100:00100000:0.0:1787826024.852527:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155781:x1874663042945152:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 565us (4550us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826024.852536:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 845 00000100:00100000:1.0:1787826024.855743:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.857532:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042945280 00000100:00100000:3.0:1787826024.857554:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042945280 00000100:00100000:3.0:1787826024.857662:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 846 00000100:00100000:3.0:1787826024.857795:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155781:x1874663042945280:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826024.857828:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.857856:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7a4 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f013 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.857942:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.857960:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.857974:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.857989:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.857998:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858005:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858060:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858068:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858074:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858081:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.858086:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858096:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858110:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.858114:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.858119:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858126:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7ab lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858141:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858147:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858153:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858158:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.858161:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858167:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858174:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826024.858177:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.858181:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858187:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7b2 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858217:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7a4 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f013 expref: 48 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858227:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.858230:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.858234:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7a4 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f013 expref: 48 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.858244:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19c00, rc 0) 00000100:00100000:3.0:1787826024.858555:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155781:x1874663042945280:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 879us (2825us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826024.862191:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 846 00000100:00100000:2.0:1787826024.862405:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.862643:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042945408 00000100:00100000:3.0:1787826024.862657:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042945408 00000100:00100000:3.0:1787826024.862834:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 847 00000100:00100000:3.0:1787826024.862848:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+47:155781:x1874663042945408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826024.862874:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.862903:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f01a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.862991:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec7c0 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.863015:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec7c0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.863028:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec7c0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826024.863091:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:3.0:1787826024.863096:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826024.863121:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec7c0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.863149:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f01a expref: 49 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.863170:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec7c0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f01a expref: 48 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.863179:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.863182:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826024.863187:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18c00, rc 0) 00000100:00100000:3.0:1787826024.863274:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+48:155781:x1874663042945408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 429us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.863282:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 847 00000100:00100000:1.0:1787826024.868657:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.868831:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042945664 00000100:00100000:3.0:1787826024.868846:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042945664 00000100:00100000:3.0:1787826024.868912:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 848 00000100:00100000:3.0:1787826024.868922:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+48:155781:x1874663042945664:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:3.0:1787826024.868990:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826024.869028:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec7c0 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f01a expref: 48 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.869051:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.869059:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826024.869135:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.869149:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.869160:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.869173:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.869184:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.869190:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826024.873894:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].473, 2152 off723048 00000040:00080000:2.0:1787826024.873995:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].344, 2352 off568960 00000004:00080000:2.0:1787826024.874003:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb342682900 with version 716 00000004:00080000:1.0:1787826024.874135:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 716 rpc_version 716 00000020:00100000:1.0:1787826024.874184:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826024.874199:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b41180 x1874663049203968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826024.874227:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049203968:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826024.874563:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826024.874658:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826024.874762:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049203968 00000100:00100000:2.0:1787826024.874772:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049203968 00000100:00100000:2.0:1787826024.874862:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12494 00000100:00100000:2.0:1787826024.874873:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049203968:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826024.875426:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049203968:12345-0@lo:1000:osp_up1-0.0 Request processed in 553us (863us total) trans 17179869898 rc 0/0 00000100:00100000:2.0:1787826024.875435:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12494 00000100:00100000:0.0:1787826024.875738:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049203968:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826024.875908:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.875927:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.875940:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.875965:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 3/0,1 mode: --/PW res: [0x200026560:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.875973:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.875979:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.876015:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.876023:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.876034:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.876053:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049204096:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826024.876097:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.876432:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.876569:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049204096 00000100:00100000:1.0:1787826024.876577:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049204096 00000100:00100000:1.0:1787826024.876640:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12495 00000100:00100000:1.0:1787826024.876650:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049204096:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826024.876672:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.876693:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec7ea lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec7e3 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876728:0:177390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec7ea lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec7e3 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876742:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec7ea lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec7e3 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876751:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x41:0x0].0x0 (ffff8eb45edbd700) 00010000:00010000:1.0:1787826024.876755:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.876758:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f000, rc 0) 00000100:00100000:1.0:1787826024.876805:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049204096:12345-0@lo:101:mdt00_003.0 Request processed in 155us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.876812:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12495 00000100:00100000:1.0:1787826024.876847:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049204096:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826024.876864:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876875:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826024.876901:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3f1b369 reply state 000000006ebf17f1 transno 335007449214 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876915:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876922:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x41:0x0].0x0 (ffff8eb481697c00) 00010000:00010000:1.0:1787826024.876925:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826024.876928:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826024.876934:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876943:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826024.876954:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x41:0x0] 00000004:00010000:1.0:1787826024.876963:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3f1b369 reply state 000000006ebf17f1 transno 335007449214 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876971:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.876978:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcd:0x0].0x0 (ffff8eb481697000) 00010000:00010000:1.0:1787826024.876980:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826024.876982:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826024.876988:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcd:0x0]: returning size 4096 00010000:00010000:1.0:1787826024.876997:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.877004:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.877012:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.877019:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826024.877025:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.877034:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.877046:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826024.877049:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826024.877053:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.877059:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec7c7 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826024.877073:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3f1b369 reply state 000000006ebf17f1 transno 335007449214 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.877083:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.877090:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:1.0:1787826024.877093:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826024.877095:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826024.877175:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155781:x1874663042945664:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 8252us (8530us total) trans 335007449214 rc 0/0 00000100:00100000:1.0:1787826024.877183:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 848 00000100:00100000:2.0:1787826024.891982:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.892170:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042945792 00000100:00100000:3.0:1787826024.892184:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042945792 00000100:00100000:3.0:1787826024.892313:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 849 00000100:00100000:3.0:1787826024.892345:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+49:155785:x1874663042945792:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826024.892378:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.892416:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec7f1 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f021 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892511:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892533:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892546:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892559:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892567:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892574:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892697:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec806 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892715:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec806 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892722:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec806 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826024.892825:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcd:0x0]: returning size 4096 00000004:00200000:3.0:1787826024.892830:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826024.892852:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec806 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892870:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892878:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892885:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892891:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.892896:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892903:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892916:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826024.892919:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.892924:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892930:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec7f8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892945:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892951:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892957:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892964:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826024.892967:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892973:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892978:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826024.892981:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826024.892983:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.892988:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec7ff lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.893017:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec7f1 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f021 expref: 51 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.893031:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec806 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f021 expref: 50 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.893039:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcd:0x0].0x0 (ffff8eb481697000) 00010000:00010000:3.0:1787826024.893041:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826024.893044:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18800, rc 0) 00000100:00100000:3.0:1787826024.893133:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+50:155785:x1874663042945792:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 808us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.893142:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 849 00000100:00100000:2.0:1787826024.906011:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.906149:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042945920 00000100:00100000:0.0:1787826024.906162:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042945920 00000100:00100000:0.0:1787826024.906245:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 850 00000100:00100000:0.0:1787826024.906268:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+50:155785:x1874663042945920:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826024.906296:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826024.906369:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec80d lrc: 2/0,0 mode: --/CR res: [0x200026560:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f028 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.906593:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.906612:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.906634:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826024.906705:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x41:0x0]: returning size 4096 00000004:00200000:0.0:1787826024.906882:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826024.906935:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cec80d lrc: 0/0,0 mode: --/CR res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 52 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.906959:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 51 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.906970:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x41:0x0].0x0 (ffff8eb481697c00) 00010000:00010000:0.0:1787826024.906974:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826024.906979:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed000, rc 0) 00000100:00100000:0.0:1787826024.907098:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155785:x1874663042945920:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 833us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.907106:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 850 00000100:00100000:1.0:1787826024.922015:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.922115:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042946048 00000100:00100000:3.0:1787826024.922129:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042946048 00000100:00100000:3.0:1787826024.922202:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 851 00000100:00100000:3.0:1787826024.922214:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155785:x1874663042946048:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:3.0:1787826024.922241:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826024.922268:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec81b lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f02f expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.923157:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.923607:0:188682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec7ea lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec7e3 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.923622:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.923762:0:188682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec7ea lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec7e3 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.923783:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188682:1874663049204224:0@lo:104: 00000100:00100000:3.0:1787826024.923866:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.923932:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.924263:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049204224 00000100:00100000:0.0:1787826024.924273:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049204224 00000100:00100000:0.0:1787826024.924650:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4763 00000100:00100000:0.0:1787826024.924666:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188682:x1874663049204224:12345-0@lo:104: 00010000:00010000:0.0:1787826024.924694:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.924789:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826024.924796:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:188682:x1874663049204224:12345-0@lo:104: Request processed in 135us (930us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826024.924844:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826024.924852:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.924863:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826024.924869:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.924880:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.924916:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.924921:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188682:1874663049204224:0@lo:104: 00010000:00010000:2.0:1787826024.924922:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826024.924947:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.924951:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.924955:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34ab19000/0x878a5eea00cec7e3 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec7ea expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.924978:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826024.924980:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826024.924982:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826024.924995:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049204352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826024.925035:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.925056:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4763 00000100:00100000:3.0:1787826024.925125:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049204352 00000100:00100000:3.0:1787826024.925131:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049204352 00010000:00010000:3.0:1787826024.925154:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec7ea lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec7e3 expref: 9 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.925188:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12213 00000100:00100000:3.0:1787826024.925200:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3618:x1874663049204352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.925212:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787826024.927812:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869898 is committed 00010000:00010000:3.0:1787826024.929949:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00cec7ea lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec7e3 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.929978:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x41:0x0].0x0 (ffff8eb45edbd700) 00010000:00010000:3.0:1787826024.929985:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.929998:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.930006:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.930504:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826024.930702:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049204352:12345-0@lo:103:ldlm_bl.0 Request processed in 5503us (5662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.930716:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12213 00000100:00100000:0.0:1787826024.931124:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049204352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.931246:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.931745:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826024.931902:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x41:0x0]: returning size 4096 00000004:00200000:2.0:1787826024.931910:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826024.931973:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec81b lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.931997:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 7 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.932008:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x41:0x0].0x0 (ffff8eb45edbd700) 00010000:00010000:2.0:1787826024.932011:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826024.932016:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18600, rc 0) 00000100:00100000:2.0:1787826024.932104:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155785:x1874663042946048:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 9891us (10104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.932113:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 851 00000100:00100000:1.0:1787826024.937820:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.937929:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042946304 00000100:00100000:3.0:1787826024.937943:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042946304 00000100:00100000:3.0:1787826024.938049:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 852 00000100:00100000:3.0:1787826024.938061:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155785:x1874663042946304:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:3.0:1787826024.938134:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826024.938173:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec806 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f021 expref: 51 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938195:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcd:0x0].0x0 (ffff8eb481697000) 00010000:00010000:3.0:1787826024.938201:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826024.938229:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938244:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938266:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938278:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938291:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938297:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938692:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938704:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938712:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938738:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938749:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 50 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938758:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 4/0,1 mode: --/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938803:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 50 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.938818:0:187905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 50 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826024.938835:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049204480:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826024.938991:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.946230:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826024.946782:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049204480:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826024.946821:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.947095:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042946432 00000100:00100000:2.0:1787826024.947105:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042946432 00010000:00010000:2.0:1787826024.947164:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 51 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.947213:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12214 00000100:00100000:2.0:1787826024.947225:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:2392:x1874663042946432:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826024.947245:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826024.947765:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 51 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.947782:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 51 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.947813:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec814 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x41:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f028 expref: 51 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.947835:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x41:0x0].0x0 (ffff8eb481697c00) 00010000:00010000:2.0:1787826024.947841:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,1 mode: --/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.947852:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.947860:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.947924:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826024.948002:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+50:2392:x1874663042946432:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 777us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.948011:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12214 00010000:00010000:3.0:1787826024.951787:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.951811:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.952068:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.952078:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.952094:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.952127:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049204608:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1787826024.952219:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.952728:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.952855:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049204608 00000100:00100000:1.0:1787826024.952867:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049204608 00000100:00100000:1.0:1787826024.952980:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12496 00000100:00100000:1.0:1787826024.952993:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187905:x1874663049204608:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787826024.953011:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826024.953033:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec84c lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec845 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.953068:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 6 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.953079:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec84c lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec845 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.953111:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 6 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.953125:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 6 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.953138:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddd880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049204736:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826024.953229:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826024.962867:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826024.965440:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042946560 00000100:00100000:0.0:1787826024.965460:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042946560 00010000:00010000:0.0:1787826024.965531:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 7 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.965590:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12215 00000100:00100000:0.0:1787826024.965603:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042946560:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826024.965624:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826024.965644:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 7 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.965662:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 7 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.965704:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x41:0x0].0x0 (ffff8eb45edbd700) 00010000:00010000:0.0:1787826024.965714:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec84c lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec845 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.965728:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec84c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec845 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.965739:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec84c lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec845 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826024.965788:0:8420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec84c lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec845 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826024.965806:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8420:1874663049204864:0@lo:105: 00000100:00100000:0.0:1787826024.965892:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.965966:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826024.966217:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049204864 00000100:00100000:2.0:1787826024.966223:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049204864 00000100:00100000:2.0:1787826024.966278:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4764 00000100:00100000:2.0:1787826024.966286:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8420:x1874663049204864:12345-0@lo:105: 00010000:00010000:2.0:1787826024.966299:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.966310:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.966320:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.966365:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.966371:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.966378:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.966411:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb441511c00) 00000100:00100000:2.0:1787826024.966465:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8420:x1874663049204864:12345-0@lo:105: Request processed in 179us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.966473:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4764 00000100:00100000:2.0:1787826024.966521:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8420:1874663049204864:0@lo:105: 00010000:00010000:2.0:1787826024.966542:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826024.966598:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042946560:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 998us (3746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826024.966610:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12215 00010000:00010000:1.0:1787826024.968068:0:177390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cec822 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f02f expref: 6 pid: 188682 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826024.968099:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddd880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177390:1874663049204736:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826024.968131:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec84c lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec845 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826024.968148:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x41:0x0].0x0 (ffff8eb45edbd700) 00010000:00010000:1.0:1787826024.968151:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826024.968154:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e600, rc 0) 00000100:00100000:1.0:1787826024.968707:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049204608:12345-0@lo:101:mdt00_001.0 Request processed in 15714us (16485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826024.968718:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12496 00000100:00100000:2.0:1787826024.968903:0:187905:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869898 gen 2 00000004:00080000:2.0:1787826024.968911:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869897 committed transno 17179869898 00000004:00080000:2.0:1787826024.968938:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869898 committed transno 17179869898 00000100:00100000:2.0:1787826024.968956:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049204608:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826024.968977:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826024.971808:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049204992:0@lo:403:mdt00_001.0 00000100:00100000:2.0:1787826024.971915:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826024.972027:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826024.972094:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049204992 00000100:00100000:0.0:1787826024.972103:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049204992 00000100:00100000:0.0:1787826024.972198:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12497 00000100:00100000:0.0:1787826024.972211:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049204992:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1787826024.978731:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049204992:12345-0@lo:403:mdt00_001.0 Request processed in 6506us (6801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826024.978751:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12497 00000100:00100000:2.0:1787826024.984623:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049204992:0@lo:403:mdt00_001.0 00000040:00080000:2.0:1787826024.985933:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].474, 656 off723704 00000040:00080000:2.0:1787826024.986164:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].345, 736 off569696 00000004:00080000:2.0:1787826024.986170:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a10c0 with version 717 00000004:00080000:0.0:1787826024.986910:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 717 rpc_version 717 00000020:00100000:0.0:1787826024.986964:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826024.986979:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472974a80 x1874663049205248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826024.987008:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049205248:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826024.987100:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826024.987152:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1abc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826024.987791:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049205248 00000100:00100000:1.0:1787826024.987803:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049205248 00000100:00100000:1.0:1787826024.987881:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12498 00000100:00100000:1.0:1787826024.987893:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049205248:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826024.988557:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049205248:12345-0@lo:1000:osp_up1-0.0 Request processed in 663us (1455us total) trans 17179869899 rc 0/0 00000100:00100000:1.0:1787826024.988568:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12498 00000100:00100000:0.0:1787826024.988890:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049205248:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826024.988966:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcd:0x0]: returning size 4096 00010000:00010000:2.0:1787826024.988996:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989009:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989018:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989024:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.989029:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989039:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989058:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x41:0x0].0x0 (ffff8eb481697c00) 00010000:00010000:2.0:1787826024.989061:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826024.989066:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 2/0,0 mode: --/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989072:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec83e lrc: 0/0,0 mode: --/EX res: [0x200026560:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989090:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989099:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989106:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989130:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826024.989141:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x41:0x0] 00010000:00010000:2.0:1787826024.989150:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989156:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989162:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989171:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.989174:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989179:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989187:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcd:0x0].0x0 (ffff8eb481697000) 00010000:00010000:2.0:1787826024.989189:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826024.989192:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989197:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec837 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989211:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989218:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989224:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989229:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826024.989232:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989239:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989563:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826024.989566:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826024.989570:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989576:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec829 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826024.989588:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005958468f reply state 0000000085777152 transno 335007449215 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989604:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826024.989612:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826024.989615:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826024.989619:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826024.989778:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826024.989788:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.989795:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826024.989799:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826024.989807:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.989848:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.989855:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826024.989889:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.989896:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb441511c00/0x878a5eea00cec845 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec84c expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.989916:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826024.989918:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826024.989920:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826024.989962:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826024.989982:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049205376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826024.990145:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155785:x1874663042946304:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 52081us (52336us total) trans 335007449215 rc 0/0 00000100:00100000:2.0:1787826024.990154:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 852 00000100:00100000:0.0:1787826024.996977:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826024.997256:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049205376 00000100:00100000:3.0:1787826024.997270:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049205376 00000100:00100000:3.0:1787826024.997376:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4205 00000100:00100000:3.0:1787826024.997389:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049205376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826024.997411:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826024.997445:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00cec84c lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec845 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826024.997472:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x41:0x0].0x0 (ffff8eb45edbd700) 00010000:00010000:3.0:1787826024.997486:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826024.997549:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049205376:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826024.997557:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4205 00000100:00100000:0.0:1787826024.999491:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049205376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826025.016432:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826025.016635:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042946688 00000100:00100000:0.0:1787826025.016650:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042946688 00000100:00100000:0.0:1787826025.016732:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 853 00000100:00100000:0.0:1787826025.016744:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155789:x1874663042946688:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826025.016776:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826025.016805:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec853 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f036 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.016891:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.016909:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.016922:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.016936:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.016945:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.016952:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017006:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017014:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017021:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017027:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ede00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826025.017032:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017040:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017055:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826025.017058:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826025.017064:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017071:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec85a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017086:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017093:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017098:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017103:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826025.017106:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017112:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017119:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826025.017121:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826025.017124:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017130:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec861 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017160:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec853 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f036 expref: 52 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017170:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826025.017173:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826025.017178:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec853 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f036 expref: 52 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.017187:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724eca00, rc 0) 00000100:00100000:0.0:1787826025.017512:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155789:x1874663042946688:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 767us (1093us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826025.017522:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 853 00000100:00100000:1.0:1787826025.028789:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826025.028916:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042946816 00000100:00100000:2.0:1787826025.028930:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042946816 00000100:00100000:2.0:1787826025.029009:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 854 00000100:00100000:2.0:1787826025.029022:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155789:x1874663042946816:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826025.029049:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826025.029078:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec868 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f03d expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029162:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029179:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029192:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029204:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029212:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029218:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029290:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029298:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029305:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029312:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.029317:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029382:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029397:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826025.029400:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.029406:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029412:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec86f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029428:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029434:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029440:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029445:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.029448:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029454:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029462:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826025.029464:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.029467:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029474:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec876 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029506:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec868 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f03d expref: 52 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029517:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826025.029520:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.029524:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec868 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f03d expref: 52 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.029534:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:2.0:1787826025.029605:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155789:x1874663042946816:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 584us (831us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826025.029613:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 854 00000100:00100000:1.0:1787826025.036764:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826025.036977:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042946944 00000100:00100000:2.0:1787826025.036991:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042946944 00000100:00100000:2.0:1787826025.037108:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 855 00000100:00100000:2.0:1787826025.037121:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+51:155789:x1874663042946944:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826025.037146:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826025.037171:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec87d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f044 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.037266:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec884 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.037284:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec884 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.037298:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec884 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826025.037388:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826025.037393:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826025.037418:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec884 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.037448:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec87d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f044 expref: 53 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.037468:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec884 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f044 expref: 52 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.037478:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826025.037481:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826025.037486:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715c00, rc 0) 00000100:00100000:2.0:1787826025.037611:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+52:155789:x1874663042946944:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 492us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826025.037620:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 855 00000100:00100000:1.0:1787826025.049442:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826025.049730:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042947200 00000100:00100000:0.0:1787826025.049744:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042947200 00000100:00100000:0.0:1787826025.049825:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 856 00000100:00100000:0.0:1787826025.049838:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+52:155789:x1874663042947200:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826025.049917:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826025.049952:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec884 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f044 expref: 52 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.049976:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826025.049981:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826025.050057:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.050073:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.050084:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.050095:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.050107:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.050114:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826025.052913:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].475, 2152 off725856 00000040:00080000:0.0:1787826025.053047:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].346, 2352 off572048 00000004:00080000:0.0:1787826025.053056:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34e1abc00 with version 718 00000004:00080000:1.0:1787826025.059519:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 718 rpc_version 718 00000020:00100000:1.0:1787826025.059617:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826025.059645:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66d180 x1874663049205632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826025.059678:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049205632:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826025.059776:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826025.059836:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826025.059951:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049205632 00000100:00100000:3.0:1787826025.059962:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049205632 00000100:00100000:3.0:1787826025.060030:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12499 00000100:00100000:3.0:1787826025.060041:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049205632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826025.060756:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049205632:12345-0@lo:1000:osp_up1-0.0 Request processed in 714us (977us total) trans 17179869900 rc 0/0 00000100:00100000:3.0:1787826025.060768:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12499 00000100:00100000:1.0:1787826025.061567:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049205632:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826025.061765:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.061785:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.061799:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.061820:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.061828:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.061834:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.061873:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.061879:0:187906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.061888:0:187906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826025.061907:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187906:1874663049205760:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787826025.061958:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826025.061990:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826025.062097:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049205760 00000100:00100000:1.0:1787826025.062106:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049205760 00000100:00100000:1.0:1787826025.062157:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12500 00000100:00100000:1.0:1787826025.062167:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187906:x1874663049205760:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787826025.062193:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826025.062215:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec8ae lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec8a7 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.062240:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec8ae lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec8a7 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.062263:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec8ae lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec8a7 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.062273:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x42:0x0].0x0 (ffff8eb45edbd500) 00010000:00010000:1.0:1787826025.062276:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826025.062280:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f200, rc 0) 00000100:00100000:1.0:1787826025.062495:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187906:x1874663049205760:12345-0@lo:101:mdt00_002.0 Request processed in 328us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826025.062503:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12500 00000100:00100000:0.0:1787826025.062589:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187906:1874663049205760:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787826025.062609:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062620:0:187906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826025.062656:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd0a73fb reply state 0000000012c65d42 transno 335007449216 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062669:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062676:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x42:0x0].0x0 (ffff8eb47f8ffa00) 00010000:00010000:0.0:1787826025.062679:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826025.062683:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826025.062689:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062697:0:187906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826025.062710:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x42:0x0] 00000004:00010000:0.0:1787826025.062717:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd0a73fb reply state 0000000012c65d42 transno 335007449216 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062732:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062738:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bce:0x0].0x0 (ffff8eb47f8ff900) 00010000:00010000:0.0:1787826025.062741:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826025.062743:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787826025.062749:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bce:0x0]: returning size 4096 00010000:00010000:0.0:1787826025.062758:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062765:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062772:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062778:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826025.062783:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062791:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062802:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:0.0:1787826025.062805:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826025.062810:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062816:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cec88b lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826025.062834:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd0a73fb reply state 0000000012c65d42 transno 335007449216 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062842:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.062848:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:0.0:1787826025.062850:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826025.062852:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787826025.062949:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155789:x1874663042947200:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 13111us (13522us total) trans 335007449216 rc 0/0 00000100:00100000:0.0:1787826025.062957:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 856 00000100:00100000:0.0:1787826025.083852:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826025.083977:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042947328 00000100:00100000:2.0:1787826025.083991:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042947328 00000100:00100000:2.0:1787826025.084068:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 857 00000100:00100000:2.0:1787826025.084080:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+53:155796:x1874663042947328:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826025.084112:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826025.084139:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8b5 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f04b expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084230:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084246:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084270:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084284:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 24 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084292:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084299:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084445:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec8ca lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084454:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec8ca lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084462:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec8ca lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826025.084571:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bce:0x0]: returning size 4096 00000004:00200000:2.0:1787826025.084577:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826025.084601:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec8ca lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084619:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084634:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084642:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084649:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.084654:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084662:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084677:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826025.084681:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.084686:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084691:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8bc lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084706:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084713:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084720:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084725:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.084728:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084734:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084741:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826025.084743:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.084746:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084752:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8c3 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084784:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8b5 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f04b expref: 55 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084799:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec8ca lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f04b expref: 54 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.084806:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bce:0x0].0x0 (ffff8eb47f8ff900) 00010000:00010000:2.0:1787826025.084808:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826025.084811:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511a00, rc 0) 00000100:00100000:2.0:1787826025.084890:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+54:155796:x1874663042947328:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 813us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826025.084899:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 857 00000100:00100000:1.0:1787826025.091959:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826025.092077:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042947456 00000100:00100000:2.0:1787826025.092092:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042947456 00000100:00100000:2.0:1787826025.092173:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 858 00000100:00100000:2.0:1787826025.092186:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+54:155796:x1874663042947456:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:2.0:1787826025.092216:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826025.092244:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8d1 lrc: 2/0,0 mode: --/CR res: [0x200026560:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f052 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.092388:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 3/1,0 mode: --/PR res: [0x200026560:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.092405:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.092421:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 3/1,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826025.092485:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026560:0x42:0x0]: returning size 4096 00000004:00200000:2.0:1787826025.092492:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787826025.092536:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8d1 lrc: 0/0,0 mode: --/CR res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 56 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.092560:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 55 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.092572:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x42:0x0].0x0 (ffff8eb47f8ffa00) 00010000:00010000:2.0:1787826025.092575:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826025.092580:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715800, rc 0) 00000100:00100000:2.0:1787826025.092659:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155796:x1874663042947456:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 474us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826025.092671:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 858 00000100:00100000:1.0:1787826025.099769:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826025.099937:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042947584 00000100:00100000:0.0:1787826025.099951:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042947584 00000100:00100000:0.0:1787826025.100032:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 859 00000100:00100000:0.0:1787826025.100044:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155796:x1874663042947584:12345-192.168.203.47@tcp:101:rmdir.0 00010000:00010000:0.0:1787826025.100072:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826025.100101:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed400/0x878a5eea00cec8df lrc: 2/0,0 mode: --/CR res: [0x240001f58:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f059 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.100183:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.100201:0:187906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec8ae lrc: 2/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec8a7 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.100213:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 4/1,0 mode: --/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.100273:0:187906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec8ae lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cec8a7 expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826025.100292:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049205888:0@lo:104: 00000100:00100000:0.0:1787826025.100403:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826025.100444:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826025.100633:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049205888 00000100:00100000:1.0:1787826025.100638:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049205888 00000100:00100000:2.0:1787826025.100774:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4765 00000100:00100000:2.0:1787826025.100787:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049205888:12345-0@lo:104: 00010000:00010000:2.0:1787826025.100802:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.100884:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826025.100891:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187906:x1874663049205888:12345-0@lo:104: Request processed in 108us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826025.100898:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4765 00010000:00010000:3.0:1787826025.100981:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826025.100989:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.100998:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826025.101004:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826025.101013:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.101046:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.101057:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826025.101094:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 1/0,0 mode: --/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.101102:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb4724eda00/0x878a5eea00cec8a7 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cec8ae expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.101125:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826025.101127:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826025.101129:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826025.101137:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826025.101150:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049206016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826025.101190:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826025.101223:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049206016 00000100:00100000:3.0:1787826025.101227:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049206016 00010000:00010000:3.0:1787826025.101262:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec8ae lrc: 4/0,0 mode: PW/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00cec8a7 expref: 9 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826025.101286:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12216 00000100:00100000:3.0:1787826025.101293:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3619:x1874663049206016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826025.101304:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826025.103799:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187906:1874663049205888:0@lo:104: 00010000:00010000:0.0:1787826025.103842:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826025.108202:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869900 is committed 00010000:00010000:3.0:1787826025.108388:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00cec8ae lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cec8a7 expref: 7 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.108413:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x42:0x0].0x0 (ffff8eb45edbd500) 00010000:00010000:3.0:1787826025.108420:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 3/1,0 mode: --/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.108437:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.108446:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 4/1,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.108481:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826025.108583:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049206016:12345-0@lo:103:ldlm_bl.0 Request processed in 7289us (7390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826025.108594:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12216 00010000:00010000:0.0:1787826025.108858:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.108867:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 3/1,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826025.108941:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f58:0x42:0x0]: returning size 4096 00000004:00200000:0.0:1787826025.108945:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826025.108997:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed400/0x878a5eea00cec8df lrc: 0/0,0 mode: --/CR res: [0x240001f58:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.109013:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.109021:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x42:0x0].0x0 (ffff8eb45edbd500) 00010000:00010000:0.0:1787826025.109025:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826025.109028:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed200, rc 0) 00000100:00100000:0.0:1787826025.109090:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:155796:x1874663042947584:12345-192.168.203.47@tcp:101:rmdir.0 Request processed in 9049us (9337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826025.109099:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 859 00000100:00100000:1.0:1787826025.109620:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049206016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826025.112387:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826025.112601:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042947840 00000100:00100000:3.0:1787826025.112614:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042947840 00000100:00100000:2.0:1787826025.112796:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 860 00000100:00100000:2.0:1787826025.112812:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155796:x1874663042947840:12345-192.168.203.47@tcp:36:rmdir.0 00010000:00010000:2.0:1787826025.112885:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826025.112920:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cec8ca lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f04b expref: 55 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.112941:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bce:0x0].0x0 (ffff8eb47f8ff900) 00010000:00010000:2.0:1787826025.112947:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826025.112975:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.112992:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113002:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113018:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 24 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113030:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113036:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113132:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113139:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113146:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113165:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113175:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 2/0,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 54 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113183:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 4/0,1 mode: --/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113221:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 54 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.113241:0:187905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 54 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826025.113256:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049206144:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826025.116656:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826025.124410:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049206144:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826025.124454:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826025.128197:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826025.128524:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042947968 00000100:00100000:2.0:1787826025.128537:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042947968 00010000:00010000:2.0:1787826025.128594:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 55 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826025.128663:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12217 00000100:00100000:2.0:1787826025.128685:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:2392:x1874663042947968:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826025.128703:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826025.128781:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 4/0,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 55 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.128798:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 3/0,0 mode: PR/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 55 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.128826:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715800/0x878a5eea00cec8d8 lrc: 0/0,0 mode: --/PR res: [0x200026560:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f052 expref: 55 pid: 187905 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.128848:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x42:0x0].0x0 (ffff8eb47f8ffa00) 00010000:00010000:2.0:1787826025.128854:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,1 mode: --/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.128870:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.128879:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 4/0,1 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.128917:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826025.128979:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.128988:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826025.128999:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+54:2392:x1874663042947968:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 316us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826025.129007:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12217 00010000:00010000:1.0:1787826025.129047:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.129055:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.129065:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 3/0,1 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826025.129088:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049206272:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787826025.129144:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826025.129190:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826025.130858:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049206272 00000100:00100000:2.0:1787826025.130874:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049206272 00000100:00100000:2.0:1787826025.130949:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12501 00000100:00100000:2.0:1787826025.130962:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187905:x1874663049206272:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826025.130987:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826025.131013:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00cec910 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec909 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.131051:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 2/0,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.131063:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00cec910 lrc: 4/0,0 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec909 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.131102:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 3/0,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 6 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.131119:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 6 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826025.131134:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049206400:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826025.131242:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826025.137265:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826025.137579:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042948096 00000100:00100000:3.0:1787826025.137592:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042948096 00010000:00010000:3.0:1787826025.137668:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 7 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826025.137825:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12218 00000100:00100000:3.0:1787826025.137838:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2392:x1874663042948096:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826025.137856:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826025.137865:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 5/0,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 7 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.137881:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 4/0,0 mode: PR/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 7 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.137911:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x42:0x0].0x0 (ffff8eb45edbd500) 00010000:00010000:3.0:1787826025.137920:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00cec910 lrc: 3/0,0 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec909 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.137934:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00cec910 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec909 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.137945:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00cec910 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x878a5eea00cec909 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.137988:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00cec910 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec909 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826025.138006:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049206528:0@lo:105: 00000100:00100000:3.0:1787826025.138079:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826025.138132:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787826025.138276:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cec8e6 lrc: 0/0,0 mode: --/PR res: [0x240001f58:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f059 expref: 7 pid: 187906 timeout: 8191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826025.138296:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8415:1874663049206400:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826025.138361:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00cec910 lrc: 4/0,0 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec909 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.138380:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x42:0x0].0x0 (ffff8eb45edbd500) 00010000:00010000:2.0:1787826025.138383:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826025.138386:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38a00, rc 0) 00000100:00100000:2.0:1787826025.138437:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049206272:12345-0@lo:101:mdt00_001.0 Request processed in 7477us (9293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826025.138446:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12501 00000100:00100000:1.0:1787826025.138672:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787826025.138697:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049206528 00000100:00100000:1.0:1787826025.138702:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049206528 00000100:00100000:1.0:1787826025.138744:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4766 00000100:00100000:1.0:1787826025.138753:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e36d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049206528:12345-0@lo:105: 00010000:00010000:1.0:1787826025.138766:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.138777:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.138793:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 4/0,1 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.138802:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.138809:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.138819:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 5/0,1 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.138834:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb479b3f400) 00000100:00100000:1.0:1787826025.138874:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e36d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6475:x1874663049206528:12345-0@lo:105: Request processed in 122us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826025.138880:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4766 00000100:00100000:3.0:1787826025.139130:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6475:1874663049206528:0@lo:105: 00010000:00010000:3.0:1787826025.139149:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826025.139206:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042948096:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1371us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826025.139215:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12218 00000100:00100000:2.0:1787826025.140534:0:187905:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869900 gen 2 00000004:00080000:2.0:1787826025.140548:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869899 committed transno 17179869900 00000004:00080000:2.0:1787826025.140575:0:187905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869900 committed transno 17179869900 00000100:00100000:2.0:1787826025.140599:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049206272:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826025.140636:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826025.141462:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049206656:0@lo:403:mdt00_001.0 00000100:00100000:2.0:1787826025.141555:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826025.141599:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826025.144013:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049206656 00000100:00100000:1.0:1787826025.144033:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049206656 00000100:00100000:1.0:1787826025.144127:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12502 00000100:00100000:1.0:1787826025.144140:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049206656:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1787826025.146294:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187905:x1874663049206656:12345-0@lo:403:mdt00_001.0 Request processed in 2143us (4725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826025.146312:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12502 00000100:00100000:2.0:1787826025.151219:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049206656:0@lo:403:mdt00_001.0 00000040:00080000:2.0:1787826025.152535:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].476, 656 off726512 00000040:00080000:2.0:1787826025.152787:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].347, 736 off572784 00000004:00080000:2.0:1787826025.152794:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb44f6a10c0 with version 719 00000004:00080000:1.0:1787826025.153768:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 719 rpc_version 719 00000020:00100000:1.0:1787826025.153825:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826025.153839:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66d500 x1874663049206912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826025.153872:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049206912:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826025.153964:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826025.154012:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34916cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826025.154666:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049206912 00000100:00100000:3.0:1787826025.154685:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049206912 00000100:00100000:3.0:1787826025.154760:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12503 00000100:00100000:3.0:1787826025.154772:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049206912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826025.155135:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049206912:12345-0@lo:1000:osp_up1-0.0 Request processed in 364us (1169us total) trans 17179869901 rc 0/0 00000100:00100000:3.0:1787826025.155145:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12503 00000100:00100000:1.0:1787826025.155568:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049206912:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787826025.155655:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bce:0x0]: returning size 4096 00010000:00010000:2.0:1787826025.155745:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,1 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155758:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 2/0,0 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155766:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155773:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.155779:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 3/0,0 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155788:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 4/0,0 mode: EX/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155809:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x42:0x0].0x0 (ffff8eb47f8ffa00) 00010000:00010000:2.0:1787826025.155812:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826025.155818:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 2/0,0 mode: --/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155825:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec902 lrc: 0/0,0 mode: --/EX res: [0x200026560:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155843:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155857:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 4/0,1 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155863:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155942:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826025.155955:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x42:0x0] 00010000:00010000:2.0:1787826025.155965:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155972:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155978:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155984:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.155987:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.155993:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156001:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bce:0x0].0x0 (ffff8eb47f8ff900) 00010000:00010000:2.0:1787826025.156004:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826025.156007:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156012:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec8fb lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156029:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156036:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156042:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156047:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.156049:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156055:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156063:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826025.156066:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.156069:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156074:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715c00/0x878a5eea00cec8ed lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826025.156085:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000facbcd4e reply state 000000004927d67e transno 335007449217 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156100:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.156107:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826025.156110:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826025.156113:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826025.156225:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155796:x1874663042947840:12345-192.168.203.47@tcp:36:rmdir.0 Request processed in 43414us (43905us total) trans 335007449217 rc 0/0 00000100:00100000:2.0:1787826025.156234:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 860 00010000:00010000:0.0:1787826025.157818:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826025.157834:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 2/0,0 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.157846:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f400 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826025.157853:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826025.157861:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 3/0,0 mode: EX/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.157916:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 2/0,0 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.157921:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826025.158015:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787826025.158139:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 1/0,0 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.158149:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb479b3f400/0x878a5eea00cec909 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec910 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826025.158179:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826025.158181:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826025.158183:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826025.158638:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049207040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826025.158735:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826025.161770:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049207040 00000100:00100000:3.0:1787826025.161793:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049207040 00000100:00100000:3.0:1787826025.161975:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4206 00000100:00100000:3.0:1787826025.161988:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049207040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826025.162009:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826025.162042:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00cec910 lrc: 0/0,0 mode: --/EX res: [0x240001f58:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec909 expref: 8 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.162064:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x42:0x0].0x0 (ffff8eb45edbd500) 00010000:00010000:3.0:1787826025.162077:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826025.162180:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3618:x1874663049207040:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826025.162188:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4206 00000100:00100000:1.0:1787826025.162599:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049207040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826025.176035:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826025.176557:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042948224 00000100:00100000:1.0:1787826025.176572:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042948224 00000100:00100000:1.0:1787826025.176662:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 861 00000100:00100000:1.0:1787826025.176675:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155790:x1874663042948224:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:1.0:1787826025.176747:0:188682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00000100:00100000:1.0:1787826025.176854:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155790:x1874663042948224:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 181us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826025.176863:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 861 00000100:00100000:1.0:1787826025.183604:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826025.183667:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826025.183775:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042948352 00000100:00100000:3.0:1787826025.183789:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042948352 00000100:00100000:3.0:1787826025.183863:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042948480 00000100:00100000:3.0:1787826025.183867:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042948480 00000100:00100000:3.0:1787826025.183901:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 862 00000100:00100000:3.0:1787826025.183913:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155790:x1874663042948352:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:3.0:1787826025.183961:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1787826025.184045:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:155790:x1874663042948352:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 134us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826025.184053:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 862 00000100:00100000:3.0:1787826025.184073:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 863 00000100:00100000:3.0:1787826025.184079:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155806:x1874663042948480:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826025.184091:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826025.184117:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec917 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f060 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184202:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184221:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184237:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184541:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184555:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184564:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184634:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184642:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184649:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184657:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826025.184662:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184676:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184690:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826025.184694:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826025.184699:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184705:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec91e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184721:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184727:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184732:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184738:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826025.184741:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184747:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184755:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826025.184758:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826025.184761:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184768:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cec925 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184802:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec917 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f060 expref: 56 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184813:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826025.184816:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826025.184819:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec917 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f060 expref: 56 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.184828:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18800, rc 0) 00000100:00100000:3.0:1787826025.184868:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155806:x1874663042948480:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 788us (1199us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826025.184876:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 863 00000100:00100000:3.0:1787826025.187983:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826025.188805:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042948608 00000100:00100000:2.0:1787826025.188825:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042948608 00000100:00100000:2.0:1787826025.188962:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 864 00000100:00100000:2.0:1787826025.188974:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155806:x1874663042948608:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826025.189001:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826025.189029:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec92c lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f067 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189123:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189140:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189153:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189167:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189175:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189182:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189247:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189254:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189262:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189270:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.189275:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189284:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189298:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826025.189302:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.189307:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189314:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39800/0x878a5eea00cec933 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189360:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189367:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189373:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189382:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826025.189386:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189392:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189400:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826025.189412:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.189415:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189421:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39400/0x878a5eea00cec93a lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189456:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec92c lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f067 expref: 56 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189468:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826025.189471:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826025.189476:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cec92c lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f067 expref: 56 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.189487:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39600, rc 0) 00000100:00100000:1.0:1787826025.189516:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826025.189581:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155806:x1874663042948608:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 608us (1613us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826025.189590:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 864 00000100:00100000:3.0:1787826025.189792:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042948736 00000100:00100000:3.0:1787826025.189799:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042948736 00000100:00100000:3.0:1787826025.189856:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5685 00000100:00100000:3.0:1787826025.189868:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:155790:x1874663042948736:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826025.190133:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826025.190184:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:155790:x1874663042948736:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 320us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826025.190192:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5685 00000100:00080000:3.0:1787826025.190282:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826025.192834:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826025.192892:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042948864 00000100:00100000:3.0:1787826025.192904:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042948864 00000100:00100000:3.0:1787826025.193859:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5686 00000100:00100000:3.0:1787826025.193876:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:155790:x1874663042948864:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826025.193921:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826025.193951:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826025.193988:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042948992 00000100:00100000:2.0:1787826025.193995:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042948992 00000100:00100000:3.0:1787826025.194017:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:155790:x1874663042948864:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 147us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826025.194025:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5686 00000100:00100000:2.0:1787826025.194034:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 865 00000100:00100000:2.0:1787826025.194040:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+55:155806:x1874663042948992:12345-192.168.203.47@tcp:101:lfs.0 00000100:00080000:3.0:1787826025.194051:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826025.194055:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826025.194083:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cec941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f06e expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.194172:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cec948 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.194190:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cec948 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.194205:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cec948 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826025.194267:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00200000:2.0:1787826025.194271:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826025.194293:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cec948 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.194350:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cec941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f06e expref: 57 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.194385:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cec948 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f06e expref: 56 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.194396:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:2.0:1787826025.194399:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826025.194405:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38400, rc 0) 00000100:00100000:2.0:1787826025.195578:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+56:155806:x1874663042948992:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 415us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826025.195600:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 865 00000100:00100000:2.0:1787826025.201005:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826025.201710:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042949248 00000100:00100000:1.0:1787826025.201725:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042949248 00000100:00100000:1.0:1787826025.201849:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 866 00000100:00100000:1.0:1787826025.201862:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+56:155806:x1874663042949248:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:1.0:1787826025.201937:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826025.201973:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cec948 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f06e expref: 56 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.201998:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:1.0:1787826025.202003:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826025.202791:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.202815:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.202827:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.202842:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.202855:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826025.202861:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826025.205963:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026560:0x1:0x0].477, 2152 off728664 00000040:00080000:1.0:1787826025.209711:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f58:0x1:0x0].348, 2352 off575136 00000004:00080000:1.0:1787826025.209735:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34916cb40 with version 720 00000004:00080000:0.0:1787826025.221958:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 720 rpc_version 720 00000020:00100000:0.0:1787826025.222037:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826025.222052:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df15880 x1874663049207296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826025.222092:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049207296:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826025.222196:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826025.222247:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826025.222369:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049207296 00000100:00100000:1.0:1787826025.222381:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049207296 00000100:00100000:1.0:1787826025.222463:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12504 00000100:00100000:1.0:1787826025.222476:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049207296:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826025.223276:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049207296:12345-0@lo:1000:osp_up1-0.0 Request processed in 800us (1076us total) trans 17179869902 rc 0/0 00000100:00100000:1.0:1787826025.223288:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12504 00000100:00100000:0.0:1787826025.224044:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049207296:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787826025.224282:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.224303:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.224319:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.224379:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 3/0,1 mode: --/PW res: [0x200026560:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.224388:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.224395:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.224560:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.224569:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826025.224580:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 3/0,1 mode: --/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826025.224606:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049207424:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787826025.224879:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826025.224911:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826025.225537:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049207424 00000100:00100000:3.0:1787826025.225548:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049207424 00000100:00100000:3.0:1787826025.225707:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12505 00000100:00100000:3.0:1787826025.225722:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188682:x1874663049207424:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826025.225749:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826025.225774:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cec972 lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cec96b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.225805:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cec972 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cec96b expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.225822:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cec972 lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cec96b expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.225833:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x43:0x0].0x0 (ffff8eb481697d00) 00010000:00010000:3.0:1787826025.225836:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826025.225840:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18800, rc 0) 00000100:00100000:3.0:1787826025.225909:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188682:x1874663049207424:12345-0@lo:101:mdt00_003.0 Request processed in 191us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826025.225921:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12505 00000100:00100000:3.0:1787826025.225974:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188682:1874663049207424:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826025.225992:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec972 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226002:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cec972 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826025.226030:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba82a4cf reply state 00000000b3213916 transno 335007449218 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 3/0,1 mode: PW/PW res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226045:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226052:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x43:0x0].0x0 (ffff8eb449aac000) 00010000:00010000:3.0:1787826025.226056:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826025.226060:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826025.226066:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 4/0,1 mode: PW/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec972 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226865:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cec972 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826025.226882:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240001f58:0x43:0x0] 00000004:00010000:3.0:1787826025.226895:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba82a4cf reply state 00000000b3213916 transno 335007449218 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226908:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226916:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcf:0x0].0x0 (ffff8eb449aac100) 00010000:00010000:3.0:1787826025.226919:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826025.226922:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826025.226929:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bcf:0x0]: returning size 4096 00010000:00010000:3.0:1787826025.226940:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226947:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226955:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226962:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826025.226967:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226976:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.226989:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb481693a00) 00010000:00010000:3.0:1787826025.226992:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826025.226996:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.227003:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00cec94f lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826025.227020:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba82a4cf reply state 00000000b3213916 transno 335007449218 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.227035:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826025.227042:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:3.0:1787826025.227044:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826025.227047:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826025.227798:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:155806:x1874663042949248:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 25931us (26801us total) trans 335007449218 rc 0/0 00000100:00100000:3.0:1787826025.227809:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 866 00010000:00010000:2.0:1787826025.300977:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826025.813675:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049207552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826025.813788:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826025.815390:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049207552 00000100:00100000:3.0:1787826025.815410:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049207552 00000100:00100000:3.0:1787826025.815501:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12506 00000100:00100000:3.0:1787826025.815515:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:3618:x1874663049207552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826025.815556:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1787826025.815668:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:3618:x1874663049207552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826025.815675:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12506 00000100:00100000:1.0:1787826025.818613:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049207552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826026.324806:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826027.351467:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826028.372611:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049207680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826028.372735:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049208064:0@lo:400:kworker.0 00000100:00100000:3.0:1787826028.372770:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.372853:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049207936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826028.372944:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049207680 00000100:00100000:2.0:1787826028.372954:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049207680 00000100:00100000:0.0:1787826028.373021:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826028.373034:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5687 00000100:00100000:2.0:1787826028.373047:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049207680:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826028.373161:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049208576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.373194:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.373224:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049209088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.373250:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.373276:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049209600:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.373305:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.373361:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826028.373367:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049208448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.373401:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.373420:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049208960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.373447:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.373464:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049209472:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.373487:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.373524:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049209088 00000100:00100000:0.0:1787826028.373528:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049209088 00000100:00100000:0.0:1787826028.373569:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049208960 00000100:00100000:0.0:1787826028.373572:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049208960 00000100:00100000:0.0:1787826028.373591:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049209472 00000100:00100000:0.0:1787826028.373593:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049209472 00000100:00100000:0.0:1787826028.373632:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6907 00000100:00100000:0.0:1787826028.373640:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049209088:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787826028.373689:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826028.373720:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049209088:12345-0@lo:400:kworker.0 Request processed in 80us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.373731:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6907 00000100:00100000:2.0:1787826028.373744:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049207680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 698us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.373753:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5687 00000100:00100000:0.0:1787826028.373758:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6908 00000100:00100000:0.0:1787826028.373772:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049208960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826028.373782:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049208576 00000100:00100000:2.0:1787826028.373788:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049208576 00000100:00100000:0.0:1787826028.373817:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049208960:12345-0@lo:400:kworker.0 Request processed in 51us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.373822:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049209600 00000100:00100000:0.0:1787826028.373825:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6908 00000100:00100000:2.0:1787826028.373827:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049209600 00000100:00100000:0.0:1787826028.373848:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6909 00000100:00100000:2.0:1787826028.373852:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049208448 00000100:00100000:2.0:1787826028.373857:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049208448 00000100:00100000:0.0:1787826028.373859:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049209472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826028.373877:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787826028.373887:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049208576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.373908:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049209472:12345-0@lo:400:kworker.0 Request processed in 51us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.373915:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6909 00000100:00100000:2.0:1787826028.373932:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049208576:12345-0@lo:400:kworker.0 Request processed in 47us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.373939:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826028.373957:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787826028.373965:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787826028.373974:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049209600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826028.373976:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049208448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374029:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049209600:12345-0@lo:400:kworker.0 Request processed in 64us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.374036:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049208448:12345-0@lo:400:kworker.0 Request processed in 63us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.374045:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826028.374162:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049208448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374175:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049208960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374184:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049209472:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374199:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049208576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374209:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049209088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374224:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049209600:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374282:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049207808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826028.374353:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.374380:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049208320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826028.374410:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.374433:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049208832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374459:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.374484:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049209344:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374504:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.374530:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787826028.374537:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049208192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374567:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.374589:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049208704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374623:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.374635:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049209216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374656:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.374720:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049208192 00000100:00100000:0.0:1787826028.374730:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049208192 00000100:00100000:2.0:1787826028.374834:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787826028.374851:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049208704 00000100:00100000:2.0:1787826028.374857:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049209216 00000100:00100000:2.0:1787826028.374862:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049209216 00000100:00100000:0.0:1787826028.374863:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049208704 00000100:00100000:2.0:1787826028.374883:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787826028.374893:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049208192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374920:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826028.374930:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049209216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826028.374937:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049208192:12345-0@lo:400:kworker.0 Request processed in 44us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.374944:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787826028.374962:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787826028.374969:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049209216:12345-0@lo:400:kworker.0 Request processed in 41us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.374971:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049208704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.374984:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826028.375024:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049208192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.375041:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049209216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.375052:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826028.375059:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049209728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826028.375089:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.375199:0:187898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049208064 00000100:00100000:0.0:1787826028.375204:0:187898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049208064 00000100:00100000:0.0:1787826028.375242:0:187898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787826028.375257:0:187898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049208064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.375291:0:187898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049208064:12345-0@lo:400:kworker.0 Request processed in 43us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.375298:0:187898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787826028.375376:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049208064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.375450:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049208320 00000100:00100000:0.0:1787826028.375454:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049208320 00000100:00100000:0.0:1787826028.375481:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049208832 00000100:00100000:0.0:1787826028.375484:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049208832 00000100:00100000:0.0:1787826028.375493:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049209344 00000100:00100000:0.0:1787826028.375496:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049209344 00000100:00100000:0.0:1787826028.375506:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12507 00000100:00100000:0.0:1787826028.375512:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1874663049208320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826028.375545:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00000100:00100000:2.0:1787826028.375593:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049208704:12345-0@lo:400:kworker.0 Request processed in 623us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.375594:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1874663049208320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.375617:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787826028.375622:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12507 00000100:00100000:0.0:1787826028.375635:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12508 00000100:00100000:0.0:1787826028.375641:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049208832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.375671:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:3620:x1874663049208832:12345-0@lo:400:kworker.0 Request processed in 31us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.375677:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12508 00000100:00100000:0.0:1787826028.375688:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12509 00000100:00100000:0.0:1787826028.375708:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049209344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.375736:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049209344:12345-0@lo:400:kworker.0 Request processed in 43us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.375741:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12509 00000100:00100000:0.0:1787826028.375761:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049207808 00000100:00100000:0.0:1787826028.375766:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049207808 00000100:00100000:0.0:1787826028.375790:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049209728 00000100:00100000:0.0:1787826028.375793:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049209728 00000100:00100000:0.0:1787826028.375803:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5688 00000100:00100000:0.0:1787826028.375809:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049207808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826028.375822:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826028.375853:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049207808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.375860:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5688 00000100:00100000:0.0:1787826028.375870:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5689 00000100:00100000:0.0:1787826028.375876:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049209728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826028.375892:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826028.375920:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049209728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.375926:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5689 00000100:00080000:0.0:1787826028.375958:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826028.375962:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826028.375965:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826028.375967:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826028.376042:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049209728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826028.376055:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049208704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.376070:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049207808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826028.376083:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049208320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826028.376093:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049208832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826028.376100:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049209344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826028.377639:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049207680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826028.377658:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826028.377746:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826028.377947:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049207936 00000100:00100000:2.0:1787826028.377958:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049207936 00000100:00100000:3.0:1787826028.379115:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5690 00000100:00100000:3.0:1787826028.379138:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049207936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826028.379167:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826028.379256:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049207936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826028.379264:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5690 00000100:00100000:1.0:1787826028.379356:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049207936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826028.793771:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826028.793817:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826028.793849:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826028.793867:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826028.793888:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826028.793961:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042949632 00000100:00100000:0.0:1787826028.793972:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042949632 00000100:00100000:0.0:1787826028.794035:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042949504 00000100:00100000:0.0:1787826028.794039:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042949504 00000100:00100000:0.0:1787826028.794063:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:0.0:1787826028.794072:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042949632:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826028.794156:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042949632:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.794163:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:0.0:1787826028.794183:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:0.0:1787826028.794189:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:2392:x1874663042949504:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826028.794218:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+57:2392:x1874663042949504:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826028.794224:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:2.0:1787826028.794578:0:187896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042949376 00000100:00100000:2.0:1787826028.794583:0:187896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042949376 00000100:00100000:2.0:1787826028.794629:0:187896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 97 00000100:00100000:2.0:1787826028.794637:0:187896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042949376:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826028.794677:0:187896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042949376:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 41us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.794684:0:187896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 97 00000100:00100000:2.0:1787826028.794715:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042949888 00000100:00100000:2.0:1787826028.794719:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042949888 00000100:00100000:2.0:1787826028.794746:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042949760 00000100:00100000:2.0:1787826028.794749:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042949760 00000100:00100000:2.0:1787826028.794768:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6910 00000100:00100000:2.0:1787826028.794775:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042949888:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826028.794805:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042949888:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.794812:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6910 00000100:00100000:2.0:1787826028.794823:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6911 00000100:00100000:2.0:1787826028.794829:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042949760:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826028.794855:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042949760:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.794861:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6911 00000100:00080000:3.0:1787826028.795137:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826028.795142:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826028.795144:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826028.795146:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787826028.890547:0:187875:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cec972 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826028.890566:0:187875:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 3/0,0 mode: PW/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cec972 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826028.890623:0:187875:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 2/0,0 mode: --/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec972 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826028.890630:0:187875:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826028.890663:0:187875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8eb34bf39e00/0x878a5eea00cec96b lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cec972 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826028.890682:0:187875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449218 is committed 00000020:00080000:3.0:1787826028.890701:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34e1ab900 refcount 2 committed 0 result 0 batchid 330712484066 00000020:00080000:3.0:1787826028.890705:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a3b6e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34e1abc00 00000020:00080000:3.0:1787826028.890709:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].346 00000020:00080000:3.0:1787826028.890711:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a3b6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb348823e00 00000020:00080000:3.0:1787826028.890714:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].475 00000020:00080000:3.0:1787826028.890730:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb44f6a1d80 refcount 2 committed 0 result 0 batchid 330712484065 00000020:00080000:3.0:1787826028.890733:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb44f6a10c0 00000020:00080000:3.0:1787826028.890736:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].345 00000020:00080000:3.0:1787826028.890738:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47fb01800 00000020:00080000:3.0:1787826028.890740:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].474 00000020:00080000:3.0:1787826028.890744:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb342682540 refcount 2 committed 0 result 0 batchid 330712484064 00000020:00080000:3.0:1787826028.890746:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb342682900 00000020:00080000:3.0:1787826028.890748:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].344 00000020:00080000:3.0:1787826028.890750:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34dbaaa00 00000020:00080000:3.0:1787826028.890752:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].473 00000020:00080000:3.0:1787826028.890759:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4812c1240 refcount 2 committed 0 result 0 batchid 330712484063 00000020:00080000:3.0:1787826028.890762:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb443e5b900 00000020:00080000:3.0:1787826028.890764:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].343 00000020:00080000:3.0:1787826028.890766:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47fb01600 00000020:00080000:3.0:1787826028.890769:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].471 00000020:00080000:3.0:1787826028.890773:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925ea80 refcount 2 committed 0 result 0 batchid 330712484062 00000020:00080000:3.0:1787826028.890776:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34925e0c0 00000020:00080000:3.0:1787826028.890778:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].342 00000020:00080000:3.0:1787826028.890779:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4730b9400 00000020:00080000:3.0:1787826028.890781:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].470 00000020:00080000:3.0:1787826028.890786:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb349172b40 refcount 2 committed 0 result 0 batchid 330712484061 00000020:00080000:3.0:1787826028.890788:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349172c00 00000020:00080000:3.0:1787826028.890791:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].341 00000020:00080000:3.0:1787826028.890792:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4730b9200 00000020:00080000:3.0:1787826028.890795:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].469 00000020:00080000:3.0:1787826028.890799:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34e1ab780 refcount 2 committed 0 result 0 batchid 330712484060 00000020:00080000:3.0:1787826028.890801:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a3b6b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34e1ab0c0 00000020:00080000:3.0:1787826028.890803:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].340 00000020:00080000:3.0:1787826028.890805:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a3b6c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb348823a00 00000020:00080000:3.0:1787826028.890807:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].468 00000020:00080000:3.0:1787826028.890812:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34be53600 refcount 2 committed 0 result 0 batchid 330712484059 00000020:00080000:3.0:1787826028.890814:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb345527d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34be530c0 00000020:00080000:3.0:1787826028.890816:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].339 00000020:00080000:3.0:1787826028.890818:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb345527800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34dbaac00 00000020:00080000:3.0:1787826028.890820:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].467 00000020:00080000:3.0:1787826028.890824:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34be53480 refcount 2 committed 0 result 0 batchid 330712484058 00000020:00080000:3.0:1787826028.890825:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb345527600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34be53a80 00000020:00080000:3.0:1787826028.890827:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].338 00000020:00080000:3.0:1787826028.890829:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb345527700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34dbab000 00000020:00080000:3.0:1787826028.890831:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].466 00000020:00080000:3.0:1787826028.890835:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb349172840 refcount 2 committed 0 result 0 batchid 330712484057 00000020:00080000:3.0:1787826028.890838:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349172c00 00000020:00080000:3.0:1787826028.890840:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].336 00000020:00080000:3.0:1787826028.890842:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4730b9a00 00000020:00080000:3.0:1787826028.890845:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].465 00000020:00080000:3.0:1787826028.890850:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb44f6b10c0 refcount 2 committed 0 result 0 batchid 330712484056 00000020:00080000:3.0:1787826028.890853:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879ae00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb44f6b1000 00000020:00080000:3.0:1787826028.890856:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].335 00000020:00080000:3.0:1787826028.890858:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb342171c00 00000020:00080000:3.0:1787826028.890860:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].464 00000020:00080000:3.0:1787826028.890863:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb349172d80 refcount 2 committed 0 result 0 batchid 330712484055 00000020:00080000:3.0:1787826028.890866:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349172840 00000020:00080000:3.0:1787826028.890869:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].334 00000020:00080000:3.0:1787826028.890870:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4730b8e00 00000020:00080000:3.0:1787826028.890873:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].463 00000020:00080000:3.0:1787826028.890877:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb44f6b1240 refcount 2 committed 0 result 0 batchid 330712484054 00000020:00080000:3.0:1787826028.890880:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879a700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb44f6b10c0 00000020:00080000:3.0:1787826028.890882:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].333 00000020:00080000:3.0:1787826028.890884:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb342170c00 00000020:00080000:3.0:1787826028.890886:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].462 00000020:00080000:3.0:1787826028.890890:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb349172240 refcount 2 committed 0 result 0 batchid 330712484053 00000020:00080000:3.0:1787826028.890893:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349172c00 00000020:00080000:3.0:1787826028.890896:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].332 00000020:00080000:3.0:1787826028.890898:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb477667400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4730b8c00 00000020:00080000:3.0:1787826028.890901:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].461 00000020:00080000:3.0:1787826028.890905:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34916ca80 refcount 2 committed 0 result 0 batchid 330712484052 00000020:00080000:3.0:1787826028.890907:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a3b6200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3436a5a80 00000020:00080000:3.0:1787826028.890910:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].331 00000020:00080000:3.0:1787826028.890912:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a3b6d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb47999ea00 00000020:00080000:3.0:1787826028.890914:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].460 00000020:00080000:3.0:1787826028.890919:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34896b9c0 refcount 2 committed 0 result 0 batchid 330712484051 00000020:00080000:3.0:1787826028.890922:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb45a3b6900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34896b780 00000020:00080000:3.0:1787826028.890925:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].330 00000020:00080000:3.0:1787826028.890927:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb4491fd000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb472798a00 00000020:00080000:3.0:1787826028.890929:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].459 00000020:00080000:3.0:1787826028.890937:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb44f6b1cc0 refcount 2 committed 0 result 0 batchid 330712484050 00000020:00080000:3.0:1787826028.890940:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879ab00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb44f6b13c0 00000020:00080000:3.0:1787826028.890942:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].329 00000020:00080000:3.0:1787826028.890944:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879a500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3448ba400 00000020:00080000:3.0:1787826028.890947:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].458 00000020:00080000:3.0:1787826028.890951:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb4603483c0 refcount 2 committed 0 result 0 batchid 330712484049 00000020:00080000:3.0:1787826028.890953:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879ad00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb479b53600 00000020:00080000:3.0:1787826028.890956:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].328 00000020:00080000:3.0:1787826028.890958:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3448ba600 00000020:00080000:3.0:1787826028.890960:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].457 00000020:00080000:3.0:1787826028.890963:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925e180 refcount 2 committed 0 result 0 batchid 330712484048 00000020:00080000:3.0:1787826028.890966:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb4491fdd00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34925ed80 00000020:00080000:3.0:1787826028.890968:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].327 00000020:00080000:3.0:1787826028.890970:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb4491fdc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb472799800 00000020:00080000:3.0:1787826028.890972:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].456 00000020:00080000:3.0:1787826028.890976:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34925ec00 refcount 2 committed 0 result 0 batchid 330712484047 00000020:00080000:3.0:1787826028.890979:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb4491fde00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34925ea80 00000020:00080000:3.0:1787826028.890981:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].326 00000020:00080000:3.0:1787826028.890983:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47a45c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb472798400 00000020:00080000:3.0:1787826028.890985:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].455 00000020:00080000:3.0:1787826028.890990:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb349172cc0 refcount 2 committed 0 result 0 batchid 330712484046 00000020:00080000:3.0:1787826028.890992:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb349172840 00000020:00080000:3.0:1787826028.890995:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].325 00000020:00080000:3.0:1787826028.890996:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb479be6b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb342171400 00000020:00080000:3.0:1787826028.890999:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].454 00000020:00080000:3.0:1787826028.891003:0:187875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb481768180 refcount 2 committed 0 result 0 batchid 330712484045 00000020:00080000:3.0:1787826028.891006:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47f9ec900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb481768000 00000020:00080000:3.0:1787826028.891008:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].324 00000020:00080000:3.0:1787826028.891010:0:187875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47f9ecc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3456c6600 00000020:00080000:3.0:1787826028.891013:0:187875:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].453 00000020:00080000:3.0:1787826028.891016:0:187875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 330712484044 batchid updated 00000020:00080000:3.0:1787826028.891063:0:187875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 330712484042 batchid updated 00000020:00080000:3.0:1787826028.891079:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 330712484066 committed batchid 330712484044 00010000:00010000:2.0:1787826028.891317:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891356:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891363:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891368:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fe00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891372:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891378:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891391:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.891394:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891397:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891406:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fe00/0x878a5eea00cec088 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891422:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891428:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891433:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891438:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891440:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891446:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891452:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.891454:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891456:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891461:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cec0ea lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891470:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891478:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891483:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891487:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891489:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891494:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891500:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc4:0x0].0x0 (ffff8eb47f8fe400) 00010000:00010000:2.0:1787826028.891502:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891505:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891510:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568e00/0x878a5eea00cec0f1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891525:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891530:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891535:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891539:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891542:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891547:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891553:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x38:0x0].0x0 (ffff8eb47f8fea00) 00010000:00010000:2.0:1787826028.891555:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891557:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891562:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cec0f8 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891574:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891579:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891583:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891588:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891590:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891596:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891612:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.891614:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891617:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891623:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f600/0x878a5eea00cec14c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891631:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891637:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891642:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891647:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891649:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891655:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891661:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.891663:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891665:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891671:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cec1ae lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891679:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891689:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891695:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891700:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891702:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891708:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891714:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc5:0x0].0x0 (ffff8eb449543200) 00010000:00010000:2.0:1787826028.891716:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891719:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891724:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cec1b5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891735:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891740:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891744:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891748:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891751:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891757:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891763:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x39:0x0].0x0 (ffff8eb449543e00) 00010000:00010000:2.0:1787826028.891765:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891768:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891773:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cec1bc lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891785:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891791:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891797:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891802:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891804:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891810:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891818:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.891820:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891823:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891829:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cec210 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891838:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891843:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891848:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891853:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891856:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891861:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891868:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.891871:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891873:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891879:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f800/0x878a5eea00cec272 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891887:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891897:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891901:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891906:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891908:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891913:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891920:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc6:0x0].0x0 (ffff8eb481697100) 00010000:00010000:2.0:1787826028.891922:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891925:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891930:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cec279 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891943:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891947:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891952:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891957:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.891960:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891965:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891971:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3a:0x0].0x0 (ffff8eb481697600) 00010000:00010000:2.0:1787826028.891974:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.891976:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891981:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cec280 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891992:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.891998:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892004:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892009:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892011:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892017:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892024:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892026:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892029:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892034:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cec2d4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892043:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892048:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892053:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892058:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892060:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892066:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892073:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892075:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892078:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892083:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cec336 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892092:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892101:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892106:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892110:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892112:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892117:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892122:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc7:0x0].0x0 (ffff8eb449543c00) 00010000:00010000:2.0:1787826028.892124:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892126:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892131:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cec33d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892142:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892147:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892152:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892156:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892159:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892164:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892170:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3b:0x0].0x0 (ffff8eb449543100) 00010000:00010000:2.0:1787826028.892172:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892174:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892179:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569800/0x878a5eea00cec344 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892190:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892195:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892200:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892205:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892207:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892212:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892218:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892220:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892223:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892228:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cec398 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892236:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892241:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892246:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892251:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892253:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892258:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892263:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892265:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892268:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892274:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fa00/0x878a5eea00cec3fa lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892283:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892293:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892299:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892304:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892307:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892312:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892319:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc8:0x0].0x0 (ffff8eb481697300) 00010000:00010000:2.0:1787826028.892321:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892344:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892351:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cec401 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892363:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892368:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892373:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892377:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892380:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892386:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892393:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3c:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:2.0:1787826028.892395:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892398:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892403:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cec408 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892414:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892420:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892425:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892430:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892432:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892438:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892444:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892446:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892449:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892454:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00cec45c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892463:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892470:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892475:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892479:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892482:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892487:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892494:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892496:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892499:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892504:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cec4be lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892514:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892524:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892530:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892535:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892537:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892542:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892550:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bc9:0x0].0x0 (ffff8eb449aac800) 00010000:00010000:2.0:1787826028.892552:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892555:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892561:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cec4c5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892575:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892581:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892587:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892591:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892594:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892609:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892616:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3d:0x0].0x0 (ffff8eb449aacd00) 00010000:00010000:2.0:1787826028.892618:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892621:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892626:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cec4cc lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892639:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892644:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892649:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892653:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892656:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892661:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892668:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892670:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892672:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892677:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec520 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892686:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892692:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892697:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892701:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892704:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892710:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892718:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892720:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892722:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892727:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19a00/0x878a5eea00cec582 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892736:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892745:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892750:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892754:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892757:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892763:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892770:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bca:0x0].0x0 (ffff8eb449aac500) 00010000:00010000:2.0:1787826028.892772:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892774:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892779:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cec589 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892790:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892796:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892801:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892806:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892810:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892816:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892823:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3e:0x0].0x0 (ffff8eb449aac700) 00010000:00010000:2.0:1787826028.892825:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892828:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892833:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cec590 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892844:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892849:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892854:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892859:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892862:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892869:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892875:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892877:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892880:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892885:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cec5e4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892894:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892899:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892904:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892908:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892910:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892915:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892921:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.892923:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892925:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892930:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec646 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892937:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892944:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892949:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892953:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724edc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.892956:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892960:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892965:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcb:0x0].0x0 (ffff8eb449543800) 00010000:00010000:2.0:1787826028.892967:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.892970:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892976:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec64d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892987:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892992:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.892996:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893000:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ecc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893002:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893007:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893013:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x3f:0x0].0x0 (ffff8eb449543a00) 00010000:00010000:2.0:1787826028.893015:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893017:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893022:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cec654 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893031:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893036:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893041:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893046:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893049:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893053:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893060:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.893061:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893063:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893068:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cec6a8 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893077:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893082:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893088:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893092:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893094:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893099:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893105:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.893107:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893109:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893114:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cec70a lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893122:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893130:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893135:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893138:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893140:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893145:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893151:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcc:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:2.0:1787826028.893153:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893155:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893160:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cec711 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893170:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893175:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893180:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893184:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893187:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893192:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893198:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x40:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826028.893200:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893202:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893207:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cec718 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893219:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893225:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893231:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893236:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893239:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893245:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893252:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.893254:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893257:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893262:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cec76c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893272:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893277:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893283:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893287:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893290:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893295:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893302:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.893304:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893306:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893311:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cec7ce lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893319:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893355:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893360:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893365:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893367:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893373:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893380:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcd:0x0].0x0 (ffff8eb481697000) 00010000:00010000:2.0:1787826028.893383:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893385:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893392:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19800/0x878a5eea00cec7d5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893403:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893409:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893414:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893419:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893422:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893428:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893435:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x41:0x0].0x0 (ffff8eb481697c00) 00010000:00010000:2.0:1787826028.893437:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893440:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893445:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cec7dc lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893459:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893466:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893472:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893477:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893480:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893486:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893493:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.893495:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893499:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893504:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cec830 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893514:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893520:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893526:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893531:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ede00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893534:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893539:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893546:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.893548:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893550:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893555:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec892 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893564:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893574:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893580:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893585:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eca00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893587:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893593:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893611:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bce:0x0].0x0 (ffff8eb47f8ff900) 00010000:00010000:2.0:1787826028.893613:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893616:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893622:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec899 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893634:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893640:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893645:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893649:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893652:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893657:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893663:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x42:0x0].0x0 (ffff8eb47f8ffa00) 00010000:00010000:2.0:1787826028.893665:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893667:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893673:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00cec8a0 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893685:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893692:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893698:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893702:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893705:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893711:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893718:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.893721:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893723:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893728:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cec8f4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893738:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893742:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893748:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893753:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ea00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893755:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893761:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893768:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x1ccea250 (ffff8eb45edbdf00) 00010000:00010000:2.0:1787826028.893770:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893773:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893778:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ea00/0x878a5eea00cec956 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x17e0:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893792:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893801:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893807:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893811:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893814:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893819:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893826:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bcf:0x0].0x0 (ffff8eb449aac100) 00010000:00010000:2.0:1787826028.893828:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893831:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893836:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec95d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893847:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 3/0,1 mode: TXN/TXN res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893853:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 2/0,0 mode: TXN/TXN res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893858:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893862:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826028.893866:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 3/0,0 mode: TXN/TXN res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893871:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 4/0,0 mode: TXN/TXN res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893878:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026560:0x43:0x0].0x0 (ffff8eb449aac000) 00010000:00010000:2.0:1787826028.893880:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826028.893882:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 2/0,0 mode: --/TXN res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.893888:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec964 lrc: 0/0,0 mode: --/TXN res: [0x200026560:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826028.893984:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826028.894007:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049209856:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1787826028.894077:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787826028.894438:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be53d80 with version 721 00000020:00080000:3.0:1787826028.894450:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483996 cancel update log [0x240001f58:0x1:0x0].272: rc = 0 00000020:00080000:3.0:1787826028.894502:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483996 cancel update log [0x200026560:0x1:0x0].401: rc = 0 00000004:00080000:3.0:1787826028.894530:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be533c0 with version 722 00000020:00080000:3.0:1787826028.894534:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483997 cancel update log [0x240001f58:0x1:0x0].273: rc = 0 00000020:00080000:3.0:1787826028.894555:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483997 cancel update log [0x200026560:0x1:0x0].402: rc = 0 00000004:00080000:3.0:1787826028.894574:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be536c0 with version 723 00000020:00080000:3.0:1787826028.894578:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483998 cancel update log [0x240001f58:0x1:0x0].275: rc = 0 00000020:00080000:3.0:1787826028.894607:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483998 cancel update log [0x200026560:0x1:0x0].404: rc = 0 00000004:00080000:3.0:1787826028.894626:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be53840 with version 724 00000020:00080000:3.0:1787826028.894629:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712483999 cancel update log [0x240001f58:0x1:0x0].276: rc = 0 00000020:00080000:3.0:1787826028.894644:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712483999 cancel update log [0x200026560:0x1:0x0].405: rc = 0 00000004:00080000:3.0:1787826028.894660:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34be53c00 with version 725 00000020:00080000:3.0:1787826028.894663:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484000 cancel update log [0x240001f58:0x1:0x0].277: rc = 0 00000020:00080000:3.0:1787826028.894678:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484000 cancel update log [0x200026560:0x1:0x0].406: rc = 0 00000004:00080000:3.0:1787826028.894695:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3491726c0 with version 726 00000020:00080000:3.0:1787826028.894697:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484001 cancel update log [0x240001f58:0x1:0x0].278: rc = 0 00000020:00080000:3.0:1787826028.894714:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484001 cancel update log [0x200026560:0x1:0x0].407: rc = 0 00000004:00080000:3.0:1787826028.894729:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb3491723c0 with version 727 00000020:00080000:3.0:1787826028.894732:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484002 cancel update log [0x240001f58:0x1:0x0].279: rc = 0 00000020:00080000:3.0:1787826028.894751:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484002 cancel update log [0x200026560:0x1:0x0].408: rc = 0 00000004:00080000:3.0:1787826028.894768:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172c00 with version 728 00000020:00080000:3.0:1787826028.894770:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484003 cancel update log [0x240001f58:0x1:0x0].280: rc = 0 00000020:00080000:3.0:1787826028.894787:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484003 cancel update log [0x200026560:0x1:0x0].409: rc = 0 00000004:00080000:3.0:1787826028.894803:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb349172600 with version 729 00000020:00080000:3.0:1787826028.894806:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484004 cancel update log [0x240001f58:0x1:0x0].281: rc = 0 00000004:00080000:0.0:1787826028.897773:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 721 rpc_version 721 00000020:00100000:0.0:1787826028.897822:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.897833:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb343e55880 x1874663049210112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.897857:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049210112:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.897921:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.897962:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826028.898027:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049210112 00000100:00100000:1.0:1787826028.898034:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049210112 00000100:00100000:1.0:1787826028.898087:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12510 00000100:00100000:1.0:1787826028.898095:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187924:x1874663049210112:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.898240:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187924:x1874663049210112:12345-0@lo:1000:osp_up1-0.0 Request processed in 145us (319us total) trans 17179869903 rc 0/0 00000100:00100000:1.0:1787826028.898248:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12510 00000020:00080000:3.0:1787826028.898916:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484004 cancel update log [0x200026560:0x1:0x0].410: rc = 0 00000004:00080000:3.0:1787826028.898950:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb481768480 with version 730 00000020:00080000:3.0:1787826028.898953:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484005 cancel update log [0x240001f58:0x1:0x0].282: rc = 0 00000100:00100000:0.0:1787826028.899049:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049210112:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.899060:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 722 rpc_version 722 00000020:00100000:0.0:1787826028.899073:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.899079:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb343e54a80 x1874663049210368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.899092:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049210368:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.899130:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.899149:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.899163:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049210368 00000100:00100000:0.0:1787826028.899167:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049210368 00000100:00100000:0.0:1787826028.899196:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12511 00000100:00100000:0.0:1787826028.899202:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187924:x1874663049210368:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.899322:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187924:x1874663049210368:12345-0@lo:1000:osp_up1-0.0 Request processed in 118us (190us total) trans 17179869904 rc 0/0 00000100:00100000:0.0:1787826028.899345:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12511 00000100:00100000:0.0:1787826028.899378:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049210368:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.899385:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 723 rpc_version 723 00000020:00100000:0.0:1787826028.899396:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.899400:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df17800 x1874663049210624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.899412:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049210624:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.899435:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.899449:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.899459:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049210624 00000100:00100000:0.0:1787826028.899462:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049210624 00000100:00100000:0.0:1787826028.899482:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12512 00000100:00100000:0.0:1787826028.899488:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187924:x1874663049210624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.899553:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187924:x1874663049210624:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (117us total) trans 17179869905 rc 0/0 00000100:00100000:0.0:1787826028.899560:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12512 00000100:00100000:0.0:1787826028.899588:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049210624:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.899595:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 724 rpc_version 724 00000020:00100000:0.0:1787826028.899617:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.899622:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c141180 x1874663049210880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.899633:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049210880:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.899662:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.899679:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.899695:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049210880 00000100:00100000:0.0:1787826028.899698:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049210880 00000100:00100000:0.0:1787826028.899722:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12513 00000100:00100000:0.0:1787826028.899729:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187924:x1874663049210880:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.899798:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187924:x1874663049210880:12345-0@lo:1000:osp_up1-0.0 Request processed in 70us (134us total) trans 17179869906 rc 0/0 00000100:00100000:0.0:1787826028.899805:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12513 00000100:00100000:0.0:1787826028.899835:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049210880:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.899842:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 725 rpc_version 725 00000020:00100000:0.0:1787826028.899853:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.899857:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c140e00 x1874663049211136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.899869:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049211136:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.899895:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.899908:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.899918:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049211136 00000100:00100000:0.0:1787826028.899920:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049211136 00000100:00100000:0.0:1787826028.899939:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12514 00000100:00100000:0.0:1787826028.899944:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187924:x1874663049211136:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.900006:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187924:x1874663049211136:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (110us total) trans 17179869907 rc 0/0 00000100:00100000:0.0:1787826028.900012:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12514 00000100:00100000:0.0:1787826028.900037:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049211136:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.900043:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 726 rpc_version 726 00000020:00100000:0.0:1787826028.900053:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.900057:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e80f100 x1874663049211392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.900069:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049211392:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.900090:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.900102:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.900112:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049211392 00000100:00100000:0.0:1787826028.900115:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049211392 00000100:00100000:0.0:1787826028.900133:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12515 00000100:00100000:0.0:1787826028.900138:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187924:x1874663049211392:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.900197:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187924:x1874663049211392:12345-0@lo:1000:osp_up1-0.0 Request processed in 58us (106us total) trans 17179869908 rc 0/0 00000100:00100000:0.0:1787826028.900202:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12515 00000100:00100000:0.0:1787826028.900234:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049211392:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.900239:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 727 rpc_version 727 00000020:00100000:0.0:1787826028.900249:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.900253:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e80c700 x1874663049211648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.900264:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049211648:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.900288:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.900301:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.900312:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049211648 00000100:00100000:0.0:1787826028.900315:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049211648 00000100:00100000:0.0:1787826028.900355:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12516 00000100:00100000:0.0:1787826028.900361:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187924:x1874663049211648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.900423:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049211648:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (134us total) trans 17179869909 rc 0/0 00000100:00100000:0.0:1787826028.900429:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12516 00000100:00100000:0.0:1787826028.900456:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049211648:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.900462:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 728 rpc_version 728 00000020:00100000:0.0:1787826028.900471:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.900475:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e80ed80 x1874663049211904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.900485:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049211904:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.900507:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.900519:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.900529:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049211904 00000100:00100000:0.0:1787826028.900532:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049211904 00000100:00100000:0.0:1787826028.900552:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12517 00000100:00100000:0.0:1787826028.900558:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049211904:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.900800:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049209856 00000100:00100000:2.0:1787826028.900806:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049209856 00000100:00100000:2.0:1787826028.900844:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4207 00000100:00100000:2.0:1787826028.900851:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+18:3619:x1874663049209856:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1787826028.900863:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826028.900885:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cec972 lrc: 0/0,0 mode: --/PW res: [0x240001f58:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cec96b expref: 18 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826028.900902:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f58:0x43:0x0].0x0 (ffff8eb481697d00) 00010000:00010000:2.0:1787826028.900913:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826028.900947:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+17:3619:x1874663049209856:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 98us (6871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826028.900953:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4207 00000100:00100000:2.0:1787826028.900987:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049209856:0@lo:103:jbd2/dm-0-8.0 00000020:00080000:3.0:1787826028.901095:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484005 cancel update log [0x200026560:0x1:0x0].411: rc = 0 00000004:00080000:3.0:1787826028.901144:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb481768300 with version 731 00000020:00080000:3.0:1787826028.901147:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484006 cancel update log [0x240001f58:0x1:0x0].283: rc = 0 00000020:00080000:3.0:1787826028.901178:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484006 cancel update log [0x200026560:0x1:0x0].412: rc = 0 00000004:00080000:3.0:1787826028.901198:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb481768540 with version 732 00000020:00080000:3.0:1787826028.901201:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484007 cancel update log [0x240001f58:0x1:0x0].284: rc = 0 00000020:00080000:3.0:1787826028.901320:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484007 cancel update log [0x200026560:0x1:0x0].413: rc = 0 00000004:00080000:3.0:1787826028.901363:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e0c0 with version 733 00000020:00080000:3.0:1787826028.901366:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484008 cancel update log [0x240001f58:0x1:0x0].285: rc = 0 00000020:00080000:3.0:1787826028.901383:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484008 cancel update log [0x200026560:0x1:0x0].414: rc = 0 00000004:00080000:3.0:1787826028.901398:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e6c0 with version 734 00000020:00080000:3.0:1787826028.901400:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484009 cancel update log [0x240001f58:0x1:0x0].286: rc = 0 00000020:00080000:3.0:1787826028.901413:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484009 cancel update log [0x200026560:0x1:0x0].415: rc = 0 00000004:00080000:3.0:1787826028.901427:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e9c0 with version 735 00000020:00080000:3.0:1787826028.901429:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484010 cancel update log [0x240001f58:0x1:0x0].287: rc = 0 00000020:00080000:3.0:1787826028.901442:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484010 cancel update log [0x200026560:0x1:0x0].416: rc = 0 00000004:00080000:3.0:1787826028.901456:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e540 with version 736 00000020:00080000:3.0:1787826028.901459:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484011 cancel update log [0x240001f58:0x1:0x0].288: rc = 0 00000020:00080000:3.0:1787826028.901472:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484011 cancel update log [0x200026560:0x1:0x0].417: rc = 0 00000004:00080000:3.0:1787826028.901484:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e180 with version 737 00000020:00080000:3.0:1787826028.901487:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484012 cancel update log [0x240001f58:0x1:0x0].289: rc = 0 00000020:00080000:3.0:1787826028.901499:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484012 cancel update log [0x200026560:0x1:0x0].418: rc = 0 00000004:00080000:3.0:1787826028.901511:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e900 with version 738 00000020:00080000:3.0:1787826028.901514:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484013 cancel update log [0x240001f58:0x1:0x0].290: rc = 0 00000020:00080000:3.0:1787826028.901528:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484013 cancel update log [0x200026560:0x1:0x0].419: rc = 0 00000004:00080000:3.0:1787826028.901544:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62ec00 with version 739 00000020:00080000:3.0:1787826028.901547:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484014 cancel update log [0x240001f58:0x1:0x0].291: rc = 0 00000020:00080000:3.0:1787826028.901565:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484014 cancel update log [0x200026560:0x1:0x0].420: rc = 0 00000004:00080000:3.0:1787826028.901583:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e600 with version 740 00000020:00080000:3.0:1787826028.901586:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484015 cancel update log [0x240001f58:0x1:0x0].292: rc = 0 00000020:00080000:3.0:1787826028.901614:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484015 cancel update log [0x200026560:0x1:0x0].421: rc = 0 00000004:00080000:3.0:1787826028.901901:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62ea80 with version 741 00000020:00080000:3.0:1787826028.901906:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484016 cancel update log [0x240001f58:0x1:0x0].293: rc = 0 00000020:00080000:3.0:1787826028.901931:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484016 cancel update log [0x200026560:0x1:0x0].422: rc = 0 00000004:00080000:3.0:1787826028.901951:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a180 with version 742 00000020:00080000:3.0:1787826028.901953:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484017 cancel update log [0x240001f58:0x1:0x0].294: rc = 0 00000020:00080000:3.0:1787826028.901970:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484017 cancel update log [0x200026560:0x1:0x0].423: rc = 0 00000004:00080000:3.0:1787826028.901987:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a840 with version 743 00000020:00080000:3.0:1787826028.901989:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484018 cancel update log [0x240001f58:0x1:0x0].296: rc = 0 00000020:00080000:3.0:1787826028.902004:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484018 cancel update log [0x200026560:0x1:0x0].424: rc = 0 00000004:00080000:3.0:1787826028.902020:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a000 with version 744 00000020:00080000:3.0:1787826028.902023:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484019 cancel update log [0x240001f58:0x1:0x0].297: rc = 0 00000020:00080000:3.0:1787826028.902040:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484019 cancel update log [0x200026560:0x1:0x0].425: rc = 0 00000004:00080000:3.0:1787826028.902055:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a540 with version 745 00000020:00080000:3.0:1787826028.902058:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484020 cancel update log [0x240001f58:0x1:0x0].298: rc = 0 00000020:00080000:3.0:1787826028.902076:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484020 cancel update log [0x200026560:0x1:0x0].427: rc = 0 00000004:00080000:3.0:1787826028.902115:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a9c0 with version 746 00000020:00080000:3.0:1787826028.902119:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484021 cancel update log [0x240001f58:0x1:0x0].299: rc = 0 00000020:00080000:3.0:1787826028.902140:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484021 cancel update log [0x200026560:0x1:0x0].428: rc = 0 00000004:00080000:3.0:1787826028.902158:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a3c0 with version 747 00000020:00080000:3.0:1787826028.902161:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484022 cancel update log [0x240001f58:0x1:0x0].300: rc = 0 00000020:00080000:3.0:1787826028.902179:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484022 cancel update log [0x200026560:0x1:0x0].429: rc = 0 00000004:00080000:3.0:1787826028.902195:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34240e780 with version 748 00000020:00080000:3.0:1787826028.902198:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484023 cancel update log [0x240001f58:0x1:0x0].301: rc = 0 00000100:00100000:0.0:1787826028.902409:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049211904:12345-0@lo:1000:osp_up1-0.0 Request processed in 1848us (1898us total) trans 17179869910 rc 0/0 00000100:00100000:0.0:1787826028.902420:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12517 00000020:00080000:3.0:1787826028.902588:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484023 cancel update log [0x200026560:0x1:0x0].430: rc = 0 00000004:00080000:3.0:1787826028.902623:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34c642900 with version 749 00000020:00080000:3.0:1787826028.902626:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484024 cancel update log [0x240001f58:0x1:0x0].302: rc = 0 00000020:00080000:3.0:1787826028.902645:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484024 cancel update log [0x200026560:0x1:0x0].431: rc = 0 00000004:00080000:3.0:1787826028.902659:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34c642840 with version 750 00000020:00080000:3.0:1787826028.902661:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484025 cancel update log [0x240001f58:0x1:0x0].303: rc = 0 00000020:00080000:3.0:1787826028.902678:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484025 cancel update log [0x200026560:0x1:0x0].432: rc = 0 00000004:00080000:3.0:1787826028.902692:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34c642b40 with version 751 00000020:00080000:3.0:1787826028.902694:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484026 cancel update log [0x240001f58:0x1:0x0].304: rc = 0 00000020:00080000:3.0:1787826028.902710:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484026 cancel update log [0x200026560:0x1:0x0].433: rc = 0 00000004:00080000:3.0:1787826028.902726:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34c642000 with version 752 00000020:00080000:3.0:1787826028.902729:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484027 cancel update log [0x240001f58:0x1:0x0].305: rc = 0 00000020:00080000:3.0:1787826028.902742:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484027 cancel update log [0x200026560:0x1:0x0].434: rc = 0 00000004:00080000:3.0:1787826028.902755:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb442451180 with version 753 00000020:00080000:3.0:1787826028.902758:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484028 cancel update log [0x240001f58:0x1:0x0].306: rc = 0 00000020:00080000:3.0:1787826028.902774:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484028 cancel update log [0x200026560:0x1:0x0].435: rc = 0 00000004:00080000:3.0:1787826028.902805:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb442451780 with version 754 00000020:00080000:3.0:1787826028.902809:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484029 cancel update log [0x240001f58:0x1:0x0].307: rc = 0 00000020:00080000:3.0:1787826028.902830:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484029 cancel update log [0x200026560:0x1:0x0].436: rc = 0 00000004:00080000:3.0:1787826028.902848:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4774c93c0 with version 755 00000020:00080000:3.0:1787826028.902851:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484030 cancel update log [0x240001f58:0x1:0x0].308: rc = 0 00000020:00080000:3.0:1787826028.902866:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484030 cancel update log [0x200026560:0x1:0x0].437: rc = 0 00000004:00080000:3.0:1787826028.902883:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4774c99c0 with version 756 00000020:00080000:3.0:1787826028.902886:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484031 cancel update log [0x240001f58:0x1:0x0].309: rc = 0 00000020:00080000:3.0:1787826028.902899:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484031 cancel update log [0x200026560:0x1:0x0].438: rc = 0 00000004:00080000:3.0:1787826028.902913:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4774c9e40 with version 757 00000020:00080000:3.0:1787826028.902915:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484032 cancel update log [0x240001f58:0x1:0x0].310: rc = 0 00000020:00080000:3.0:1787826028.902928:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484032 cancel update log [0x200026560:0x1:0x0].439: rc = 0 00000004:00080000:3.0:1787826028.902943:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb448f0da80 with version 758 00000020:00080000:3.0:1787826028.902945:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484033 cancel update log [0x240001f58:0x1:0x0].311: rc = 0 00000020:00080000:3.0:1787826028.902958:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484033 cancel update log [0x200026560:0x1:0x0].440: rc = 0 00000004:00080000:3.0:1787826028.902972:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb45ec79180 with version 759 00000020:00080000:3.0:1787826028.902974:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484034 cancel update log [0x240001f58:0x1:0x0].312: rc = 0 00000020:00080000:3.0:1787826028.902989:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484034 cancel update log [0x200026560:0x1:0x0].441: rc = 0 00000004:00080000:3.0:1787826028.903004:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb45ec79540 with version 760 00000020:00080000:3.0:1787826028.903007:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484035 cancel update log [0x240001f58:0x1:0x0].313: rc = 0 00000020:00080000:3.0:1787826028.903020:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484035 cancel update log [0x200026560:0x1:0x0].442: rc = 0 00000004:00080000:3.0:1787826028.903034:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb442ec2180 with version 761 00000020:00080000:3.0:1787826028.903036:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484036 cancel update log [0x240001f58:0x1:0x0].314: rc = 0 00000020:00080000:3.0:1787826028.903048:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484036 cancel update log [0x200026560:0x1:0x0].443: rc = 0 00000004:00080000:3.0:1787826028.903077:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb442ec2480 with version 762 00000020:00080000:3.0:1787826028.903080:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484037 cancel update log [0x240001f58:0x1:0x0].315: rc = 0 00000020:00080000:3.0:1787826028.903098:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484037 cancel update log [0x200026560:0x1:0x0].444: rc = 0 00000004:00080000:3.0:1787826028.903112:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb442ec2c00 with version 763 00000020:00080000:3.0:1787826028.903115:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484038 cancel update log [0x240001f58:0x1:0x0].317: rc = 0 00000020:00080000:3.0:1787826028.903129:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484038 cancel update log [0x200026560:0x1:0x0].445: rc = 0 00000004:00080000:3.0:1787826028.903143:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb442ec23c0 with version 764 00000020:00080000:3.0:1787826028.903145:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484039 cancel update log [0x240001f58:0x1:0x0].318: rc = 0 00000020:00080000:3.0:1787826028.903159:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484039 cancel update log [0x200026560:0x1:0x0].446: rc = 0 00000004:00080000:3.0:1787826028.903172:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4817689c0 with version 765 00000020:00080000:3.0:1787826028.903174:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484040 cancel update log [0x240001f58:0x1:0x0].319: rc = 0 00000020:00080000:3.0:1787826028.903187:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484040 cancel update log [0x200026560:0x1:0x0].447: rc = 0 00000004:00080000:3.0:1787826028.903201:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47744d240 with version 766 00000020:00080000:3.0:1787826028.903203:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484041 cancel update log [0x240001f58:0x1:0x0].320: rc = 0 00000020:00080000:3.0:1787826028.909424:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484041 cancel update log [0x200026560:0x1:0x0].448: rc = 0 00000004:00080000:3.0:1787826028.909469:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47744d900 with version 767 00000020:00080000:3.0:1787826028.909474:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484042 cancel update log [0x240001f58:0x1:0x0].321: rc = 0 00000020:00080000:3.0:1787826028.909494:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484042 cancel update log [0x200026560:0x1:0x0].450: rc = 0 00000004:00080000:3.0:1787826028.909513:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47744d840 with version 768 00000020:00080000:3.0:1787826028.909516:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484043 cancel update log [0x240001f58:0x1:0x0].322: rc = 0 00000020:00080000:3.0:1787826028.909534:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484043 cancel update log [0x200026560:0x1:0x0].451: rc = 0 00000004:00080000:3.0:1787826028.909555:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb450baa900 with version 769 00000020:00080000:3.0:1787826028.909557:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484044 cancel update log [0x240001f58:0x1:0x0].323: rc = 0 00000020:00080000:3.0:1787826028.909575:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484044 cancel update log [0x200026560:0x1:0x0].452: rc = 0 00000020:00080000:3.0:1787826028.909582:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484044 00000100:00100000:1.0:1787826028.911419:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049211904:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.911438:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 729 rpc_version 729 00000020:00100000:1.0:1787826028.911465:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.911473:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34ddd4a80 x1874663049212160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.911495:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049212160:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.911561:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.911597:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826028.914513:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049212160 00000100:00100000:3.0:1787826028.914528:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049212160 00000100:00100000:3.0:1787826028.914579:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12518 00000100:00100000:3.0:1787826028.914589:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049212160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826028.914825:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187924:x1874663049212160:12345-0@lo:1000:osp_up1-0.0 Request processed in 237us (3263us total) trans 17179869911 rc 0/0 00000100:00100000:3.0:1787826028.914833:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12518 00000100:00100000:1.0:1787826028.915415:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049212160:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.915432:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 730 rpc_version 730 00000020:00100000:1.0:1787826028.915459:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.915467:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479842a00 x1874663049212416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.915487:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049212416:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.915533:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.915615:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.932826:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049212416 00000100:00100000:0.0:1787826028.932841:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049212416 00000100:00100000:0.0:1787826028.932898:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12519 00000100:00100000:0.0:1787826028.932907:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187924:x1874663049212416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.933074:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187924:x1874663049212416:12345-0@lo:1000:osp_up1-0.0 Request processed in 168us (17540us total) trans 17179869912 rc 0/0 00000100:00100000:0.0:1787826028.933081:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12519 00000100:00100000:1.0:1787826028.933200:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049212416:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.933214:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 731 rpc_version 731 00000020:00100000:1.0:1787826028.933250:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.933257:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b41f80 x1874663049212672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.933279:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049212672:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.933318:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.933362:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.933583:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049212672 00000100:00100000:0.0:1787826028.933589:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049212672 00000100:00100000:0.0:1787826028.933638:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12520 00000100:00100000:0.0:1787826028.933645:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187924:x1874663049212672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.933753:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187924:x1874663049212672:12345-0@lo:1000:osp_up1-0.0 Request processed in 106us (433us total) trans 17179869913 rc 0/0 00000100:00100000:0.0:1787826028.933761:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12520 00000100:00100000:1.0:1787826028.933837:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049212672:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.933845:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 732 rpc_version 732 00000020:00100000:1.0:1787826028.933857:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.933862:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb479b41180 x1874663049212928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.933874:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049212928:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.933897:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.933920:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.933962:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049212928 00000100:00100000:0.0:1787826028.933966:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049212928 00000100:00100000:0.0:1787826028.933994:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12521 00000100:00100000:0.0:1787826028.934000:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187924:x1874663049212928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.934059:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187924:x1874663049212928:12345-0@lo:1000:osp_up1-0.0 Request processed in 59us (160us total) trans 17179869914 rc 0/0 00000100:00100000:0.0:1787826028.934065:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12521 00000100:00100000:1.0:1787826028.934126:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049212928:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.934132:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 733 rpc_version 733 00000020:00100000:1.0:1787826028.934143:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.934147:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb448d14a80 x1874663049213184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.934157:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d14a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049213184:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.934180:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.934202:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.934360:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049213184 00000100:00100000:0.0:1787826028.934364:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049213184 00000100:00100000:0.0:1787826028.934387:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12522 00000100:00100000:0.0:1787826028.934393:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187924:x1874663049213184:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.934461:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187924:x1874663049213184:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (278us total) trans 17179869915 rc 0/0 00000100:00100000:0.0:1787826028.934467:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12522 00000100:00100000:1.0:1787826028.934657:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d14a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049213184:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.934665:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 734 rpc_version 734 00000020:00100000:1.0:1787826028.934678:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.934682:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66e300 x1874663049213440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.934693:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049213440:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.934717:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.934740:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.934782:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049213440 00000100:00100000:0.0:1787826028.934787:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049213440 00000100:00100000:0.0:1787826028.934816:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12523 00000100:00100000:0.0:1787826028.934823:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187924:x1874663049213440:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.934903:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187924:x1874663049213440:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (184us total) trans 17179869916 rc 0/0 00000100:00100000:0.0:1787826028.934909:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12523 00000100:00100000:2.0:1787826028.934974:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049213440:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826028.934982:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 735 rpc_version 735 00000020:00100000:2.0:1787826028.934994:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826028.934999:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4815e3480 x1874663049213696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826028.935012:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049213696:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.935040:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826028.935065:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.935109:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049213696 00000100:00100000:0.0:1787826028.935114:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049213696 00000100:00100000:0.0:1787826028.935144:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12524 00000100:00100000:0.0:1787826028.935151:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187924:x1874663049213696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.935243:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187924:x1874663049213696:12345-0@lo:1000:osp_up1-0.0 Request processed in 92us (201us total) trans 17179869917 rc 0/0 00000100:00100000:0.0:1787826028.935249:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12524 00000100:00100000:0.0:1787826028.935281:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049213696:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.935288:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 736 rpc_version 736 00000020:00100000:0.0:1787826028.935301:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.935306:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b76300 x1874663049213952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.935317:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b76300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049213952:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.935367:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.935381:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.935391:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049213952 00000100:00100000:0.0:1787826028.935395:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049213952 00000100:00100000:0.0:1787826028.935416:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12525 00000100:00100000:0.0:1787826028.935422:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187924:x1874663049213952:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.935488:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187924:x1874663049213952:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (119us total) trans 17179869918 rc 0/0 00000100:00100000:0.0:1787826028.935495:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12525 00000100:00100000:0.0:1787826028.935526:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b76300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049213952:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.935532:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 737 rpc_version 737 00000020:00100000:0.0:1787826028.935542:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.935546:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b75500 x1874663049214208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.935563:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049214208:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.935585:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.935596:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.935619:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049214208 00000100:00100000:0.0:1787826028.935622:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049214208 00000100:00100000:0.0:1787826028.935639:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12526 00000100:00100000:0.0:1787826028.935644:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187924:x1874663049214208:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.935699:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187924:x1874663049214208:12345-0@lo:1000:osp_up1-0.0 Request processed in 55us (113us total) trans 17179869919 rc 0/0 00000100:00100000:0.0:1787826028.935706:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12526 00000100:00100000:0.0:1787826028.935731:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049214208:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.935737:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 738 rpc_version 738 00000020:00100000:0.0:1787826028.935747:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.935751:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b75180 x1874663049214464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.935761:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049214464:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.935782:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.935792:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.935801:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049214464 00000100:00100000:0.0:1787826028.935804:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049214464 00000100:00100000:0.0:1787826028.935821:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12527 00000100:00100000:0.0:1787826028.935826:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187924:x1874663049214464:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.935881:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187924:x1874663049214464:12345-0@lo:1000:osp_up1-0.0 Request processed in 54us (98us total) trans 17179869920 rc 0/0 00000100:00100000:0.0:1787826028.935887:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12527 00000100:00100000:0.0:1787826028.935913:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049214464:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.935919:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 739 rpc_version 739 00000020:00100000:0.0:1787826028.935928:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.935932:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b75f80 x1874663049214720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.935955:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049214720:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.935977:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.935988:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.935997:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049214720 00000100:00100000:0.0:1787826028.935999:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049214720 00000100:00100000:0.0:1787826028.936015:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12528 00000100:00100000:0.0:1787826028.936020:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187924:x1874663049214720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936072:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187924:x1874663049214720:12345-0@lo:1000:osp_up1-0.0 Request processed in 51us (93us total) trans 17179869921 rc 0/0 00000100:00100000:0.0:1787826028.936077:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12528 00000100:00100000:0.0:1787826028.936102:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049214720:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.936108:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 740 rpc_version 740 00000020:00100000:0.0:1787826028.936117:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.936120:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481b77800 x1874663049214976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.936130:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b77800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049214976:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936149:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.936160:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.936169:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049214976 00000100:00100000:0.0:1787826028.936172:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049214976 00000100:00100000:0.0:1787826028.936188:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12529 00000100:00100000:0.0:1787826028.936193:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187924:x1874663049214976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936250:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187924:x1874663049214976:12345-0@lo:1000:osp_up1-0.0 Request processed in 55us (99us total) trans 17179869922 rc 0/0 00000100:00100000:0.0:1787826028.936256:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12529 00000100:00100000:0.0:1787826028.936283:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b77800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049214976:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.936289:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 741 rpc_version 741 00000020:00100000:0.0:1787826028.936299:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.936303:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb476d30700 x1874663049215232/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.936313:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049215232:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936360:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.936373:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.936382:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049215232 00000100:00100000:0.0:1787826028.936385:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049215232 00000100:00100000:0.0:1787826028.936403:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12530 00000100:00100000:0.0:1787826028.936408:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187924:x1874663049215232:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936465:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187924:x1874663049215232:12345-0@lo:1000:osp_up1-0.0 Request processed in 56us (105us total) trans 17179869923 rc 0/0 00000100:00100000:0.0:1787826028.936471:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12530 00000100:00100000:0.0:1787826028.936497:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049215232:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.936503:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 742 rpc_version 742 00000020:00100000:0.0:1787826028.936512:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.936515:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb476d30e00 x1874663049215488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.936525:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049215488:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936545:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.936556:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.936566:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049215488 00000100:00100000:0.0:1787826028.936569:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049215488 00000100:00100000:0.0:1787826028.936587:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12531 00000100:00100000:0.0:1787826028.936592:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187924:x1874663049215488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936663:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187924:x1874663049215488:12345-0@lo:1000:osp_up1-0.0 Request processed in 70us (116us total) trans 17179869924 rc 0/0 00000100:00100000:0.0:1787826028.936669:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12531 00000100:00100000:0.0:1787826028.936695:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049215488:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.936701:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 743 rpc_version 743 00000020:00100000:0.0:1787826028.936711:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.936715:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb476d31180 x1874663049215744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.936725:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d31180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049215744:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936747:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.936760:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.936769:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049215744 00000100:00100000:0.0:1787826028.936772:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049215744 00000100:00100000:0.0:1787826028.936791:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12532 00000100:00100000:0.0:1787826028.936797:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187924:x1874663049215744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936858:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187924:x1874663049215744:12345-0@lo:1000:osp_up1-0.0 Request processed in 60us (109us total) trans 17179869925 rc 0/0 00000100:00100000:0.0:1787826028.936864:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12532 00000100:00100000:0.0:1787826028.936893:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d31180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049215744:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.936899:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 744 rpc_version 744 00000020:00100000:0.0:1787826028.936909:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.936914:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb476d32300 x1874663049216000/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.936925:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d32300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049216000:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.936950:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.936963:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.936973:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049216000 00000100:00100000:0.0:1787826028.936976:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049216000 00000100:00100000:0.0:1787826028.936995:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12533 00000100:00100000:0.0:1787826028.937001:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187924:x1874663049216000:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937066:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187924:x1874663049216000:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (114us total) trans 17179869926 rc 0/0 00000100:00100000:0.0:1787826028.937073:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12533 00000100:00100000:0.0:1787826028.937102:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d32300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049216000:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.937107:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 745 rpc_version 745 00000020:00100000:0.0:1787826028.937119:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.937122:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472585180 x1874663049216256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.937131:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472585180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049216256:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937154:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.937167:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.937177:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049216256 00000100:00100000:0.0:1787826028.937180:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049216256 00000100:00100000:0.0:1787826028.937200:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12534 00000100:00100000:0.0:1787826028.937206:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187924:x1874663049216256:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937268:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187924:x1874663049216256:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (112us total) trans 17179869927 rc 0/0 00000100:00100000:0.0:1787826028.937274:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12534 00000100:00100000:0.0:1787826028.937304:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472585180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049216256:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.937309:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 746 rpc_version 746 00000020:00100000:0.0:1787826028.937321:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.937350:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472584000 x1874663049216512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.937362:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049216512:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937387:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.937402:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.937413:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049216512 00000100:00100000:0.0:1787826028.937416:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049216512 00000100:00100000:0.0:1787826028.937438:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12535 00000100:00100000:0.0:1787826028.937444:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187924:x1874663049216512:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937509:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187924:x1874663049216512:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (120us total) trans 17179869928 rc 0/0 00000100:00100000:0.0:1787826028.937515:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12535 00000100:00100000:0.0:1787826028.937543:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049216512:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.937549:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 747 rpc_version 747 00000020:00100000:0.0:1787826028.937560:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.937564:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f747480 x1874663049216768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.937575:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049216768:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937610:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.937624:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.937635:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049216768 00000100:00100000:0.0:1787826028.937639:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049216768 00000100:00100000:0.0:1787826028.937659:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12536 00000100:00100000:0.0:1787826028.937665:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187924:x1874663049216768:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937729:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187924:x1874663049216768:12345-0@lo:1000:osp_up1-0.0 Request processed in 63us (129us total) trans 17179869929 rc 0/0 00000100:00100000:0.0:1787826028.937735:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12536 00000100:00100000:0.0:1787826028.937763:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049216768:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.937770:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 748 rpc_version 748 00000020:00100000:0.0:1787826028.937780:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.937784:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f747100 x1874663049217024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.937794:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049217024:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937818:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.937832:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.937843:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049217024 00000100:00100000:0.0:1787826028.937846:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049217024 00000100:00100000:0.0:1787826028.937867:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12537 00000100:00100000:0.0:1787826028.937872:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187924:x1874663049217024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.937935:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187924:x1874663049217024:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (117us total) trans 17179869930 rc 0/0 00000100:00100000:0.0:1787826028.937941:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12537 00000100:00100000:0.0:1787826028.937967:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049217024:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.937973:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 749 rpc_version 749 00000020:00100000:0.0:1787826028.937983:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.937987:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f747800 x1874663049217280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.937998:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049217280:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.938022:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.938035:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.938045:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049217280 00000100:00100000:0.0:1787826028.938048:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049217280 00000100:00100000:0.0:1787826028.938068:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12538 00000100:00100000:0.0:1787826028.938073:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187924:x1874663049217280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.938138:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187924:x1874663049217280:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (114us total) trans 17179869931 rc 0/0 00000100:00100000:0.0:1787826028.938145:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12538 00000100:00100000:0.0:1787826028.938175:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049217280:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.938182:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 750 rpc_version 750 00000020:00100000:0.0:1787826028.938194:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.938198:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb349b6ed80 x1874663049217536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.938210:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049217536:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.938233:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.938246:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.938257:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049217536 00000100:00100000:0.0:1787826028.938259:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049217536 00000100:00100000:0.0:1787826028.938281:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12539 00000100:00100000:0.0:1787826028.938287:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187924:x1874663049217536:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.938377:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187924:x1874663049217536:12345-0@lo:1000:osp_up1-0.0 Request processed in 89us (141us total) trans 17179869932 rc 0/0 00000100:00100000:0.0:1787826028.938384:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12539 00000100:00100000:0.0:1787826028.938419:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049217536:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.938426:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 751 rpc_version 751 00000020:00100000:0.0:1787826028.938436:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.938440:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb349b6ca80 x1874663049217792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.938450:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049217792:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.938473:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.938486:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.938495:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049217792 00000100:00100000:0.0:1787826028.938498:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049217792 00000100:00100000:0.0:1787826028.938516:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12540 00000100:00100000:0.0:1787826028.938522:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187924:x1874663049217792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.938582:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:187924:x1874663049217792:12345-0@lo:1000:osp_up1-0.0 Request processed in 60us (107us total) trans 17179869933 rc 0/0 00000100:00100000:0.0:1787826028.938589:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12540 00000100:00100000:1.0:1787826028.939572:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049217792:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.939585:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 752 rpc_version 752 00000020:00100000:1.0:1787826028.939615:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.939621:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a66d180 x1874663049218048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.939637:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049218048:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.939678:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.939709:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.939765:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049218048 00000100:00100000:2.0:1787826028.939771:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049218048 00000100:00100000:2.0:1787826028.939815:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12541 00000100:00100000:2.0:1787826028.939825:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:187924:x1874663049218048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.939944:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:187924:x1874663049218048:12345-0@lo:1000:osp_up1-0.0 Request processed in 121us (265us total) trans 17179869934 rc 0/0 00000100:00100000:2.0:1787826028.939951:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12541 00000100:00100000:1.0:1787826028.940264:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049218048:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.940272:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 753 rpc_version 753 00000020:00100000:1.0:1787826028.940286:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.940290:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4607f4e00 x1874663049218304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.940302:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049218304:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.940372:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.940390:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.940496:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049218304 00000100:00100000:2.0:1787826028.940500:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049218304 00000100:00100000:2.0:1787826028.940530:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12542 00000100:00100000:2.0:1787826028.940536:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:187924:x1874663049218304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.940615:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:187924:x1874663049218304:12345-0@lo:1000:osp_up1-0.0 Request processed in 78us (242us total) trans 17179869935 rc 0/0 00000100:00100000:2.0:1787826028.940621:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12542 00000100:00100000:1.0:1787826028.940676:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049218304:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.940683:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 754 rpc_version 754 00000020:00100000:1.0:1787826028.940693:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.940697:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f5f2300 x1874663049218560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.940709:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049218560:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.940730:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.940749:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.940784:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049218560 00000100:00100000:2.0:1787826028.940788:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049218560 00000100:00100000:2.0:1787826028.940816:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12543 00000100:00100000:2.0:1787826028.940822:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:187924:x1874663049218560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.940890:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+42:187924:x1874663049218560:12345-0@lo:1000:osp_up1-0.0 Request processed in 68us (159us total) trans 17179869936 rc 0/0 00000100:00100000:2.0:1787826028.940897:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12543 00000100:00100000:1.0:1787826028.941817:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049218560:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.941828:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 755 rpc_version 755 00000020:00100000:1.0:1787826028.941844:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.941850:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f5f3480 x1874663049218816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.941864:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049218816:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.941901:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.941930:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.941977:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049218816 00000100:00100000:2.0:1787826028.941982:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049218816 00000100:00100000:2.0:1787826028.942020:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12544 00000100:00100000:2.0:1787826028.942028:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+42:187924:x1874663049218816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.942139:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+43:187924:x1874663049218816:12345-0@lo:1000:osp_up1-0.0 Request processed in 111us (238us total) trans 17179869937 rc 0/0 00000100:00100000:2.0:1787826028.942146:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12544 00000100:00100000:1.0:1787826028.942231:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049218816:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.942239:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 756 rpc_version 756 00000020:00100000:1.0:1787826028.942251:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.942255:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f5f2680 x1874663049219072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.942267:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049219072:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.942290:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.942313:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.942379:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049219072 00000100:00100000:2.0:1787826028.942384:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049219072 00000100:00100000:2.0:1787826028.942416:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12545 00000100:00100000:2.0:1787826028.942423:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+43:187924:x1874663049219072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.942490:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:187924:x1874663049219072:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (198us total) trans 17179869938 rc 0/0 00000100:00100000:2.0:1787826028.942496:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12545 00000100:00100000:1.0:1787826028.942711:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049219072:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.942719:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 757 rpc_version 757 00000020:00100000:1.0:1787826028.942732:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.942737:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e84f100 x1874663049219328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.942748:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049219328:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.942790:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.942815:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.942857:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049219328 00000100:00100000:2.0:1787826028.942862:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049219328 00000100:00100000:2.0:1787826028.942893:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12546 00000100:00100000:2.0:1787826028.942900:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:187924:x1874663049219328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.942976:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+45:187924:x1874663049219328:12345-0@lo:1000:osp_up1-0.0 Request processed in 76us (185us total) trans 17179869939 rc 0/0 00000100:00100000:2.0:1787826028.942982:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12546 00000100:00100000:1.0:1787826028.943046:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049219328:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.943055:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 758 rpc_version 758 00000020:00100000:1.0:1787826028.943066:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.943070:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e84ca80 x1874663049219584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.943081:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049219584:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.943104:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.943127:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.943168:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049219584 00000100:00100000:2.0:1787826028.943172:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049219584 00000100:00100000:2.0:1787826028.943203:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12547 00000100:00100000:2.0:1787826028.943226:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+45:187924:x1874663049219584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.943305:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+46:187924:x1874663049219584:12345-0@lo:1000:osp_up1-0.0 Request processed in 95us (198us total) trans 17179869940 rc 0/0 00000100:00100000:2.0:1787826028.943312:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12547 00000100:00100000:1.0:1787826028.943658:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049219584:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.943666:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 759 rpc_version 759 00000020:00100000:1.0:1787826028.943691:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.943697:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e84df80 x1874663049219840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.943709:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049219840:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.943736:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.943759:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.943956:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049219840 00000100:00100000:2.0:1787826028.943960:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049219840 00000100:00100000:2.0:1787826028.943994:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12548 00000100:00100000:2.0:1787826028.944001:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+46:187924:x1874663049219840:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.944084:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+47:187924:x1874663049219840:12345-0@lo:1000:osp_up1-0.0 Request processed in 84us (348us total) trans 17179869941 rc 0/0 00000100:00100000:2.0:1787826028.944091:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12548 00000100:00100000:1.0:1787826028.944505:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049219840:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.944514:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 760 rpc_version 760 00000020:00100000:1.0:1787826028.944529:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.944534:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e84fb80 x1874663049220096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.944547:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049220096:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.944573:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.944596:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.944650:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049220096 00000100:00100000:2.0:1787826028.944655:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049220096 00000100:00100000:2.0:1787826028.944689:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12549 00000100:00100000:2.0:1787826028.944696:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+47:187924:x1874663049220096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.944782:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+48:187924:x1874663049220096:12345-0@lo:1000:osp_up1-0.0 Request processed in 87us (208us total) trans 17179869942 rc 0/0 00000100:00100000:2.0:1787826028.944788:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12549 00000100:00100000:1.0:1787826028.945047:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049220096:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.945054:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 761 rpc_version 761 00000020:00100000:1.0:1787826028.945066:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.945070:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e84e300 x1874663049220352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.945081:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049220352:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.945137:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.945161:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.945202:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049220352 00000100:00100000:2.0:1787826028.945215:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049220352 00000100:00100000:2.0:1787826028.945255:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12550 00000100:00100000:2.0:1787826028.945262:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+48:187924:x1874663049220352:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.945359:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+49:187924:x1874663049220352:12345-0@lo:1000:osp_up1-0.0 Request processed in 97us (221us total) trans 17179869943 rc 0/0 00000100:00100000:2.0:1787826028.945366:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12550 00000100:00100000:1.0:1787826028.945534:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049220352:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.945542:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 762 rpc_version 762 00000020:00100000:1.0:1787826028.945553:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.945559:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e84d880 x1874663049220608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.945570:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049220608:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.945597:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.945627:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.947501:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049220608 00000100:00100000:2.0:1787826028.947514:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049220608 00000100:00100000:2.0:1787826028.947577:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12551 00000100:00100000:2.0:1787826028.947588:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+49:187924:x1874663049220608:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.947783:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+50:187924:x1874663049220608:12345-0@lo:1000:osp_up1-0.0 Request processed in 197us (2184us total) trans 17179869944 rc 0/0 00000100:00100000:2.0:1787826028.947790:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12551 00000100:00100000:1.0:1787826028.947883:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049220608:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.947896:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 763 rpc_version 763 00000020:00100000:1.0:1787826028.947915:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.947921:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34dde0000 x1874663049220864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.947939:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049220864:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.947984:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.948011:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826028.952417:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049220864 00000100:00100000:2.0:1787826028.952429:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049220864 00000100:00100000:2.0:1787826028.952479:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12552 00000100:00100000:2.0:1787826028.952488:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+50:187924:x1874663049220864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826028.952680:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+51:187924:x1874663049220864:12345-0@lo:1000:osp_up1-0.0 Request processed in 193us (4695us total) trans 17179869945 rc 0/0 00000100:00100000:2.0:1787826028.952689:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12552 00000100:00100000:1.0:1787826028.955901:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049220864:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.955919:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 764 rpc_version 764 00000020:00100000:1.0:1787826028.955943:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.955950:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34dde3800 x1874663049221120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.955969:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049221120:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.956025:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.956066:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049221120 00000100:00100000:1.0:1787826028.956072:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049221120 00000100:00100000:1.0:1787826028.956117:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12553 00000100:00100000:1.0:1787826028.956125:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+51:187924:x1874663049221120:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.957528:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+52:187924:x1874663049221120:12345-0@lo:1000:osp_up1-0.0 Request processed in 1398us (1497us total) trans 17179869946 rc 0/0 00000100:00100000:1.0:1787826028.957540:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12553 00000100:00100000:1.0:1787826028.957579:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826028.957617:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049221120:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826028.957630:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 765 rpc_version 765 00000020:00100000:1.0:1787826028.957649:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826028.957655:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34dde2d80 x1874663049221376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826028.957671:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049221376:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826028.957702:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826028.957723:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a75c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.958208:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049221376 00000100:00100000:0.0:1787826028.958215:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049221376 00000100:00100000:0.0:1787826028.958268:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12554 00000100:00100000:0.0:1787826028.958278:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+52:187924:x1874663049221376:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.958422:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+53:187924:x1874663049221376:12345-0@lo:1000:osp_up1-0.0 Request processed in 146us (719us total) trans 17179869947 rc 0/0 00000100:00100000:0.0:1787826028.958430:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12554 00000100:00100000:0.0:1787826028.958467:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049221376:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.958476:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 766 rpc_version 766 00000020:00100000:0.0:1787826028.958490:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.958495:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb349b6ce00 x1874663049221632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.958508:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049221632:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.958548:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.958564:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.958575:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049221632 00000100:00100000:0.0:1787826028.958578:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049221632 00000100:00100000:0.0:1787826028.958596:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12555 00000100:00100000:0.0:1787826028.958617:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+53:187924:x1874663049221632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.958684:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+54:187924:x1874663049221632:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (135us total) trans 17179869948 rc 0/0 00000100:00100000:0.0:1787826028.958690:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12555 00000100:00100000:0.0:1787826028.958877:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049221632:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.958885:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 767 rpc_version 767 00000020:00100000:0.0:1787826028.958896:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.958901:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb349b6f480 x1874663049221888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.958914:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049221888:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.958982:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.958998:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.959009:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049221888 00000100:00100000:0.0:1787826028.959013:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049221888 00000100:00100000:0.0:1787826028.959031:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12556 00000100:00100000:0.0:1787826028.959037:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+54:187924:x1874663049221888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.959121:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+55:187924:x1874663049221888:12345-0@lo:1000:osp_up1-0.0 Request processed in 83us (137us total) trans 17179869949 rc 0/0 00000100:00100000:0.0:1787826028.959127:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12556 00000100:00100000:0.0:1787826028.959157:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049221888:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.959164:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 768 rpc_version 768 00000020:00100000:0.0:1787826028.959175:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.959180:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb349b6d180 x1874663049222144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.959192:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049222144:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.959215:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.959227:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.959237:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049222144 00000100:00100000:0.0:1787826028.959240:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049222144 00000100:00100000:0.0:1787826028.959257:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12557 00000100:00100000:0.0:1787826028.959262:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+55:187924:x1874663049222144:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.959345:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+56:187924:x1874663049222144:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (109us total) trans 17179869950 rc 0/0 00000100:00100000:0.0:1787826028.959352:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12557 00000100:00100000:0.0:1787826028.959380:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049222144:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826028.959386:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 769 rpc_version 769 00000020:00100000:0.0:1787826028.959397:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826028.959401:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb349b6ea00 x1874663049222400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826028.959413:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049222400:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.959436:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826028.959449:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826028.959460:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049222400 00000100:00100000:0.0:1787826028.959463:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049222400 00000100:00100000:0.0:1787826028.959478:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12558 00000100:00100000:0.0:1787826028.959484:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+56:187924:x1874663049222400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826028.959551:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+57:187924:x1874663049222400:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (113us total) trans 17179869951 rc 0/0 00000100:00100000:0.0:1787826028.959559:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12558 00000100:00100000:0.0:1787826028.959586:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049222400:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787826029.396629:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826030.420572:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787826030.939315:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869951 is committed 00000100:00100000:3.0:1787826030.945464:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826030.945506:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049222528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826030.945607:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826030.945836:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049222528 00000100:00100000:0.0:1787826030.945847:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049222528 00000100:00100000:0.0:1787826030.945919:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12559 00000100:00100000:0.0:1787826030.945932:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049222528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826030.945983:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445466112 avail 1299226624 00000100:00100000:0.0:1787826030.946040:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049222528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826030.946047:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12559 00000100:00100000:3.0:1787826030.946130:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869951 gen 2 00000004:00080000:3.0:1787826030.946136:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869901 committed transno 17179869951 00000020:00080000:3.0:1787826030.946144:0:3618:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb44f6a1cc0 refcount 2 committed 0 result 0 batchid 330712484067 00000020:00080000:3.0:1787826030.946148:0:3618:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb446099200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb44f6a10c0 00000020:00080000:3.0:1787826030.946151:0:3618:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].347 00000020:00080000:3.0:1787826030.946154:0:3618:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb446099800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb3448bb000 00000020:00080000:3.0:1787826030.946157:0:3618:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].476 00000004:00080000:3.0:1787826030.946232:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869902 committed transno 17179869951 00000020:00080000:3.0:1787826030.946237:0:3618:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8eb34916c240 refcount 2 committed 0 result 0 batchid 330712484068 00000020:00080000:3.0:1787826030.946240:0:3618:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879a100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb34916cb40 00000020:00080000:3.0:1787826030.946243:0:3618:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f58:0x1:0x0].348 00000020:00080000:3.0:1787826030.946246:0:3618:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb44879a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb342170600 00000020:00080000:3.0:1787826030.946248:0:3618:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200026560:0x1:0x0].477 00000004:00080000:3.0:1787826030.946262:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869903 committed transno 17179869951 00000004:00080000:3.0:1787826030.946275:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869904 committed transno 17179869951 00000004:00080000:3.0:1787826030.946285:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869905 committed transno 17179869951 00000004:00080000:3.0:1787826030.946293:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869906 committed transno 17179869951 00000004:00080000:3.0:1787826030.946302:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869907 committed transno 17179869951 00000004:00080000:3.0:1787826030.946313:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869908 committed transno 17179869951 00000004:00080000:3.0:1787826030.946348:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869909 committed transno 17179869951 00000004:00080000:3.0:1787826030.946363:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869910 committed transno 17179869951 00000004:00080000:3.0:1787826030.946375:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869911 committed transno 17179869951 00000004:00080000:3.0:1787826030.946386:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869912 committed transno 17179869951 00000004:00080000:3.0:1787826030.946396:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869913 committed transno 17179869951 00000004:00080000:3.0:1787826030.946405:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869914 committed transno 17179869951 00000004:00080000:3.0:1787826030.946417:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869915 committed transno 17179869951 00000004:00080000:3.0:1787826030.946430:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869916 committed transno 17179869951 00000004:00080000:3.0:1787826030.946454:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869917 committed transno 17179869951 00000004:00080000:3.0:1787826030.946464:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869918 committed transno 17179869951 00000004:00080000:3.0:1787826030.946475:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869919 committed transno 17179869951 00000004:00080000:3.0:1787826030.946494:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869920 committed transno 17179869951 00000004:00080000:3.0:1787826030.946504:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869921 committed transno 17179869951 00000004:00080000:3.0:1787826030.946513:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869922 committed transno 17179869951 00000004:00080000:3.0:1787826030.946526:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869923 committed transno 17179869951 00000004:00080000:3.0:1787826030.946536:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869924 committed transno 17179869951 00000004:00080000:3.0:1787826030.946546:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869925 committed transno 17179869951 00000004:00080000:3.0:1787826030.946557:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869926 committed transno 17179869951 00000004:00080000:3.0:1787826030.946567:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869927 committed transno 17179869951 00000004:00080000:3.0:1787826030.946576:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869928 committed transno 17179869951 00000004:00080000:3.0:1787826030.946598:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869929 committed transno 17179869951 00000004:00080000:3.0:1787826030.946608:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869930 committed transno 17179869951 00000004:00080000:3.0:1787826030.946618:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869931 committed transno 17179869951 00000004:00080000:3.0:1787826030.946629:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869932 committed transno 17179869951 00000004:00080000:3.0:1787826030.946639:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869933 committed transno 17179869951 00000004:00080000:3.0:1787826030.946650:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869934 committed transno 17179869951 00000004:00080000:3.0:1787826030.946661:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869935 committed transno 17179869951 00000004:00080000:3.0:1787826030.946670:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869936 committed transno 17179869951 00000004:00080000:3.0:1787826030.946692:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869937 committed transno 17179869951 00000004:00080000:3.0:1787826030.946702:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869938 committed transno 17179869951 00000004:00080000:3.0:1787826030.946710:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869939 committed transno 17179869951 00000004:00080000:3.0:1787826030.946730:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869940 committed transno 17179869951 00000004:00080000:3.0:1787826030.946742:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869941 committed transno 17179869951 00000004:00080000:3.0:1787826030.946751:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869942 committed transno 17179869951 00000004:00080000:3.0:1787826030.946760:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869943 committed transno 17179869951 00000004:00080000:3.0:1787826030.946772:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869944 committed transno 17179869951 00000004:00080000:3.0:1787826030.946781:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869945 committed transno 17179869951 00000004:00080000:3.0:1787826030.946790:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869946 committed transno 17179869951 00000004:00080000:3.0:1787826030.946799:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869947 committed transno 17179869951 00000004:00080000:3.0:1787826030.946810:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869948 committed transno 17179869951 00000004:00080000:3.0:1787826030.946819:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869949 committed transno 17179869951 00000004:00080000:3.0:1787826030.946828:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869950 committed transno 17179869951 00000004:00080000:3.0:1787826030.946850:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869951 committed transno 17179869951 00000100:00100000:3.0:1787826030.946872:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049222528:0@lo:41:osp-pre-1-0.0 00000020:00080000:0.0:1787826030.948613:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 330712484068 committed batchid 330712484044 00000020:00080000:0.0:1787826030.948728:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484044 00010000:00010000:3.0:1787826031.444515:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826032.472135:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826033.494576:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049222656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.494654:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.494702:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049223168:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.494730:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.494750:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049223680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.494771:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.494789:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049224192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.494810:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.494835:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826033.494842:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049223040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.494863:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.494879:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049223552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.494904:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.494919:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049224064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.494941:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.494966:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049222912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.494987:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.495004:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049223424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495024:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.495041:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049223936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495059:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.495074:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787826033.495079:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049222784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495098:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.495107:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049223296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495128:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.495142:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049223808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495159:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.495171:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049224320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826033.495190:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.495216:0:187895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049222656 00000100:00100000:0.0:1787826033.495222:0:187895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049222656 00000100:00100000:0.0:1787826033.495262:0:187895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787826033.495270:0:187895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049222656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495319:0:187895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049222656:12345-0@lo:400:kworker.0 Request processed in 49us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495348:0:187895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787826033.495383:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049223168 00000100:00100000:0.0:1787826033.495387:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049223168 00000100:00100000:0.0:1787826033.495415:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049223680 00000100:00100000:0.0:1787826033.495418:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049223680 00000100:00100000:0.0:1787826033.495429:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049224192 00000100:00100000:0.0:1787826033.495432:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049224192 00000100:00100000:0.0:1787826033.495442:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049223040 00000100:00100000:0.0:1787826033.495444:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049223040 00000100:00100000:0.0:1787826033.495454:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049222912 00000100:00100000:0.0:1787826033.495456:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049222912 00000100:00100000:0.0:1787826033.495466:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049222784 00000100:00100000:0.0:1787826033.495469:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049222784 00000100:00100000:0.0:1787826033.495483:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826033.495489:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049223168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495520:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049223168:12345-0@lo:400:kworker.0 Request processed in 31us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495526:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826033.495540:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787826033.495546:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049223680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495586:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049223680:12345-0@lo:400:kworker.0 Request processed in 40us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495592:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787826033.495605:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787826033.495612:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049224192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495642:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049224192:12345-0@lo:400:kworker.0 Request processed in 30us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495648:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787826033.495659:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787826033.495665:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049223040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495691:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049223040:12345-0@lo:400:kworker.0 Request processed in 27us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495697:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787826033.495708:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787826033.495714:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049222912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495745:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049222912:12345-0@lo:400:kworker.0 Request processed in 31us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495751:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787826033.495763:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787826033.495769:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049222784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495796:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049222784:12345-0@lo:400:kworker.0 Request processed in 27us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495802:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787826033.495832:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049223552 00000100:00100000:0.0:1787826033.495836:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049223552 00000100:00100000:0.0:1787826033.495860:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049224064 00000100:00100000:0.0:1787826033.495863:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049224064 00000100:00100000:0.0:1787826033.495878:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049223424 00000100:00100000:0.0:1787826033.495881:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049223424 00000100:00100000:0.0:1787826033.495895:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049223936 00000100:00100000:0.0:1787826033.495897:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049223936 00000100:00100000:0.0:1787826033.495912:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6912 00000100:00100000:0.0:1787826033.495918:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049223552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495947:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049223552:12345-0@lo:400:kworker.0 Request processed in 29us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495953:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6912 00000100:00100000:0.0:1787826033.495963:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6913 00000100:00100000:0.0:1787826033.495968:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049224064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.495992:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049224064:12345-0@lo:400:kworker.0 Request processed in 23us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.495997:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6913 00000100:00100000:0.0:1787826033.496008:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6914 00000100:00100000:0.0:1787826033.496013:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049223424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496036:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049223424:12345-0@lo:400:kworker.0 Request processed in 23us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.496041:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6914 00000100:00100000:0.0:1787826033.496052:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6915 00000100:00100000:0.0:1787826033.496058:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049223936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496083:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049223936:12345-0@lo:400:kworker.0 Request processed in 26us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.496088:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6915 00000100:00100000:0.0:1787826033.496105:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049224320 00000100:00100000:0.0:1787826033.496108:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049224320 00000100:00100000:0.0:1787826033.496129:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5691 00000100:00100000:0.0:1787826033.496135:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049224320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826033.496156:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826033.496185:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049224320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.496192:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5691 00000100:00080000:0.0:1787826033.496208:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826033.496212:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826033.496215:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826033.496217:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826033.496257:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049222784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496274:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049224320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826033.496284:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049222912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496293:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049223424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496302:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049223936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496359:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049223040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496369:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049223552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496378:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049224064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496387:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049222656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496396:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049223168:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496406:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049223680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.496415:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049224192:0@lo:400:kworker.0 00000100:00100000:1.0:1787826033.496611:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049224448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826033.496641:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.496671:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049224448 00000100:00100000:1.0:1787826033.496675:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049224448 00000100:00100000:1.0:1787826033.496699:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5692 00000100:00100000:1.0:1787826033.496705:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049224448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826033.496722:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826033.496756:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049224448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826033.496762:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5692 00000100:00100000:1.0:1787826033.496793:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049224448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826033.496979:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049224576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826033.497005:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826033.499439:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826033.505050:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049224576 00000100:00100000:0.0:1787826033.505064:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049224576 00000100:00100000:0.0:1787826033.505130:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5693 00000100:00100000:0.0:1787826033.505141:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049224576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826033.505169:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826033.505311:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826033.505341:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049224832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826033.505383:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.505419:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049224832 00000100:00100000:1.0:1787826033.505423:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049224832 00000100:00100000:1.0:1787826033.505442:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5694 00000100:00100000:1.0:1787826033.505449:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049224832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826033.505460:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826033.505492:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049224832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826033.505500:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5694 00000100:00100000:1.0:1787826033.505544:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049224832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826033.507913:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049223296 00000100:00100000:2.0:1787826033.507928:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049223296 00000100:00100000:2.0:1787826033.507980:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049223808 00000100:00100000:2.0:1787826033.507984:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049223808 00000100:00100000:2.0:1787826033.508010:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12560 00000100:00100000:2.0:1787826033.508019:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049223296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826033.508105:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049223296:12345-0@lo:400:kworker.0 Request processed in 87us (12975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826033.508113:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12560 00000100:00100000:2.0:1787826033.508131:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12561 00000100:00100000:2.0:1787826033.508138:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049223808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826033.508170:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049223808:12345-0@lo:400:kworker.0 Request processed in 33us (13009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826033.508176:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12561 00000100:00100000:2.0:1787826033.508218:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049224704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826033.508255:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826033.508289:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049224704 00000100:00100000:2.0:1787826033.508293:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049224704 00000100:00100000:2.0:1787826033.508312:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12562 00000100:00100000:2.0:1787826033.508319:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049224704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826033.508362:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00000100:00100000:2.0:1787826033.508398:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049224704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826033.508405:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12562 00000100:00100000:2.0:1787826033.508443:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049224704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826033.509594:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049224576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4450us (12583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.509606:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5693 00000100:00100000:0.0:1787826033.511959:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049223296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826033.511977:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049223808:0@lo:400:kworker.0 00000100:00100000:1.0:1787826033.512463:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049224576:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787826033.847587:0:189182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 73a: open(O_CREAT), unlink, replay, reconnect before open replay, close ========================================================== 06:20:32 (1787826032) 00000100:00100000:1.0:1787826033.926171:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826033.926220:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826033.926258:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826033.926280:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826033.926305:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826033.926367:0:187898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042950016 00000100:00100000:1.0:1787826033.926377:0:187898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042950016 00000100:00100000:1.0:1787826033.926424:0:187898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00100000:1.0:1787826033.926433:0:187898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2390:x1874663042950016:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826033.926500:0:187898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2390:x1874663042950016:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826033.926508:0:187898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00100000:1.0:1787826033.926543:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042950144 00000100:00100000:1.0:1787826033.926548:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042950144 00000100:00100000:1.0:1787826033.926595:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042950272 00000100:00100000:1.0:1787826033.926598:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042950272 00000100:00100000:1.0:1787826033.926620:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:1.0:1787826033.926626:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2390:x1874663042950144:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826033.926657:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2390:x1874663042950144:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 32us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826033.926663:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:1.0:1787826033.926676:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:1.0:1787826033.926682:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042950272:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826033.926703:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042950272:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 22us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826033.926709:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:1.0:1787826033.926727:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042950400 00000100:00100000:1.0:1787826033.926730:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042950400 00000100:00100000:1.0:1787826033.926752:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042950528 00000100:00100000:1.0:1787826033.926755:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042950528 00000100:00100000:1.0:1787826033.926773:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6916 00000100:00100000:1.0:1787826033.926778:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2390:x1874663042950400:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826033.926801:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2390:x1874663042950400:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826033.926807:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6916 00000100:00100000:1.0:1787826033.927012:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6917 00000100:00100000:1.0:1787826033.927019:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2390:x1874663042950528:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826033.927044:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2390:x1874663042950528:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826033.927053:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6917 00000100:00080000:1.0:1787826033.927072:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826033.927076:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826033.927078:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826033.927081:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826033.930890:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826033.931625:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042950784 00000100:00100000:2.0:1787826033.931638:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042950784 00000100:00100000:2.0:1787826033.931686:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 867 00000100:00100000:2.0:1787826033.931696:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156396:x1874663042950784:12345-192.168.203.47@tcp:101:multiop.0 00010000:00010000:2.0:1787826033.931715:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826033.931729:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787826033.931758:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429cac00/0x878a5eea00ce9626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6d18f expref: 9 pid: 187941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.931774:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb44972eb00) 00010000:00010000:2.0:1787826033.931783:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826033.931798:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cec979 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f075 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.931917:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.931930:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.931939:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.931949:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.931955:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.931960:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826033.932248:0:188992:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x1828:0x0], count =26 00000004:00080000:2.0:1787826033.932255:0:188992:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x1828:0x0]+26 in llog 00000004:00080000:2.0:1787826033.932268:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1842:0x0], index 0: 0 00010000:00010000:2.0:1787826033.932453:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec98e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932463:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec98e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932470:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec98e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932498:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932506:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932513:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932518:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826033.932522:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932529:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932538:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb46e062d00) 00010000:00010000:2.0:1787826033.932541:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826033.932545:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932551:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cec980 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826033.932561:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c9e30aa reply state 00000000a5678a2c transno 335007449219 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932580:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932586:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8eb46e062300) 00010000:00010000:2.0:1787826033.932588:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826033.932590:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826033.932615:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cec979 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f075 expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932630:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec98e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f075 expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826033.932638:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd0:0x0].0x0 (ffff8eb46e062800) 00010000:00010000:2.0:1787826033.932640:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826033.932643:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38c00, rc 0) 00000100:00100000:2.0:1787826033.932705:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:156396:x1874663042950784:12345-192.168.203.47@tcp:101:multiop.0 Request processed in 1010us (1825us total) trans 335007449219 rc 0/0 00000100:00100000:2.0:1787826033.932713:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 867 00000001:00080000:0.0:1787826033.936268:0:187875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449219 is committed 00000020:00080000:0.0:1787826033.936279:0:187875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 330712484068 batchid updated 00000020:00080000:0.0:1787826033.936320:0:187875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 330712484066 batchid updated 00010000:00010000:1.0:1787826033.936448:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826033.936459:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826033.936467:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826033.936474:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826033.936479:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826033.936486:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826033.936501:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8eb46e062300) 00010000:00010000:1.0:1787826033.936504:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826033.936509:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826033.936515:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cec987 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787826033.936718:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484068 00000004:00080000:3.0:1787826033.936772:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb45ec79c00 with version 770 00000020:00080000:3.0:1787826033.936787:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484045 cancel update log [0x240001f58:0x1:0x0].324: rc = 0 00000020:00080000:3.0:1787826033.936919:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484045 cancel update log [0x200026560:0x1:0x0].453: rc = 0 00000004:00080000:3.0:1787826033.936945:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb45ec79540 with version 771 00000020:00080000:3.0:1787826033.936948:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484046 cancel update log [0x240001f58:0x1:0x0].325: rc = 0 00000020:00080000:3.0:1787826033.936967:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484046 cancel update log [0x200026560:0x1:0x0].454: rc = 0 00000004:00080000:3.0:1787826033.936985:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4774c9e40 with version 772 00000020:00080000:3.0:1787826033.936988:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484047 cancel update log [0x240001f58:0x1:0x0].326: rc = 0 00000020:00080000:3.0:1787826033.937006:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484047 cancel update log [0x200026560:0x1:0x0].455: rc = 0 00000004:00080000:3.0:1787826033.937024:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4774c9a80 with version 773 00000020:00080000:3.0:1787826033.937027:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484048 cancel update log [0x240001f58:0x1:0x0].327: rc = 0 00000020:00080000:3.0:1787826033.937046:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484048 cancel update log [0x200026560:0x1:0x0].456: rc = 0 00000004:00080000:3.0:1787826033.937062:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4774c9840 with version 774 00000020:00080000:3.0:1787826033.937065:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484049 cancel update log [0x240001f58:0x1:0x0].328: rc = 0 00000020:00080000:3.0:1787826033.937081:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484049 cancel update log [0x200026560:0x1:0x0].457: rc = 0 00000004:00080000:3.0:1787826033.937097:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb4603483c0 with version 775 00000020:00080000:3.0:1787826033.937100:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484050 cancel update log [0x240001f58:0x1:0x0].329: rc = 0 00000020:00080000:3.0:1787826033.937114:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484050 cancel update log [0x200026560:0x1:0x0].458: rc = 0 00000004:00080000:3.0:1787826033.937128:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb442451180 with version 776 00000020:00080000:3.0:1787826033.937131:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484051 cancel update log [0x240001f58:0x1:0x0].330: rc = 0 00000020:00080000:3.0:1787826033.937144:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484051 cancel update log [0x200026560:0x1:0x0].459: rc = 0 00000004:00080000:3.0:1787826033.937160:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34c642000 with version 777 00000020:00080000:3.0:1787826033.937162:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484052 cancel update log [0x240001f58:0x1:0x0].331: rc = 0 00000020:00080000:3.0:1787826033.937177:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484052 cancel update log [0x200026560:0x1:0x0].460: rc = 0 00000004:00080000:3.0:1787826033.937195:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34c642480 with version 778 00000020:00080000:3.0:1787826033.937198:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484053 cancel update log [0x240001f58:0x1:0x0].332: rc = 0 00000020:00080000:3.0:1787826033.937214:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484053 cancel update log [0x200026560:0x1:0x0].461: rc = 0 00000004:00080000:3.0:1787826033.937231:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34c642600 with version 779 00000020:00080000:3.0:1787826033.937234:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484054 cancel update log [0x240001f58:0x1:0x0].333: rc = 0 00000020:00080000:3.0:1787826033.937253:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484054 cancel update log [0x200026560:0x1:0x0].462: rc = 0 00000004:00080000:3.0:1787826033.937269:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34c642e40 with version 780 00000020:00080000:3.0:1787826033.937271:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484055 cancel update log [0x240001f58:0x1:0x0].334: rc = 0 00000020:00080000:3.0:1787826033.937287:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484055 cancel update log [0x200026560:0x1:0x0].463: rc = 0 00000004:00080000:3.0:1787826033.937304:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb34240ef00 with version 781 00000020:00080000:3.0:1787826033.937306:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484056 cancel update log [0x240001f58:0x1:0x0].335: rc = 0 00000004:00080000:0.0:1787826033.937413:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 770 rpc_version 770 00000020:00100000:0.0:1787826033.937446:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826033.937456:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb342776a00 x1874663049225088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826033.937478:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342776a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049225088:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826033.937542:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787826033.937619:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484056 cancel update log [0x200026560:0x1:0x0].464: rc = 0 00000004:00080000:3.0:1787826033.937645:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a3c0 with version 782 00000020:00080000:3.0:1787826033.937649:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484057 cancel update log [0x240001f58:0x1:0x0].336: rc = 0 00000020:00080000:3.0:1787826033.937671:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484057 cancel update log [0x200026560:0x1:0x0].465: rc = 0 00000004:00080000:3.0:1787826033.937689:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38ad80 with version 783 00000020:00080000:3.0:1787826033.937691:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484058 cancel update log [0x240001f58:0x1:0x0].338: rc = 0 00000020:00080000:3.0:1787826033.937709:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484058 cancel update log [0x200026560:0x1:0x0].466: rc = 0 00000004:00080000:3.0:1787826033.937732:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38aa80 with version 784 00000020:00080000:3.0:1787826033.937734:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484059 cancel update log [0x240001f58:0x1:0x0].339: rc = 0 00000020:00080000:3.0:1787826033.937750:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484059 cancel update log [0x200026560:0x1:0x0].467: rc = 0 00000004:00080000:3.0:1787826033.937765:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a600 with version 785 00000020:00080000:3.0:1787826033.937767:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484060 cancel update log [0x240001f58:0x1:0x0].340: rc = 0 00000020:00080000:3.0:1787826033.937782:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484060 cancel update log [0x200026560:0x1:0x0].468: rc = 0 00000004:00080000:3.0:1787826033.937800:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a240 with version 786 00000020:00080000:3.0:1787826033.937802:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484061 cancel update log [0x240001f58:0x1:0x0].341: rc = 0 00000020:00080000:3.0:1787826033.937834:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484061 cancel update log [0x200026560:0x1:0x0].469: rc = 0 00000004:00080000:3.0:1787826033.937854:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb46e38a480 with version 787 00000020:00080000:3.0:1787826033.937857:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484062 cancel update log [0x240001f58:0x1:0x0].342: rc = 0 00000020:00080000:3.0:1787826033.937875:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484062 cancel update log [0x200026560:0x1:0x0].470: rc = 0 00000004:00080000:3.0:1787826033.937893:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e600 with version 788 00000020:00080000:3.0:1787826033.937896:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484063 cancel update log [0x240001f58:0x1:0x0].343: rc = 0 00000020:00080000:3.0:1787826033.937913:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484063 cancel update log [0x200026560:0x1:0x0].471: rc = 0 00000004:00080000:3.0:1787826033.937930:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62ec00 with version 789 00000020:00080000:3.0:1787826033.937932:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484064 cancel update log [0x240001f58:0x1:0x0].344: rc = 0 00000020:00080000:3.0:1787826033.937949:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484064 cancel update log [0x200026560:0x1:0x0].473: rc = 0 00000004:00080000:3.0:1787826033.937964:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e900 with version 790 00000020:00080000:3.0:1787826033.937966:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484065 cancel update log [0x240001f58:0x1:0x0].345: rc = 0 00000020:00080000:3.0:1787826033.937982:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484065 cancel update log [0x200026560:0x1:0x0].474: rc = 0 00000004:00080000:3.0:1787826033.937997:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e180 with version 791 00000020:00080000:3.0:1787826033.937999:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484066 cancel update log [0x240001f58:0x1:0x0].346: rc = 0 00000020:00080000:3.0:1787826033.938016:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484066 cancel update log [0x200026560:0x1:0x0].475: rc = 0 00000004:00080000:3.0:1787826033.938033:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e540 with version 792 00000020:00080000:3.0:1787826033.938036:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484067 cancel update log [0x240001f58:0x1:0x0].347: rc = 0 00000020:00080000:3.0:1787826033.938054:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484067 cancel update log [0x200026560:0x1:0x0].476: rc = 0 00000004:00080000:3.0:1787826033.938072:0:187938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47a62e9c0 with version 793 00000020:00080000:3.0:1787826033.938075:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 330712484068 cancel update log [0x240001f58:0x1:0x0].348: rc = 0 00000020:00080000:3.0:1787826033.938094:0:187938:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 330712484068 cancel update log [0x200026560:0x1:0x0].477: rc = 0 00000020:00080000:3.0:1787826033.938100:0:187938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484068 00000100:00100000:0.0:1787826033.938222:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.940655:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049225088 00000100:00100000:1.0:1787826033.940668:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049225088 00000100:00100000:1.0:1787826033.940749:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12563 00000100:00100000:1.0:1787826033.940759:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187924:x1874663049225088:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.940949:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049225088:12345-0@lo:1000:osp_up1-0.0 Request processed in 192us (3407us total) trans 17179869952 rc 0/0 00000100:00100000:1.0:1787826033.940957:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12563 00000100:00100000:0.0:1787826033.941042:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342776a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049225088:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826033.941057:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 771 rpc_version 771 00000020:00100000:0.0:1787826033.941078:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826033.941084:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb342776680 x1874663049225344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826033.941105:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342776680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049225344:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826033.941141:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.944411:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.944550:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049225344 00000100:00100000:2.0:1787826033.944559:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049225344 00000100:00100000:2.0:1787826033.944618:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12564 00000100:00100000:2.0:1787826033.944628:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187924:x1874663049225344:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.944795:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049225344:12345-0@lo:1000:osp_up1-0.0 Request processed in 169us (3653us total) trans 17179869953 rc 0/0 00000100:00100000:2.0:1787826033.944803:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12564 00000100:00100000:2.0:1787826033.944875:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342776680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049225344:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826033.944887:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 772 rpc_version 772 00000020:00100000:2.0:1787826033.944909:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826033.944917:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4815e2d80 x1874663049225600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826033.944936:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049225600:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.944971:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826033.944987:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb342682f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.944999:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049225600 00000100:00100000:2.0:1787826033.945002:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049225600 00000100:00100000:2.0:1787826033.945019:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12565 00000100:00100000:2.0:1787826033.945025:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187924:x1874663049225600:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945092:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187924:x1874663049225600:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (121us total) trans 17179869954 rc 0/0 00000100:00100000:2.0:1787826033.945099:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12565 00000100:00100000:2.0:1787826033.945127:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049225600:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826033.945134:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 773 rpc_version 773 00000020:00100000:2.0:1787826033.945146:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826033.945150:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4815e0e00 x1874663049225856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826033.945162:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049225856:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945185:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826033.945198:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4770c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.945208:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049225856 00000100:00100000:2.0:1787826033.945212:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049225856 00000100:00100000:2.0:1787826033.945228:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12566 00000100:00100000:2.0:1787826033.945234:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187924:x1874663049225856:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945298:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187924:x1874663049225856:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (112us total) trans 17179869955 rc 0/0 00000100:00100000:2.0:1787826033.945305:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12566 00000100:00100000:2.0:1787826033.945355:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049225856:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826033.945362:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 774 rpc_version 774 00000020:00100000:2.0:1787826033.945372:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826033.945378:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb4815e2300 x1874663049226112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826033.945389:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049226112:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945410:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826033.945423:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4770c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.945433:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049226112 00000100:00100000:2.0:1787826033.945436:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049226112 00000100:00100000:2.0:1787826033.945454:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12567 00000100:00100000:2.0:1787826033.945460:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187924:x1874663049226112:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945521:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187924:x1874663049226112:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (109us total) trans 17179869956 rc 0/0 00000100:00100000:2.0:1787826033.945528:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12567 00000100:00100000:2.0:1787826033.945554:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049226112:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826033.945560:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 775 rpc_version 775 00000020:00100000:2.0:1787826033.945582:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826033.945587:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f6c1500 x1874663049226368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826033.945599:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049226368:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945623:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826033.945636:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4770c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.945646:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049226368 00000100:00100000:2.0:1787826033.945649:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049226368 00000100:00100000:2.0:1787826033.945666:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12568 00000100:00100000:2.0:1787826033.945671:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187924:x1874663049226368:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945745:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187924:x1874663049226368:12345-0@lo:1000:osp_up1-0.0 Request processed in 73us (121us total) trans 17179869957 rc 0/0 00000100:00100000:2.0:1787826033.945755:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12568 00000100:00100000:2.0:1787826033.945783:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049226368:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826033.945790:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 776 rpc_version 776 00000020:00100000:2.0:1787826033.945800:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826033.945809:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f6c3800 x1874663049226624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826033.945822:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049226624:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945846:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826033.945859:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4770c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.945870:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049226624 00000100:00100000:2.0:1787826033.945873:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049226624 00000100:00100000:2.0:1787826033.945888:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12569 00000100:00100000:2.0:1787826033.945894:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187924:x1874663049226624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.945957:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187924:x1874663049226624:12345-0@lo:1000:osp_up1-0.0 Request processed in 63us (110us total) trans 17179869958 rc 0/0 00000100:00100000:2.0:1787826033.945964:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12569 00000100:00100000:2.0:1787826033.945991:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049226624:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826033.945998:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 777 rpc_version 777 00000020:00100000:2.0:1787826033.946008:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826033.946012:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f6c2d80 x1874663049226880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826033.946024:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049226880:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.946046:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826033.946058:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4770c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.946070:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049226880 00000100:00100000:2.0:1787826033.946073:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049226880 00000100:00100000:2.0:1787826033.946089:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12570 00000100:00100000:2.0:1787826033.946094:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187924:x1874663049226880:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.946156:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187924:x1874663049226880:12345-0@lo:1000:osp_up1-0.0 Request processed in 60us (108us total) trans 17179869959 rc 0/0 00000100:00100000:2.0:1787826033.946162:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12570 00000100:00100000:2.0:1787826033.946191:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049226880:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826033.946197:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 778 rpc_version 778 00000020:00100000:2.0:1787826033.946206:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826033.946211:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb44f6c0000 x1874663049227136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826033.946222:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049227136:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.946246:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826033.946259:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4770c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.946269:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049227136 00000100:00100000:2.0:1787826033.946272:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049227136 00000100:00100000:2.0:1787826033.946842:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12571 00000100:00100000:2.0:1787826033.946850:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187924:x1874663049227136:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.947024:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187924:x1874663049227136:12345-0@lo:1000:osp_up1-0.0 Request processed in 174us (775us total) trans 17179869960 rc 0/0 00000100:00100000:2.0:1787826033.947030:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12571 00000100:00100000:0.0:1787826033.947142:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049227136:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826033.947153:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 779 rpc_version 779 00000020:00100000:0.0:1787826033.947168:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826033.947173:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb342774700 x1874663049227392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826033.947187:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049227392:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826033.947215:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826033.947271:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826033.947304:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049227392 00000100:00100000:2.0:1787826033.947309:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049227392 00000100:00100000:2.0:1787826033.947486:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12572 00000100:00100000:2.0:1787826033.947494:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187924:x1874663049227392:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826033.947596:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049227392:12345-0@lo:1000:osp_up1-0.0 Request processed in 102us (379us total) trans 17179869961 rc 0/0 00000100:00100000:2.0:1787826033.947602:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12572 00000100:00100000:1.0:1787826033.947664:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049227392:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.947671:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 780 rpc_version 780 00000020:00100000:1.0:1787826033.947683:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.947688:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34dde0e00 x1874663049227648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.947701:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049227648:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.947728:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.947751:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826033.947804:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049227648 00000100:00100000:3.0:1787826033.947809:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049227648 00000100:00100000:3.0:1787826033.947840:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12573 00000100:00100000:3.0:1787826033.947847:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187924:x1874663049227648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826033.947921:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187924:x1874663049227648:12345-0@lo:1000:osp_up1-0.0 Request processed in 74us (192us total) trans 17179869962 rc 0/0 00000100:00100000:3.0:1787826033.947928:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12573 00000100:00100000:1.0:1787826033.948173:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049227648:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.948181:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 781 rpc_version 781 00000020:00100000:1.0:1787826033.948192:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.948197:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34dde2680 x1874663049227904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.948210:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049227904:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.948237:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.948257:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826033.948522:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049227904 00000100:00100000:3.0:1787826033.948527:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049227904 00000100:00100000:3.0:1787826033.948631:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12574 00000100:00100000:3.0:1787826033.948639:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187924:x1874663049227904:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826033.948724:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187924:x1874663049227904:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (486us total) trans 17179869963 rc 0/0 00000100:00100000:3.0:1787826033.948732:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12574 00000100:00100000:1.0:1787826033.948780:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049227904:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.948788:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 782 rpc_version 782 00000020:00100000:1.0:1787826033.948799:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.948804:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb45eb72a00 x1874663049228160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.948816:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb45eb72a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049228160:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.948840:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.948854:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.948865:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049228160 00000100:00100000:1.0:1787826033.948868:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049228160 00000100:00100000:1.0:1787826033.948886:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12575 00000100:00100000:1.0:1787826033.948892:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187924:x1874663049228160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.948960:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187924:x1874663049228160:12345-0@lo:1000:osp_up1-0.0 Request processed in 68us (119us total) trans 17179869964 rc 0/0 00000100:00100000:1.0:1787826033.948967:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12575 00000100:00100000:1.0:1787826033.948999:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb45eb72a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049228160:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.949005:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 783 rpc_version 783 00000020:00100000:1.0:1787826033.949015:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.949020:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb343e55c00 x1874663049228416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.949031:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049228416:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949054:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.949067:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.949078:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049228416 00000100:00100000:1.0:1787826033.949081:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049228416 00000100:00100000:1.0:1787826033.949097:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12576 00000100:00100000:1.0:1787826033.949103:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187924:x1874663049228416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949168:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187924:x1874663049228416:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (113us total) trans 17179869965 rc 0/0 00000100:00100000:1.0:1787826033.949175:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12576 00000100:00100000:1.0:1787826033.949205:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049228416:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.949212:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 784 rpc_version 784 00000020:00100000:1.0:1787826033.949222:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.949226:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb343e54a80 x1874663049228672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.949238:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049228672:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949263:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.949276:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.949285:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049228672 00000100:00100000:1.0:1787826033.949289:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049228672 00000100:00100000:1.0:1787826033.949304:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12577 00000100:00100000:1.0:1787826033.949310:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187924:x1874663049228672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949395:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187924:x1874663049228672:12345-0@lo:1000:osp_up1-0.0 Request processed in 85us (131us total) trans 17179869966 rc 0/0 00000100:00100000:1.0:1787826033.949402:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12577 00000100:00100000:1.0:1787826033.949428:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049228672:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.949434:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 785 rpc_version 785 00000020:00100000:1.0:1787826033.949444:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.949448:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df14380 x1874663049228928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.949459:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df14380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049228928:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949482:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.949496:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.949505:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049228928 00000100:00100000:1.0:1787826033.949509:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049228928 00000100:00100000:1.0:1787826033.949524:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12578 00000100:00100000:1.0:1787826033.949531:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187924:x1874663049228928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949612:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187924:x1874663049228928:12345-0@lo:1000:osp_up1-0.0 Request processed in 81us (129us total) trans 17179869967 rc 0/0 00000100:00100000:1.0:1787826033.949618:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12578 00000100:00100000:1.0:1787826033.949644:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df14380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049228928:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.949650:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 786 rpc_version 786 00000020:00100000:1.0:1787826033.949660:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.949665:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df14e00 x1874663049229184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.949675:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df14e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049229184:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949696:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.949709:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.949719:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049229184 00000100:00100000:1.0:1787826033.949723:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049229184 00000100:00100000:1.0:1787826033.949740:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12579 00000100:00100000:1.0:1787826033.949746:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187924:x1874663049229184:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949809:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187924:x1874663049229184:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (111us total) trans 17179869968 rc 0/0 00000100:00100000:1.0:1787826033.949815:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12579 00000100:00100000:1.0:1787826033.949845:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df14e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049229184:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.949851:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 787 rpc_version 787 00000020:00100000:1.0:1787826033.949861:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.949865:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df14700 x1874663049229440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.949876:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df14700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049229440:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.949899:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.949912:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.949922:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049229440 00000100:00100000:1.0:1787826033.949926:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049229440 00000100:00100000:1.0:1787826033.949941:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12580 00000100:00100000:1.0:1787826033.949946:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187924:x1874663049229440:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950008:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187924:x1874663049229440:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (108us total) trans 17179869969 rc 0/0 00000100:00100000:1.0:1787826033.950015:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12580 00000100:00100000:1.0:1787826033.950044:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df14700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049229440:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.950050:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 788 rpc_version 788 00000020:00100000:1.0:1787826033.950059:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.950064:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34df17800 x1874663049229696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.950074:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049229696:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950097:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.950109:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.950119:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049229696 00000100:00100000:1.0:1787826033.950122:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049229696 00000100:00100000:1.0:1787826033.950138:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12581 00000100:00100000:1.0:1787826033.950143:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187924:x1874663049229696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950211:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187924:x1874663049229696:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (113us total) trans 17179869970 rc 0/0 00000100:00100000:1.0:1787826033.950217:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12581 00000100:00100000:1.0:1787826033.950244:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049229696:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.950251:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 789 rpc_version 789 00000020:00100000:1.0:1787826033.950262:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.950267:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a1ff480 x1874663049229952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.950278:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ff480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049229952:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950301:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.950314:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.950457:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049229952 00000100:00100000:1.0:1787826033.950461:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049229952 00000100:00100000:1.0:1787826033.950479:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12582 00000100:00100000:1.0:1787826033.950484:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187924:x1874663049229952:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950547:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187924:x1874663049229952:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (244us total) trans 17179869971 rc 0/0 00000100:00100000:1.0:1787826033.950553:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12582 00000100:00100000:1.0:1787826033.950592:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ff480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049229952:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.950599:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 790 rpc_version 790 00000020:00100000:1.0:1787826033.950609:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.950613:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a1fca80 x1874663049230208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.950624:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049230208:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950647:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.950660:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.950669:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049230208 00000100:00100000:1.0:1787826033.950672:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049230208 00000100:00100000:1.0:1787826033.950687:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12583 00000100:00100000:1.0:1787826033.950692:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187924:x1874663049230208:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950755:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187924:x1874663049230208:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (107us total) trans 17179869972 rc 0/0 00000100:00100000:1.0:1787826033.950761:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12583 00000100:00100000:1.0:1787826033.950788:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049230208:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.950794:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 791 rpc_version 791 00000020:00100000:1.0:1787826033.950804:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.950808:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a1ffb80 x1874663049230464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.950820:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ffb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049230464:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950843:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.950857:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.950867:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049230464 00000100:00100000:1.0:1787826033.950870:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049230464 00000100:00100000:1.0:1787826033.950886:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12584 00000100:00100000:1.0:1787826033.950891:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187924:x1874663049230464:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.950951:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187924:x1874663049230464:12345-0@lo:1000:osp_up1-0.0 Request processed in 59us (106us total) trans 17179869973 rc 0/0 00000100:00100000:1.0:1787826033.950957:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12584 00000100:00100000:1.0:1787826033.950984:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ffb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049230464:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.950992:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 792 rpc_version 792 00000020:00100000:1.0:1787826033.951001:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.951006:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a1fed80 x1874663049230720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.951016:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049230720:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.951039:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.951052:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.951063:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049230720 00000100:00100000:1.0:1787826033.951067:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049230720 00000100:00100000:1.0:1787826033.951085:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12585 00000100:00100000:1.0:1787826033.951090:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187924:x1874663049230720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.951151:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187924:x1874663049230720:12345-0@lo:1000:osp_up1-0.0 Request processed in 60us (111us total) trans 17179869974 rc 0/0 00000100:00100000:1.0:1787826033.951157:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12585 00000100:00100000:1.0:1787826033.951187:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049230720:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826033.951193:0:187924:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb4491e2c00 version 793 rpc_version 793 00000020:00100000:1.0:1787826033.951204:0:187924:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826033.951208:0:187924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47a1fea00 x1874663049230976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826033.951219:0:187924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049230976:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.951242:0:187924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826033.951254:0:187924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826033.951264:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049230976 00000100:00100000:1.0:1787826033.951268:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049230976 00000100:00100000:1.0:1787826033.951285:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12586 00000100:00100000:1.0:1787826033.951290:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187924:x1874663049230976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826033.954738:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187924:x1874663049230976:12345-0@lo:1000:osp_up1-0.0 Request processed in 3437us (3485us total) trans 17179869975 rc 0/0 00000100:00100000:1.0:1787826033.954753:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12586 00000100:00100000:1.0:1787826033.954833:0:187924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187924:1874663049230976:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826033.974693:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826033.974729:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042950912 00000100:00100000:0.0:1787826033.974738:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042950912 00000100:00100000:0.0:1787826033.974785:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 868 00000100:00100000:0.0:1787826033.974795:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156398:x1874663042950912:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826033.974818:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826033.974841:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec99c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f07c expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826033.974902:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec9a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826033.974916:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826033.974928:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826033.974980:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787826033.974984:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826033.975002:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826033.975029:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec99c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f07c expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826033.975043:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f07c expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826033.975051:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb480de3b00) 00010000:00010000:0.0:1787826033.975054:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826033.975057:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ede00, rc 0) 00000100:00100000:0.0:1787826033.975108:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:156398:x1874663042950912:12345-192.168.203.47@tcp:101:rm.0 Request processed in 314us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826033.975115:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 868 00000100:00100000:2.0:1787826033.980507:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826033.981016:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042951040 00000100:00100000:3.0:1787826033.981026:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042951040 00000100:00100000:3.0:1787826033.981085:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22530 00000100:00100000:3.0:1787826033.981095:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042951040:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826033.981112:0:179226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826033.981130:0:179226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f083 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826033.981153:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1842:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826033.981173:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1842:0x0].0x0 since=8100s v=(0 0) 00010000:00010000:3.0:1787826033.981178:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826033.981188:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826033.981214:0:179226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826033.981228:0:179226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19000, rc 0) 00000100:00100000:3.0:1787826033.981286:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042951040:12345-192.168.203.47@tcp:101:rm.0 Request processed in 192us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826033.981293:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22530 00000100:00100000:0.0:1787826034.001804:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826034.002376:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042951296 00000100:00100000:0.0:1787826034.002386:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042951296 00000100:00100000:0.0:1787826034.002440:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 869 00000100:00100000:0.0:1787826034.002450:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:156398:x1874663042951296:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826034.002503:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787826034.002531:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00cec98e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f075 expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002548:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd0:0x0].0x0 (ffff8eb46e062800) 00010000:00010000:0.0:1787826034.002574:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ede00/0x878a5eea00cec9a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f07c expref: 9 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002585:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb480de3b00) 00010000:00010000:0.0:1787826034.002593:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826034.002617:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002629:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002638:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002648:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002655:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002660:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002747:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002756:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.002762:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826034.002965:0:187905:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x20001a9e3:0x1bd0:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1787826034.003042:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003050:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003058:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003064:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826034.003068:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003075:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003084:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd0:0x0].0x0 (ffff8eb480de3a00) 00010000:00010000:0.0:1787826034.003087:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826034.003091:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003096:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cec9bf lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003110:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003116:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003122:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003126:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eca00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826034.003129:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003138:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003144:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb480de3300) 00010000:00010000:0.0:1787826034.003147:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826034.003149:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003154:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eca00/0x878a5eea00cec9b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826034.003164:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047b6238b reply state 00000000ef7b4a07 transno 335007449220 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003174:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.003181:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8eb480de3800) 00010000:00010000:0.0:1787826034.003183:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826034.003185:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826034.003260:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:156398:x1874663042951296:12345-192.168.203.47@tcp:36:rm.0 Request processed in 810us (1465us total) trans 335007449220 rc 0/0 00000100:00100000:0.0:1787826034.003268:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 869 00010000:00010000:3.0:1787826034.527545:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787826034.880086:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869975 is committed 00000001:00080000:3.0:1787826034.885441:0:187875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449220 is committed 00010000:00010000:0.0:1787826034.886159:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.886173:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.886185:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.886192:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724edc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826034.886196:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.886204:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.886221:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8eb480de3800) 00010000:00010000:0.0:1787826034.886224:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826034.886228:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.886233:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826034.981165:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826034.988316:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042951424 00000100:00100000:0.0:1787826034.988441:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042951424 00000100:00100000:0.0:1787826034.988509:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 870 00000100:00100000:0.0:1787826034.988521:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+8:156407:x1874663042951424:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826034.988550:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826034.988587:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f08a expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.988937:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec9cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.988956:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.988967:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826034.989012:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787826034.989015:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826034.989034:0:188682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.989058:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cec9c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f08a expref: 10 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.989076:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec9cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f08a expref: 9 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826034.989084:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb480de3800) 00010000:00010000:0.0:1787826034.989087:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826034.989090:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed800, rc 0) 00000100:00100000:0.0:1787826034.989164:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156407:x1874663042951424:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 645us (8010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826034.989172:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 870 00000100:00100000:2.0:1787826034.994530:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826034.994685:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042951552 00000100:00100000:0.0:1787826034.994697:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042951552 00000100:00100000:0.0:1787826034.994768:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 871 00000100:00100000:0.0:1787826034.994778:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156407:x1874663042951552:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826034.994819:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00000100:00100000:0.0:1787826034.994886:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156407:x1874663042951552:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 109us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826034.994894:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 871 00000100:00100000:3.0:1787826035.009705:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826035.009890:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042951680 00000100:00100000:2.0:1787826035.009900:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042951680 00000100:00100000:2.0:1787826035.009974:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 872 00000100:00100000:2.0:1787826035.009985:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156407:x1874663042951680:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826035.010024:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445466112 avail 1299226624 00000100:00100000:2.0:1787826035.010092:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156407:x1874663042951680:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 109us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826035.010100:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 872 00000100:00080000:3.0:1787826035.010736:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826035.014511:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826035.014600:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042951808 00000100:00100000:3.0:1787826035.014669:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042951808 00000100:00100000:3.0:1787826035.014732:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5695 00000100:00100000:3.0:1787826035.014743:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156407:x1874663042951808:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826035.014860:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826035.014923:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156407:x1874663042951808:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 182us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826035.014931:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5695 00000100:00080000:1.0:1787826035.015603:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826035.020993:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826035.021086:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042951936 00000100:00100000:1.0:1787826035.021097:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042951936 00000100:00100000:1.0:1787826035.021174:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5696 00000100:00100000:1.0:1787826035.021195:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:156407:x1874663042951936:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:1.0:1787826035.021224:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826035.021290:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:156407:x1874663042951936:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 97us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826035.021297:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5696 00000100:00080000:3.0:1787826035.021691:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826035.187144:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826035.187193:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042952192 00000100:00100000:0.0:1787826035.187203:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042952192 00000100:00100000:0.0:1787826035.187268:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 873 00000100:00100000:0.0:1787826035.187278:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156414:x1874663042952192:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00010000:0.0:1787826035.187347:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826035.187392:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cec9cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f08a expref: 9 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.187409:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb480de3800) 00010000:00010000:0.0:1787826035.187420:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826035.187492:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.187505:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.187515:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.187527:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.187534:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.187544:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188139:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188149:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188155:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188161:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826035.188165:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188172:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188240:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb480de3000) 00010000:00010000:0.0:1787826035.188244:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826035.188247:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188253:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cec9d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826035.188267:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001eeb5485 reply state 0000000035af2ace transno 335007449221 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188277:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826035.188283:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3200) 00010000:00010000:0.0:1787826035.188285:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826035.188287:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826035.188469:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:156414:x1874663042952192:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 1190us (1328us total) trans 335007449221 rc 0/0 00000100:00100000:0.0:1787826035.188476:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 873 00000100:00080000:0.0:1787826035.188505:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826035.212671:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826035.212788:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042952320 00000100:00100000:3.0:1787826035.212798:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042952320 00000100:00100000:3.0:1787826035.212857:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 874 00000100:00100000:3.0:1787826035.212869:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:156417:x1874663042952320:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826035.212892:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826035.212915:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec9e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f091 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.212980:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec9e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.212993:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.213005:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826035.213059:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787826035.213064:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826035.213091:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.213116:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cec9e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f091 expref: 12 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.213133:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f091 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.213141:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb476e51200) 00010000:00010000:3.0:1787826035.213144:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826035.213148:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18600, rc 0) 00000100:00100000:3.0:1787826035.213216:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:156417:x1874663042952320:12345-192.168.203.47@tcp:101:rm.0 Request processed in 349us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826035.213222:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 874 00000100:00100000:2.0:1787826035.217364:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826035.218288:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042952448 00000100:00100000:3.0:1787826035.218300:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042952448 00000100:00100000:3.0:1787826035.218394:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 875 00000100:00100000:3.0:1787826035.218405:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:156417:x1874663042952448:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826035.218425:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826035.218445:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec9f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f098 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218507:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218521:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218532:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218544:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218552:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218567:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218669:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00ceca05 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218678:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00ceca05 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218684:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00ceca05 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826035.218729:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bd1:0x0]: returning size 0 00000004:00200000:3.0:1787826035.218733:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826035.218749:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00ceca05 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218761:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00ceca05 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218768:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218774:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218781:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218786:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826035.218789:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218797:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218808:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb476e51200) 00010000:00010000:3.0:1787826035.218812:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826035.218816:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218822:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cec9f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218839:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218845:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218851:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218856:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826035.218858:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218864:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218870:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3200) 00010000:00010000:3.0:1787826035.218872:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826035.218875:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218880:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cec9fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218903:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19c00/0x878a5eea00cec9f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f098 expref: 13 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218916:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00ceca05 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f098 expref: 12 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.218927:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd1:0x0].0x0 (ffff8eb476e51100) 00010000:00010000:3.0:1787826035.218929:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826035.218931:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19400, rc 0) 00000100:00100000:3.0:1787826035.218990:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:156417:x1874663042952448:12345-192.168.203.47@tcp:101:rm.0 Request processed in 587us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826035.218997:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 875 00000100:00100000:2.0:1787826035.238311:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826035.238733:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042952704 00000100:00100000:1.0:1787826035.238745:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042952704 00000100:00100000:1.0:1787826035.238801:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 876 00000100:00100000:1.0:1787826035.238812:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:156417:x1874663042952704:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:1.0:1787826035.238864:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787826035.238892:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00ceca05 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f098 expref: 12 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.238911:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd1:0x0].0x0 (ffff8eb476e51100) 00010000:00010000:1.0:1787826035.238927:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18600/0x878a5eea00cec9e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f091 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.238936:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb476e51200) 00010000:00010000:1.0:1787826035.238942:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826035.238965:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.238978:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.238992:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.239004:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.239012:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.239019:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.239119:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.239128:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.239134:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240047:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240059:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240068:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240076:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240084:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240091:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240112:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826035.240131:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240138:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240144:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240151:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ec00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826035.240156:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240164:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240174:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd1:0x0].0x0 (ffff8eb4820dd000) 00010000:00010000:1.0:1787826035.240177:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826035.240194:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240200:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceca1a lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240221:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240227:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240232:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240237:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826035.240240:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240245:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240253:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb4820dd600) 00010000:00010000:1.0:1787826035.240255:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826035.240258:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240264:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f400/0x878a5eea00ceca0c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826035.240278:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db5ed6d4 reply state 00000000c87f20f1 transno 335007449222 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240289:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826035.240296:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3200) 00010000:00010000:1.0:1787826035.240298:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826035.240301:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826035.240646:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826035.240654:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.240661:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826035.240664:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.240672:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.240681:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd1:0x0].0x0 (ffff8eb4820dd000) 00010000:00010000:3.0:1787826035.240684:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826035.240687:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.240693:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e600/0x878a5eea00ceca21 lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826035.240706:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826035.240708:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826035.240710:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826035.240878:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:156417:x1874663042952704:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2063us (2572us total) trans 335007449222 rc 0/0 00000100:00100000:1.0:1787826035.240887:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 876 00010000:00010000:3.0:1787826035.540915:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826036.055280:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049231104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826036.055361:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826036.055445:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049231104 00000100:00100000:2.0:1787826036.055453:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049231104 00000100:00100000:2.0:1787826036.055508:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12587 00000100:00100000:2.0:1787826036.055518:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049231104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826036.055568:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445466112 avail 1299226624 00000100:00100000:2.0:1787826036.055614:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049231104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826036.055621:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12587 00000100:00100000:2.0:1787826036.055658:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869975 gen 2 00000004:00080000:2.0:1787826036.055664:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869952 committed transno 17179869975 00000004:00080000:2.0:1787826036.055681:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869953 committed transno 17179869975 00000004:00080000:2.0:1787826036.055689:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869954 committed transno 17179869975 00000004:00080000:2.0:1787826036.055696:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869955 committed transno 17179869975 00000004:00080000:2.0:1787826036.055707:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869956 committed transno 17179869975 00000004:00080000:2.0:1787826036.055713:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869957 committed transno 17179869975 00000004:00080000:2.0:1787826036.055722:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869958 committed transno 17179869975 00000004:00080000:2.0:1787826036.055729:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869959 committed transno 17179869975 00000004:00080000:2.0:1787826036.055737:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869960 committed transno 17179869975 00000004:00080000:2.0:1787826036.055745:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869961 committed transno 17179869975 00000004:00080000:2.0:1787826036.055763:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869962 committed transno 17179869975 00000004:00080000:2.0:1787826036.055775:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869963 committed transno 17179869975 00000004:00080000:2.0:1787826036.055782:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869964 committed transno 17179869975 00000004:00080000:2.0:1787826036.055789:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869965 committed transno 17179869975 00000004:00080000:2.0:1787826036.055795:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869966 committed transno 17179869975 00000004:00080000:2.0:1787826036.055802:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869967 committed transno 17179869975 00000004:00080000:2.0:1787826036.055810:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869968 committed transno 17179869975 00000004:00080000:2.0:1787826036.055818:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869969 committed transno 17179869975 00000004:00080000:2.0:1787826036.055826:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869970 committed transno 17179869975 00000004:00080000:2.0:1787826036.055832:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869971 committed transno 17179869975 00000004:00080000:2.0:1787826036.055839:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869972 committed transno 17179869975 00000004:00080000:2.0:1787826036.055846:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869973 committed transno 17179869975 00000004:00080000:2.0:1787826036.055853:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869974 committed transno 17179869975 00000004:00080000:2.0:1787826036.055859:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869975 committed transno 17179869975 00000100:00100000:2.0:1787826036.055874:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049231104:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826036.564489:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826037.588469:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826038.612839:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049231232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826038.612912:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826038.612974:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826038.612980:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049231360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826038.613005:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826038.613036:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049231232 00000100:00100000:1.0:1787826038.613043:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049231232 00000100:00100000:1.0:1787826038.613093:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049231360 00000100:00100000:1.0:1787826038.613096:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049231360 00000100:00100000:1.0:1787826038.613117:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5697 00000100:00100000:1.0:1787826038.613127:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049231232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826038.613155:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826038.613196:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049231232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826038.613203:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5697 00000100:00100000:1.0:1787826038.613221:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5698 00000100:00100000:1.0:1787826038.613228:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049231360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826038.613243:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826038.613271:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049231360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826038.613276:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5698 00000100:00080000:1.0:1787826038.613292:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826038.613296:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826038.613356:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049231360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826038.613371:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049231232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826038.613851:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049231488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826038.613886:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826038.613918:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826038.613926:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049231488 00000100:00100000:3.0:1787826038.613930:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049231488 00000100:00100000:3.0:1787826038.613961:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5699 00000100:00100000:3.0:1787826038.613968:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049231488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826038.613980:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826038.614010:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049231488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.614017:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5699 00000100:00100000:3.0:1787826038.614046:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049231488:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787826038.614062:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826038.614567:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826038.614577:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049231616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826038.614621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.614819:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049232000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.614847:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.614868:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049232512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.614890:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.614907:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787826038.614913:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049232128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.614934:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.614951:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049232640:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.614973:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.615001:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049232000 00000100:00100000:3.0:1787826038.615006:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049232000 00000100:00100000:3.0:1787826038.615040:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049232512 00000100:00100000:3.0:1787826038.615043:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049232512 00000100:00100000:3.0:1787826038.615059:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049232128 00000100:00100000:3.0:1787826038.615062:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049232128 00000100:00100000:3.0:1787826038.615076:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787826038.615083:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049232000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615122:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049232000:12345-0@lo:400:kworker.0 Request processed in 40us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.615129:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787826038.615143:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787826038.615150:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049232512:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826038.615161:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472974a80 x1874663049232512/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:394/0 lens 224/224 e 0 to 0 dl 1787826049 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826038.615204:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049232512:12345-0@lo:400:kworker.0 Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.615210:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787826038.615222:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787826038.615228:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049232128:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826038.615239:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472974e00 x1874663049232128/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:394/0 lens 224/224 e 0 to 0 dl 1787826049 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826038.615266:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049232128:12345-0@lo:400:kworker.0 Request processed in 38us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.615271:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787826038.615305:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049232128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615316:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049232000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615348:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049232512:0@lo:400:kworker.0 00000100:00080000:3.0:1787826038.615373:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826038.615377:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826038.615386:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049231744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615416:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.615442:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049232256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615464:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.615479:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049232768:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615498:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.615515:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787826038.615521:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049231872:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615552:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.615562:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049232384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615583:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826038.615606:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049232256 00000100:00100000:3.0:1787826038.615610:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049232256 00000100:00100000:3.0:1787826038.615634:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049232768 00000100:00100000:3.0:1787826038.615637:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049232768 00000100:00100000:3.0:1787826038.615647:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049231872 00000100:00100000:3.0:1787826038.615649:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049231872 00000100:00100000:3.0:1787826038.615663:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787826038.615668:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049232256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.615706:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049232256:12345-0@lo:400:kworker.0 Request processed in 37us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.615713:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787826038.615726:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787826038.615732:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049232768:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826038.615742:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cd5880 x1874663049232768/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:394/0 lens 224/224 e 0 to 0 dl 1787826049 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826038.615767:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049232768:12345-0@lo:400:kworker.0 Request processed in 36us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.615773:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787826038.615785:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787826038.615791:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049231872:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826038.615800:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cd7b80 x1874663049231872/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:394/0 lens 224/224 e 0 to 0 dl 1787826049 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826038.615823:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049231872:12345-0@lo:400:kworker.0 Request processed in 33us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.615829:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787826038.615849:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049232640 00000100:00100000:3.0:1787826038.615853:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049232640 00000100:00100000:3.0:1787826038.615878:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049232384 00000100:00100000:3.0:1787826038.615881:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049232384 00000100:00100000:3.0:1787826038.615897:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12588 00000100:00100000:3.0:1787826038.615903:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049232640:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826038.615918:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472975f80 x1874663049232640/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:394/0 lens 224/224 e 0 to 0 dl 1787826049 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826038.615948:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049232640:12345-0@lo:400:kworker.0 Request processed in 45us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.615958:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12588 00000100:00100000:3.0:1787826038.615969:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12589 00000100:00100000:3.0:1787826038.615975:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049232384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.616002:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049232384:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826038.616008:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12589 00000100:00100000:3.0:1787826038.616036:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049232640:0@lo:400:kworker.0 00000100:00080000:3.0:1787826038.616051:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826038.616055:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826038.616068:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049231872:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.616077:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049232384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.616086:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049232256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826038.616095:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049232768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826038.617795:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049231616 00000100:00100000:1.0:1787826038.617807:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049231616 00000100:00100000:1.0:1787826038.617866:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5700 00000100:00100000:1.0:1787826038.617877:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049231616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826038.617898:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826038.617998:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049231616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826038.618005:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5700 00000100:00080000:1.0:1787826038.618027:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826038.618137:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049231616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826038.618887:0:187896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049231744 00000100:00100000:2.0:1787826038.618896:0:187896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049231744 00000100:00100000:2.0:1787826038.618933:0:187896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787826038.618942:0:187896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049231744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826038.619004:0:187896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049231744:12345-0@lo:400:kworker.0 Request processed in 64us (3587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826038.619011:0:187896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787826038.619065:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049231744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826038.619380:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826038.619393:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049232896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826038.619431:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826038.619511:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049232896 00000100:00100000:0.0:1787826038.619516:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049232896 00000100:00100000:0.0:1787826038.619559:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12590 00000100:00100000:0.0:1787826038.619567:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049232896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826038.619604:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00010000:00000080:0.0:1787826038.619619:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69c000 x1874663049232896/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:394/0 lens 224/368 e 0 to 0 dl 1787826049 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826038.619657:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049232896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826038.619664:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12590 00000100:00100000:1.0:1787826038.619799:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049232896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826039.037242:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826039.037279:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826039.037310:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826039.037351:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826039.037390:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826039.037417:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042952960 00000100:00100000:3.0:1787826039.037427:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042952960 00000100:00100000:3.0:1787826039.037482:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042953088 00000100:00100000:3.0:1787826039.037485:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042953088 00000100:00100000:3.0:1787826039.037510:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:3.0:1787826039.037544:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2389:x1874663042952960:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:3.0:1787826039.037578:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4725e9f80 x1874663042952960/t0(0) o400->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:395/0 lens 224/224 e 0 to 0 dl 1787826050 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826039.039391:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2389:x1874663042952960:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 1855us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826039.039403:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:3.0:1787826039.039437:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:3.0:1787826039.039451:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042953088:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826039.039485:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042953088:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826039.039492:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:3.0:1787826039.039817:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042953216 00000100:00100000:3.0:1787826039.039825:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042953216 00000100:00100000:3.0:1787826039.039869:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042953344 00000100:00100000:3.0:1787826039.039873:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042953344 00000100:00100000:3.0:1787826039.039899:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6918 00000100:00100000:3.0:1787826039.039906:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042953216:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826039.039936:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042953216:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826039.039942:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6918 00000100:00100000:3.0:1787826039.039955:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6919 00000100:00100000:3.0:1787826039.039961:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042953344:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826039.039984:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042953344:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826039.039990:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6919 00000100:00100000:3.0:1787826039.040010:0:187895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042952832 00000100:00100000:3.0:1787826039.040015:0:187895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042952832 00000100:00100000:3.0:1787826039.040041:0:187895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:3.0:1787826039.040048:0:187895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042952832:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826039.040071:0:187895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042952832:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826039.040076:0:187895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00080000:3.0:1787826039.040111:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826039.040116:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826039.040119:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826039.040121:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826039.642695:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826040.666317:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826041.172755:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049233024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826041.172824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826041.173859:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049233024 00000100:00100000:0.0:1787826041.173869:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049233024 00000100:00100000:0.0:1787826041.173922:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12591 00000100:00100000:0.0:1787826041.173931:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049233024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826041.173965:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445466112 avail 1299226624 00000100:00100000:0.0:1787826041.186417:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049233024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 12477us (13583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826041.186431:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12591 00000100:00100000:1.0:1787826041.188872:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049233024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826041.684526:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787826041.720483:0:187875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449222 is committed 00010000:00010000:1.0:1787826041.720640:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720652:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720664:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720671:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826041.720675:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720684:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720701:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3200) 00010000:00010000:1.0:1787826041.720704:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826041.720710:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720715:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed200/0x878a5eea00cec9db lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720734:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720740:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720747:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720751:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826041.720754:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720763:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720769:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3200) 00010000:00010000:1.0:1787826041.720771:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826041.720773:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826041.720779:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceca13 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826042.708598:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826042.886578:0:189577:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1787826043.732710:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049233152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826043.732781:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.732987:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049233280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826043.733130:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.733155:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826043.733162:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049233408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826043.733185:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.733214:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049233152 00000100:00100000:1.0:1787826043.733221:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049233152 00000100:00100000:1.0:1787826043.733274:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12592 00000100:00100000:1.0:1787826043.733287:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049233152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826043.733346:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00010000:00000080:1.0:1787826043.733362:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69d880 x1874663049233152/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/368 e 0 to 0 dl 1787826054 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826043.733400:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049233152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826043.733407:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12592 00000100:00100000:1.0:1787826043.733434:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049233280 00000100:00100000:1.0:1787826043.733438:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049233280 00000100:00100000:1.0:1787826043.733545:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049233408 00000100:00100000:1.0:1787826043.733548:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049233408 00000100:00080000:2.0:1787826043.735361:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826043.735371:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826043.736483:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5701 00000100:00100000:1.0:1787826043.736508:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049233280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826043.736544:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826043.736621:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049233280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826043.736627:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5701 00000100:00100000:1.0:1787826043.736649:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5702 00000100:00100000:1.0:1787826043.736656:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049233408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826043.736672:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826043.736700:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049233408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (3514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826043.736706:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5702 00000100:00100000:1.0:1787826043.736833:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049233536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826043.736872:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.736933:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049233152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826043.736959:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049233536 00000100:00100000:1.0:1787826043.736964:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049233536 00000100:00100000:1.0:1787826043.736994:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5703 00000100:00100000:1.0:1787826043.737002:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049233536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826043.737014:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826043.737051:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049233536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826043.737058:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5703 00000100:00080000:2.0:1787826043.737063:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826043.737100:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049233408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826043.737113:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049233280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826043.737140:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049233536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826043.737539:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049234048:0@lo:400:kworker.0 00000100:00100000:1.0:1787826043.737568:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.737590:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049234560:0@lo:400:kworker.0 00000100:00100000:1.0:1787826043.737609:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.737623:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826043.737628:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049233664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826043.737649:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.737673:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049234176:0@lo:400:kworker.0 00000100:00100000:1.0:1787826043.737696:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.737714:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049234688:0@lo:400:kworker.0 00000100:00100000:3.0:1787826043.737716:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049234048 00000100:00100000:3.0:1787826043.737722:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049234048 00000100:00100000:1.0:1787826043.737735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826043.737747:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049233920:0@lo:400:kworker.0 00000100:00100000:1.0:1787826043.737765:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049233792:0@lo:400:kworker.0 00000100:00100000:3.0:1787826043.737783:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049234176 00000100:00100000:3.0:1787826043.737788:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049234176 00000100:00100000:2.0:1787826043.737790:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.737803:0:187898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049233664 00000100:00100000:1.0:1787826043.737808:0:187898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049233664 00000100:00100000:3.0:1787826043.737811:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049234688 00000100:00100000:3.0:1787826043.737816:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049234688 00000100:00100000:2.0:1787826043.737830:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049234432:0@lo:400:kworker.0 00000100:00100000:3.0:1787826043.737837:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049233920 00000100:00100000:3.0:1787826043.737841:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049233920 00000100:00100000:1.0:1787826043.737845:0:187898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787826043.737855:0:187898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049233664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826043.737866:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826043.737869:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787826043.737880:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049234048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826043.737901:0:187898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049233664:12345-0@lo:400:kworker.0 Request processed in 47us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826043.737905:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.737915:0:187898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787826043.737925:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049234304:0@lo:400:kworker.0 00000100:00100000:2.0:1787826043.737958:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826043.737962:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049233664:0@lo:400:kworker.0 00000100:00100000:0.0:1787826043.737969:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049234432 00000100:00100000:0.0:1787826043.737975:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049234432 00000100:00100000:2.0:1787826043.737992:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049234816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826043.738000:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049233792 00000100:00100000:0.0:1787826043.738005:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049233792 00000100:00100000:2.0:1787826043.738025:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826043.738029:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787826043.738040:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049234176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826043.738065:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049234304 00000100:00100000:2.0:1787826043.738070:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049234304 00000100:00100000:0.0:1787826043.738093:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049234176:12345-0@lo:400:kworker.0 Request processed in 55us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826043.738107:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12593 00000100:00100000:2.0:1787826043.738115:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049234304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826043.738156:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049234304:12345-0@lo:400:kworker.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826043.738163:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12593 00000100:00100000:2.0:1787826043.738181:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049234816 00000100:00100000:2.0:1787826043.738184:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049234816 00000100:00100000:2.0:1787826043.738208:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5704 00000100:00100000:2.0:1787826043.738214:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049234816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826043.738227:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826043.738258:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049234816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826043.738273:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5704 00000100:00100000:2.0:1787826043.738306:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049234304:0@lo:400:kworker.0 00010000:00000080:3.0:1787826043.738313:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a426d80 x1874663049234048/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1787826054 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826043.738343:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049234816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826043.738373:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049234048:12345-0@lo:400:kworker.0 Request processed in 494us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826043.738406:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787826043.738454:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787826043.738469:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787826043.738476:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049234688:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826043.738489:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479bf7800 x1874663049234688/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1787826054 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826043.738862:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049234688:12345-0@lo:400:kworker.0 Request processed in 386us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826043.738870:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787826043.738949:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826043.738959:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049233920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826043.739003:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049233920:12345-0@lo:400:kworker.0 Request processed in 47us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826043.739010:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826043.739022:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787826043.739031:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049234432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826043.739046:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049233920:0@lo:400:kworker.0 00010000:00000080:3.0:1787826043.739047:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348ae9c00 x1874663049234432/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1787826054 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826043.739091:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049234432:12345-0@lo:400:kworker.0 Request processed in 61us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826043.739098:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787826043.739103:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049234432:0@lo:400:kworker.0 00000100:00100000:3.0:1787826043.739432:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787826043.739442:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049233792:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826043.739447:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826043.739454:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00000080:3.0:1787826043.739456:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348aebb80 x1874663049233792/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1787826054 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826043.739458:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826043.739521:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049233792:12345-0@lo:400:kworker.0 Request processed in 81us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826043.739527:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787826043.739593:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049233792:0@lo:400:kworker.0 00010000:00010000:2.0:1787826043.739683:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826043.739876:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049234560 00000100:00100000:0.0:1787826043.739882:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049234560 00000100:00100000:0.0:1787826043.739987:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6920 00000100:00100000:0.0:1787826043.739994:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049234560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826043.740030:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049234560:12345-0@lo:400:kworker.0 Request processed in 37us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826043.740037:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6920 00000100:00100000:0.0:1787826043.740067:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049234176:0@lo:400:kworker.0 00000100:00100000:0.0:1787826043.740079:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049234688:0@lo:400:kworker.0 00000100:00100000:0.0:1787826043.740089:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049234048:0@lo:400:kworker.0 00000100:00100000:0.0:1787826043.740098:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049234560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826044.168944:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826044.169207:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826044.169241:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826044.169260:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826044.169286:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826044.169311:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042953728 00000100:00100000:2.0:1787826044.169321:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042953728 00000100:00100000:2.0:1787826044.169462:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042953600 00000100:00100000:2.0:1787826044.169466:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042953600 00000100:00100000:2.0:1787826044.169503:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00100000:2.0:1787826044.169514:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042953728:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826044.169581:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042953728:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826044.169588:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00100000:2.0:1787826044.169607:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:2.0:1787826044.169614:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+8:2392:x1874663042953600:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:2.0:1787826044.169627:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1fea00 x1874663042953600/t0(0) o400->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:400/0 lens 224/224 e 0 to 0 dl 1787826055 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826044.169651:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+8:2392:x1874663042953600:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826044.169658:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:2.0:1787826044.169677:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042953984 00000100:00100000:2.0:1787826044.169681:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042953984 00000100:00100000:2.0:1787826044.169705:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042953856 00000100:00100000:2.0:1787826044.169708:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042953856 00000100:00100000:2.0:1787826044.169727:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6921 00000100:00100000:2.0:1787826044.169734:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042953984:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826044.169922:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6922 00000100:00100000:0.0:1787826044.169932:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042953856:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826044.169961:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042953856:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 32us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826044.169968:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6922 00000100:00100000:3.0:1787826044.170068:0:187896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042953472 00000100:00100000:3.0:1787826044.170073:0:187896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042953472 00000100:00100000:3.0:1787826044.170109:0:187896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 103 00000100:00100000:3.0:1787826044.170116:0:187896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042953472:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826044.170143:0:187896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042953472:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826044.170149:0:187896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 103 00000100:00100000:2.0:1787826044.170221:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042953984:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 486us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826044.170228:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6921 00000100:00080000:2.0:1787826044.170246:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826044.170250:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826044.170252:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826044.170254:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787826044.759103:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826045.780524:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787826046.103028:0:189723:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787826046.103084:0:189723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.103098:0:189723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.103106:0:189723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.103112:0:189723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.103140:0:189723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787826046.103144:0:189723:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787826046.103170:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826046.103174:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787826046.103179:0:189723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787826046.103216:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa5b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787826046.103263:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049234944:0@lo:39:umount.0 00000100:00100000:3.0:1787826046.103354:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826046.104795:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826046.104807:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826046.104824:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb46e31e600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826046.104828:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826046.104840:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826046.104848:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826046.104854:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787826046.104857:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787826046.104860:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787826046.104896:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826046.104904:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826046.104933:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826046.104941:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e600/0x878a5eea00ce717b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce7182 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826046.104957:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826046.104959:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826046.104961:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826046.104969:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826046.104985:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049235072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826046.105034:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826046.106703:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049235072 00000100:00100000:3.0:1787826046.106717:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049235072 00000100:00100000:3.0:1787826046.106792:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4208 00000100:00100000:3.0:1787826046.106803:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049235072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826046.106817:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826046.106835:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34252ee00/0x878a5eea00ce7182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ce717b expref: 24 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.106851:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826046.106912:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3617:x1874663049235072:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826046.106919:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4208 00000100:00100000:2.0:1787826046.106965:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049235072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826046.108044:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049234944 00000100:00100000:1.0:1787826046.108053:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049234944 00000100:00100000:1.0:1787826046.108172:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1787826046.108182:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049234944:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826046.108224:0:188992:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce733b 00000100:00080000:1.0:1787826046.108239:0:188992:0:(import.c:65:import_set_state_nolock()) ffff8eb47f951800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1787826046.108265:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34ddd7480 x1874663049234944/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:402/0 lens 224/224 e 0 to 0 dl 1787826057 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826046.108349:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1874663049234944:12345-0@lo:39:umount.0 Request processed in 144us (4971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826046.108357:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000020:00000080:1.0:1787826046.108370:0:188992:0:(genops.c:885:class_export_put()) final put ffff8eb47f955000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787826046.108427:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826046.108455:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826046.108466:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049234944:0@lo:39:umount.0 00000020:00000080:1.0:1787826046.108503:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f955000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826046.108555:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f951800 for lustre-MDT0000 00000100:00080000:3.0:1787826046.108896:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826046.108905:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787826046.108909:0:189723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787826046.109882:0:189723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.109897:0:189723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.109905:0:189723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.109913:0:189723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.109936:0:189723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826046.109942:0:189723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.109949:0:189723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.109955:0:189723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.109960:0:189723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.109973:0:189723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787826046.109988:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826046.109994:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110001:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34252ec00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826046.110005:0:9495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110015:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826046.110022:0:9495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826046.110028:0:9495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826046.110030:0:9495:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787826046.110059:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110065:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826046.110093:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110100:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34252ec00/0x878a5eea00ce70b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce70b7 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110113:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826046.110117:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110123:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb46e31ea00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826046.110125:0:9495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110132:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826046.110139:0:9495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826046.110143:0:9495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826046.110145:0:9495:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787826046.110147:0:9495:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787826046.110161:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110167:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826046.110172:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110177:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ea00/0x878a5eea00ce72af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce72b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.110187:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826046.110188:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049235328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826046.110189:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826046.110190:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826046.110250:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826046.110296:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826046.110302:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049235200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826046.110339:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826046.110366:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049235328 00000100:00100000:2.0:1787826046.110373:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049235328 00000100:00100000:2.0:1787826046.110410:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049235200 00000100:00100000:2.0:1787826046.110413:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049235200 00000100:00100000:2.0:1787826046.110434:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4209 00000100:00100000:2.0:1787826046.110442:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049235328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826046.110455:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826046.110470:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb46e31fe00/0x878a5eea00ce72b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ce72af expref: 24 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826046.110496:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826046.110530:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3620:x1874663049235328:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826046.110537:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4209 00000100:00100000:2.0:1787826046.110560:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4210 00000100:00100000:2.0:1787826046.110566:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3620:x1874663049235200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826046.110574:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826046.110583:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bdcca00/0x878a5eea00ce70b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ce70b0 expref: 22 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826046.110591:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826046.110612:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3620:x1874663049235200:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826046.110619:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4210 00000100:00100000:2.0:1787826046.111159:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049235200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826046.111178:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049235328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826046.111322:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826046.113689:0:189723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.113710:0:189723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.113716:0:189723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.113723:0:189723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.113744:0:189723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826046.113750:0:189723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.113757:0:189723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.113768:0:189723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.113773:0:189723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826046.113815:0:189723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787826046.113820:0:189723:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787826046.113825:0:189723:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787826046.113863:0:189723:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787826046.113867:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1787826046.113871:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1787826046.113875:0:189723:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1787826046.118473:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826046.118497:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118508:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bdcde00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1787826046.118512:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118525:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826046.118533:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826046.118539:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787826046.118541:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787826046.118544:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787826046.118589:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118595:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826046.118628:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118635:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bdcde00/0x878a5eea00ce716d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce7174 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118649:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826046.118653:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118658:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb46e31fa00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1787826046.118661:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118667:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826046.118676:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826046.118681:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826046.118684:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787826046.118686:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787826046.118698:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118704:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826046.118710:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118715:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb46e31fa00/0x878a5eea00ce70a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ce70a9 expref: -99 pid: 187862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.118724:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826046.118726:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826046.118728:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826046.118753:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049235584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826046.118820:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826046.118871:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826046.118877:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049235456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826046.118901:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826046.118931:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049235584 00000100:00100000:1.0:1787826046.118938:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049235584 00000100:00100000:1.0:1787826046.118979:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049235456 00000100:00100000:1.0:1787826046.118983:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049235456 00000100:00100000:1.0:1787826046.119004:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4211 00000100:00100000:1.0:1787826046.119014:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3618:x1874663049235584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826046.119027:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826046.119041:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bdcda00/0x878a5eea00ce70a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ce70a2 expref: 22 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.119054:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826046.119086:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3618:x1874663049235584:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826046.119093:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4211 00000100:00100000:1.0:1787826046.119112:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4212 00000100:00100000:1.0:1787826046.119118:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:3618:x1874663049235456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826046.119127:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826046.119136:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714800/0x878a5eea00ce7174 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ce716d expref: 20 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.119145:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826046.119165:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3618:x1874663049235456:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826046.119171:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4212 00000004:00000080:3.0:1787826046.119453:0:189723:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1787826046.119661:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1787826046.119668:0:189723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb448c33000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787826046.119674:0:189723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb448c37800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787826046.119679:0:189723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb47986f800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787826046.119684:0:189723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb343730000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 330712483740 stale:0 00000020:00080000:3.0:1787826046.119691:0:189723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb343732000 a9ce6693-0634-46c5-bf21-5ca7d026d44e 192.168.203.47@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 335007449222 stale:0 00000020:00080000:3.0:1787826046.119695:0:189723:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8eb46a870000) has exports, disconnecting them 00000020:00080000:3.0:1787826046.119700:0:189723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb448c33000), last request at 1787826043 00000020:00000080:3.0:1787826046.119706:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7484 00000100:00080000:3.0:1787826046.119714:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb448c34800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787826046.119749:0:189723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb448c33000): rc 0 00000020:00000080:3.0:1787826046.119751:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb448c33000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787826046.119760:0:189723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb448c37800), last request at 1787826043 00000020:00000080:3.0:1787826046.119763:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce747d 00000100:00080000:3.0:1787826046.119767:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb448c34000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787826046.119777:0:189723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb448c37800): rc 0 00000020:00000080:3.0:1787826046.119780:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb448c37800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787826046.119783:0:189723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb47986f800), last request at 1787825987 00000020:00000080:3.0:1787826046.119786:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7293 00000100:00080000:3.0:1787826046.119788:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb479868800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787826046.119796:0:189723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb47986f800): rc 0 00000020:00000080:3.0:1787826046.119798:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb47986f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787826046.119801:0:189723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb343730000), last request at 1787825986 00000020:00000080:3.0:1787826046.119807:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce70f6 00000100:00080000:3.0:1787826046.119815:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb34c991800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787826046.119845:0:189723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb343730000): rc 0 00000020:00000080:3.0:1787826046.119847:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb343730000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1787826046.119851:0:189723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.47@tcp (ffff8eb343732000), last request at 1787826044 00000020:00000080:3.0:1787826046.119854:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce70ef 00000020:00010000:3.0:1787826046.119859:0:189723:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb343732000: total 4 00000100:00080000:3.0:1787826046.119862:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb3422b2800 : changing import state from FULL to CLOSED 00000004:00080000:3.0:1787826046.119914:0:189723:0:(mdd_object.c:3895:mdd_close()) Object [0x20001a9e3:0x1bd0:0x0] is retained in orphan list 00000020:00080000:3.0:1787826046.119922:0:189723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb343732000): rc 0 00000004:00000080:3.0:1787826046.119927:0:189723:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb65b85e0bae0 00000100:00080000:3.0:1787826046.119942:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787826046.119946:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869975 gen 3 00000100:00100000:1.0:1787826046.120098:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049235456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826046.120114:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049235584:0@lo:103:ldlm_bl.0 00000020:00010000:1.0:1787826046.120138:0:6479:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb343732000: total 4 00010000:00010000:1.0:1787826046.120176:0:6479:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb343732000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787826046.120290:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4429caa00/0x878a5eea00ce962d lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 3 pid: 187941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.120315:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e400/0x878a5eea00ce9634 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64b3f expref: 2 pid: 187941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826046.120350:0:6479:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb343732000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787826046.121321:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826046.121349:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c33000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826046.121402:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c37800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826046.121419:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47986f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826046.121438:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343730000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826046.121461:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb448c34800 for lustre-MDT0000 00000020:00000080:0.0:1787826046.121466:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb448c34000 for lustre-MDT0000 00000020:00000080:0.0:1787826046.121468:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb479868800 for lustre-MDT0000 00000020:00000080:0.0:1787826046.121471:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb34c991800 for lustre-MDT0000 00000100:00080000:3.0:1787826046.124050:0:189723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787826046.124084:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb472784800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787826046.125317:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049235712:0@lo:39:umount.0 00000100:00100000:0.0:1787826046.125400:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826046.125441:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049235712 00000100:00100000:3.0:1787826046.125450:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049235712 00000100:00100000:3.0:1787826046.125516:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12594 00000100:00100000:3.0:1787826046.125526:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049235712:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787826046.125555:0:8415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7200 00000100:00080000:3.0:1787826046.125575:0:8415:0:(import.c:65:import_set_state_nolock()) ffff8eb349087800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787826046.125669:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 4, last_transno is 17179869975 00000100:00100000:3.0:1787826046.126013:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1874663049235712:12345-0@lo:39:umount.0 Request processed in 487us (611us total) trans 17179869976 rc 0/0 00000100:00100000:3.0:1787826046.126021:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12594 00010000:00010000:0.0:1787826046.126308:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826046.126347:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb472784800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787826046.126355:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049235712:0@lo:39:umount.0 00010000:00010000:2.0:1787826046.126375:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826046.127397:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826046.129921:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787826046.129929:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738460 gen 3 00000004:00080000:3.0:1787826046.129954:0:189723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787826046.130033:0:189723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787826046.130059:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb46a6c7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787826046.130080:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787826046.130081:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975533 gen 3 00000004:00080000:3.0:1787826046.130091:0:189723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787826046.130156:0:189723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787826046.130165:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787826046.130210:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb46a870000) has no exports 00000100:00100000:0.0:1787826046.130315:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049235840:0@lo:9:umount.0 00000100:00100000:0.0:1787826046.130401:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826046.130435:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049235968:0@lo:9:umount.0 00000100:00100000:0.0:1787826046.130456:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826046.130506:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049235840 00000100:00100000:0.0:1787826046.130514:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049235840 00000100:00100000:3.0:1787826046.130527:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049235968 00000100:00100000:3.0:1787826046.130534:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049235968 00000100:00100000:0.0:1787826046.130577:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22531 00000100:00100000:0.0:1787826046.130586:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049235840:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787826046.130609:0:43902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce714a 00000100:00080000:0.0:1787826046.130616:0:43902:0:(import.c:65:import_set_state_nolock()) ffff8eb45eb95800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787826046.130655:0:43902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738460 00000100:00100000:0.0:1787826046.130792:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049235840:12345-0@lo:9:umount.0 Request processed in 207us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826046.130800:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22531 00000100:00100000:0.0:1787826046.130817:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22532 00000100:00100000:0.0:1787826046.130823:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049235968:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787826046.130834:0:43902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7158 00000100:00080000:0.0:1787826046.130840:0:43902:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787826046.130861:0:43902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975533 00000100:00100000:0.0:1787826046.130936:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049235968:12345-0@lo:9:umount.0 Request processed in 113us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826046.130943:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22532 00000040:00080000:3.0:1787826046.133995:0:189723:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 9, last_idx 11 00000040:00080000:3.0:1787826046.134038:0:189723:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 10, last_idx 11 00000100:00080000:2.0:1787826046.135392:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826046.135402:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787826046.135413:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787826046.135451:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb46a870000) has no exports 00000100:00080000:2.0:1787826046.135460:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb46a6c7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787826046.135475:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787826046.135477:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826046.135494:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049235840:0@lo:9:umount.0 00000100:00080000:2.0:1787826046.135509:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787826046.135513:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787826046.135514:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826046.135516:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049235968:0@lo:9:umount.0 00010000:00010000:0.0:1787826046.136570:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787826046.180649:0:6479:0:(genops.c:885:class_export_put()) final put ffff8eb343732000/a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:2.0:1787826046.180761:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343732000/a9ce6693-0634-46c5-bf21-5ca7d026d44e for lustre-MDT0000 00000020:00000080:2.0:1787826046.180818:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3422b2800 for lustre-MDT0000 00010000:00010000:0.0:1787826046.180866:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826046.180869:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826046.180872:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826046.223674:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce710b 00000020:00000080:3.0:1787826046.223690:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb472783000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787826046.223708:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787826046.224182:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb472783000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787826046.232390:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826046.232406:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787826046.232412:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8eb4815f3370) has no exports 00000020:00000080:0.0:1787826046.232946:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7104 00000020:00000080:0.0:1787826046.232955:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb46abec800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826046.233016:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826046.233023:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787826046.233026:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb46abef000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787826046.233029:0:189723:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46abef000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787826046.233038:0:189723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787826046.233298:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46abec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787826046.233496:0:189723:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb4813b1840 - data ffff8eb4722005e8/ffff8eb343f38000 00000020:01000000:0.0:1787826046.233635:0:189723:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb343f64840 - data ffff8eb4721f4948/ffff8eb34bb00000 00000100:00080000:1.0:1787826046.345353:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787826046.345363:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869975 gen 4 00000100:00100000:1.0:1787826046.345378:0:189723:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb34ddd4a80 x1874663049235712/t17179869976(17179869976) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826056 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826046.345407:0:189723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787826046.349736:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787826046.349746:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738460 gen 4 00000004:00080000:1.0:1787826046.349769:0:189723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826046.349772:0:189723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787826046.354420:0:187926:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787826046.354429:0:187926:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x138:0x0] index 1 count 1 00000040:00080000:0.0:1787826046.354448:0:187926:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 78 count 2 00000100:00080000:1.0:1787826046.355110:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787826046.355116:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975533 gen 4 00000004:00080000:1.0:1787826046.355125:0:189723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826046.355128:0:189723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787826046.355639:0:187928:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787826046.355643:0:187928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13a:0x0] index 1 count 1 00000040:00080000:3.0:1787826046.355654:0:187928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 78 count 2 00000020:00000080:1.0:1787826046.360953:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce70c5 00000020:00000080:1.0:1787826046.360965:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb4728b9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787826046.361698:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce70da 00000020:00000080:1.0:1787826046.361704:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb3431b9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787826046.361709:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787826046.361715:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826046.361724:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787826046.361728:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8eb46a874d28) has no exports 00000004:01000000:1.0:1787826046.361886:0:189723:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787826046.361895:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7151 00000020:00000080:1.0:1787826046.361899:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb3431bc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787826046.361903:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787826046.361907:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826046.361911:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826046.361913:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8eb45eb80000) has no exports 00000020:00000080:1.0:1787826046.361919:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7143 00000020:00000080:1.0:1787826046.361922:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb34c51a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826046.362408:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4728b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826046.362417:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3431b9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787826046.362421:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3431bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787826046.362425:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c51a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787826046.364620:0:189723:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787826046.364629:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787826046.364633:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975533 gen 5 00000004:00080000:1.0:1787826046.364640:0:189723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826046.364643:0:189723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826046.365304:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826046.365317:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826046.365355:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7135 00000020:00000080:1.0:1787826046.365364:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb34c51a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826046.370344:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb34c51c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787826046.370361:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb34c51c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826046.370364:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c51c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787826046.370372:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787826046.371740:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787826046.371756:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826046.371769:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826046.371775:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8eb4815f19b8) has no exports 00000020:00000080:1.0:1787826046.371786:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce712e 00000020:00000080:1.0:1787826046.371794:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb46abee800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826046.378390:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c51a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787826046.382021:0:189723:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787826046.382030:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787826046.382034:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738460 gen 5 00000004:00080000:1.0:1787826046.382045:0:189723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826046.382048:0:189723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826046.387354:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826046.387370:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787826046.387386:0:189723:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787826046.387394:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7120 00000020:00000080:1.0:1787826046.387403:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb477f6d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787826046.387409:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787826046.387417:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826046.387421:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826046.387425:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8eb45eb819b8) has no exports 00000020:00000080:1.0:1787826046.387432:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7119 00000020:00000080:1.0:1787826046.387435:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb4728bf800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826046.389359:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46abee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826046.389382:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46a6c7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787826046.389392:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb477f6e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826046.389395:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb477f6e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787826046.389400:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826046.389523:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb477f6d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787826046.389529:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4728bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787826046.392388:0:189723:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787826046.392396:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826046.392400:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869975 gen 5 00000100:00100000:0.0:1787826046.392409:0:189723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826046.392470:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826046.392490:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826046.392499:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb472784800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787826046.392512:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb477f6b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826046.392515:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb477f6b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787826046.392518:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826046.392521:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826046.392524:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb4728bd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787826046.392524:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826046.392526:0:189723:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4728bd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787826046.392531:0:189723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826046.392646:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce70e1 00000020:00000080:0.0:1787826046.392653:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb3431bd800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787826046.392679:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787826046.392684:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826046.392689:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826046.392692:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8eb46a8719b8) has no exports 00000020:00000080:0.0:1787826046.392716:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787826046.392717:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3431bd800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787826046.392720:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787826046.392722:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb3431bf800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787826046.392725:0:189723:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3431bf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787826046.392728:0:189723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787826046.392764:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce70e8 00000020:00000080:0.0:1787826046.392769:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb3431ba000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787826046.392787:0:189723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb46e35f000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787826046.392790:0:189723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb46e35f000 3 00000020:01000004:0.0:1787826046.392793:0:189723:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb46e35f000 from lustre-MDT0000 00000020:00000080:0.0:1787826046.392810:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826046.392814:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787826046.392816:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb4728bf000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787826046.392818:0:189723:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4728bf000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787826046.392823:0:189723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787826046.392855:0:189723:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787826046.392859:0:189723:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787826046.392861:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787826046.392864:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826046.392867:0:189723:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787826046.392875:0:189723:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb46aa59800 7528148b-9bee-4d31-b597-8aae3b0b4982 192.168.203.47@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826046.392881:0:189723:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb348a3c800 205ad83e-e455-4070-92a2-f1e25b8f3f40 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826046.392885:0:189723:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8eb481d599b8) has exports, disconnecting them 00000020:00080000:0.0:1787826046.392889:0:189723:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.47@tcp (ffff8eb46aa59800), last request at 1787825998 00000020:00000080:0.0:1787826046.392911:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce748b 00000020:00010000:0.0:1787826046.392916:0:189723:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb46aa59800: total 1 00000100:00080000:0.0:1787826046.392920:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa5a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826046.392930:0:189723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb46aa59800): rc 0 00000020:00080000:0.0:1787826046.392934:0:189723:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8eb348a3c800), last request at 1787825985 00000020:00000080:3.0:1787826046.392938:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3431ba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1787826046.392973:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb46aa59800: total 0 00010000:00010000:0.0:1787826046.392977:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826046.393005:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb46aa59800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1787826046.393038:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34252fc00/0x878a5eea00ce7499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6e5bd expref: 5 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.393052:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481715a00/0x878a5eea00ce74a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6e5cb expref: 4 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.393064:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34252fe00/0x878a5eea00ce7492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6e5b6 expref: 3 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.393074:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714e00/0x878a5eea00ce74a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6e5c4 expref: 2 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.393083:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb46aa59800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1787826046.393103:0:6478:0:(genops.c:885:class_export_put()) final put ffff8eb46aa59800/7528148b-9bee-4d31-b597-8aae3b0b4982 00010000:00010000:0.0:1787826046.393120:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826046.393122:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826046.393124:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826046.393137:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7086 00000020:00010000:0.0:1787826046.393141:0:189723:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb348a3c800: total 1 00000100:00080000:0.0:1787826046.393143:0:189723:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826046.393155:0:189723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb348a3c800): rc 0 00000020:00080000:0.0:1787826046.393158:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8eb481d599b8) has no exports 00000100:00100000:0.0:1787826046.393230:0:187898:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8eb46e022e00:187898] 2 exiting: rc = 0 00000100:00100000:3.0:1787826046.393251:0:187895:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8eb3423e5a00:187895] 0 exiting: rc = 1 00000100:00100000:3.0:1787826046.400990:0:187896:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8eb3423e5800:187896] 1 exiting: rc = 0 00000020:00000080:3.0:1787826046.401085:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46aa59800/7528148b-9bee-4d31-b597-8aae3b0b4982 for MGS 00000020:00000080:3.0:1787826046.401120:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46aa5a000 for MGS 00000100:00100000:0.0:1787826046.401198:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401207:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401215:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401221:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401227:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401233:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401239:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401246:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401253:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401259:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401265:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401271:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401278:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401285:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401292:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401296:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401302:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401307:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401313:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401318:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401340:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401347:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401352:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401357:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401362:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401368:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401373:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401378:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401383:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401388:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401393:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401399:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401403:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401408:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401415:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401420:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401425:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401429:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401434:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401439:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401444:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401451:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401456:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401461:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401467:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401472:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401487:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401494:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401499:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401504:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401510:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401514:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401519:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401524:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401528:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401534:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401540:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401546:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401553:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401558:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401562:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401567:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401572:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826046.401577:0:189723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787826046.408247:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb34bdcc800/0x878a5eea00ce7318 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce7311 expref: 14 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.408275:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bdcc800/0x878a5eea00ce7318 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce7311 expref: 14 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.408300:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb34252f800/0x878a5eea00ce71c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce71c1 expref: 13 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.408310:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34252f800/0x878a5eea00ce71c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce71c1 expref: 13 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.408320:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb481714200/0x878a5eea00ce727e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce7277 expref: 12 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.408344:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714200/0x878a5eea00ce727e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce7277 expref: 12 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.408354:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb481714000/0x878a5eea00ce72c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce72bd expref: 11 pid: 187895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.408362:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714000/0x878a5eea00ce72c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce72bd expref: 11 pid: 187895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411704:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb46e31f000/0x878a5eea00ce72d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce72cb expref: 10 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411728:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb46e31f000/0x878a5eea00ce72d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce72cb expref: 10 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411738:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb46e31f200/0x878a5eea00ce72ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce72e7 expref: 9 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411747:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb46e31f200/0x878a5eea00ce72ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce72e7 expref: 9 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411757:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb34bdcd200/0x878a5eea00ce72fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce72f5 expref: 8 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411764:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bdcd200/0x878a5eea00ce72fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce72f5 expref: 8 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411772:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb481714600/0x878a5eea00ce7326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce731f expref: 7 pid: 187895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411779:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714600/0x878a5eea00ce7326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce731f expref: 7 pid: 187895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411792:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb46e31ec00/0x878a5eea00ce72a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce72a1 expref: 6 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411798:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb46e31ec00/0x878a5eea00ce72a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce72a1 expref: 6 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411810:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb34252f200/0x878a5eea00ce71ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce71b3 expref: 5 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411816:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34252f200/0x878a5eea00ce71ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce71b3 expref: 5 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411827:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb46e31f800/0x878a5eea00ce7270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce7269 expref: 4 pid: 187895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411833:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb46e31f800/0x878a5eea00ce7270 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce7269 expref: 4 pid: 187895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411844:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb46e31fc00/0x878a5eea00ce72e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce72d9 expref: 3 pid: 187895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411850:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb46e31fc00/0x878a5eea00ce72e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce72d9 expref: 3 pid: 187895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411858:0:189723:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8eb481714c00/0x878a5eea00ce730a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x878a5eea00ce7303 expref: 2 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826046.411864:0:189723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714c00/0x878a5eea00ce730a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x878a5eea00ce7303 expref: 2 pid: 187896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1787826046.433391:0:66923:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb348a3c800: total 0 00010000:00010000:0.0:1787826046.433507:0:66923:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb348a3c800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1787826046.433526:0:66923:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb348a3c800, canceled 0 locks, left on hash table 0. 00000020:00000080:0.0:1787826046.433541:0:66923:0:(genops.c:885:class_export_put()) final put ffff8eb348a3c800/205ad83e-e455-4070-92a2-f1e25b8f3f40 00010000:00010000:0.0:1787826046.433566:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826046.433568:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826046.433570:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826046.433717:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a3c800/205ad83e-e455-4070-92a2-f1e25b8f3f40 for MGS 00000020:00000080:3.0:1787826046.433765:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb348a3d800 for MGS 00010000:00010000:1.0:1787826046.804661:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826047.828697:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787826048.468493:0:189723:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb4813b17e0 - data ffff8eb472158ca8/ffff8eb34518d400 00000020:01000000:0.0:1787826048.468644:0:189723:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb476c6d3c0 - data ffff8eb4721240d8/ffff8eb349224c00 00000020:00000080:0.0:1787826048.469121:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7078 00000020:00000080:0.0:1787826048.469129:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb348a3b800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787826048.469144:0:189723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb46e35f000 from MGS, refs=2 00000020:01000004:0.0:1787826048.469147:0:189723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb46e35f000 2 00000020:01000004:0.0:1787826048.469150:0:189723:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb46e35f000 from MGS 00000020:00000080:0.0:1787826048.469169:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826048.469176:0:189723:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787826048.469179:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb348a3e800/MGS 00000020:00000080:0.0:1787826048.469182:0:189723:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a3e800/MGS for MGS 00000020:01000000:0.0:1787826048.469189:0:189723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787826048.469281:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787826048.469285:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826048.469291:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826048.469297:0:189723:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8eb46aa5c000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826048.469303:0:189723:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8eb348ce4d28) has exports, disconnecting them 00000020:00080000:0.0:1787826048.469308:0:189723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8eb46aa5c000), last request at 1787825986 00000020:00000080:0.0:1787826048.469312:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7190 00000020:00080000:0.0:1787826048.469321:0:189723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb46aa5c000): rc 0 00000020:00000080:0.0:1787826048.469370:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb46aa5c000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787826048.470226:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a3b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787826048.470239:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46aa5c000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787826048.471896:0:189723:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787826048.471905:0:189723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826048.471909:0:189723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787826048.471917:0:189723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826048.472090:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826048.472098:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787826048.472105:0:189723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb46e35f000 1 00000020:00000080:1.0:1787826048.472111:0:189723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce706a 00000020:00000080:1.0:1787826048.472118:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb348a3b000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787826048.472123:0:189723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787826048.472129:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826048.472133:0:189723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787826048.472136:0:189723:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8eb45eb84d28) has no exports 00000020:00000080:3.0:1787826048.474513:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46aa5b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787826048.474528:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb46aa59000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787826048.474532:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46aa59000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787826048.474538:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787826048.474619:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a3b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826048.577743:0:189723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826048.577757:0:189723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787826048.577763:0:189723:0:(genops.c:885:class_export_put()) final put ffff8eb46e35a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787826048.577767:0:189723:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e35a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787826048.577779:0:189723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787826048.577903:0:189723:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8eb46e35c800 00000020:02000400:2.0:1787826048.577967:0:189723:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1787826048.852496:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049236096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826048.852564:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826048.853998:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826048.855062:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049236224:0@lo:400:kworker.0 00000400:00000100:0.0:1787826048.855114:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049236224 offset 0 length 224: 4 00000100:00100000:3.0:1787826048.857440:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049236096 00000100:00100000:3.0:1787826048.857455:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049236096 00000100:00100000:3.0:1787826048.857586:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5705 00000100:00100000:3.0:1787826048.857599:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049236096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826048.857631:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826048.857705:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049236096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (5140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826048.857713:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5705 00000100:00100000:3.0:1787826048.857765:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049236096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826048.861179:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049236480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826048.861255:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826048.861390:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826048.861397:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049236352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826048.861431:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826048.861482:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049236352 00000100:00100000:1.0:1787826048.861490:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049236352 00000100:00100000:1.0:1787826048.861530:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12595 00000100:00100000:1.0:1787826048.861538:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3618:x1874663049236352:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787826048.861546:0:177386:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826048.861640:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3618:x1874663049236352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (209us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826048.861647:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12595 00000100:00100000:1.0:1787826048.861676:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049236992:0@lo:400:kworker.0 00000100:00100000:1.0:1787826048.861703:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:1.0:1787826048.861733:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787826048.861739:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826048.861743:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826048.861747:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787826048.861752:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826048.861755:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8055 00000100:00080000:1.0:1787826048.861762:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826048.861781:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69c380 x1874663049237120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826048.861805:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826048.861810:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049236864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826048.861841:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826048.862020:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826048.862038:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049236992 00000100:00100000:0.0:1787826048.862043:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049236992 00000100:00100000:0.0:1787826048.862097:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049236864 00000100:00100000:0.0:1787826048.862101:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049236864 00000100:00100000:0.0:1787826048.862119:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787826048.862127:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049236992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826048.862182:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049237120:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787826048.862207:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826048.862240:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:1.0:1787826048.862246:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874663049236864:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826048.862251:0:187904:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826048.862335:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049236480 00000100:00100000:3.0:1787826048.862340:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049236480 00000100:00100000:3.0:1787826048.862374:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5706 00000100:00100000:3.0:1787826048.862382:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049236480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826048.862404:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826048.864458:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049236992:12345-0@lo:400:kworker.0 Request processed in 2324us (2746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826048.864483:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826048.868294:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049236608:0@lo:400:kworker.0 00000100:00100000:2.0:1787826048.868395:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826048.868441:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049237248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826048.868481:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826048.868508:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826048.868515:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049236736:0@lo:400:kworker.0 00000100:00100000:2.0:1787826048.868552:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826048.869419:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1874663049236864:12345-0@lo:400:kworker.0 Request processed in 7168us (7573us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826048.869432:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:1.0:1787826048.869493:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049236608 00000100:00100000:1.0:1787826048.869501:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049236608 00000100:00100000:1.0:1787826048.869528:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049237248 00000100:00100000:1.0:1787826048.869532:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049237248 00000100:00100000:1.0:1787826048.869539:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049236736 00000100:00100000:1.0:1787826048.869541:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049236736 00000100:00100000:1.0:1787826048.869568:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787826048.869577:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049236736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826048.869645:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049236736:12345-0@lo:400:kworker.0 Request processed in 68us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826048.869652:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787826048.869669:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:1.0:1787826048.869675:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1874663049236608:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826048.869682:0:187905:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826048.869706:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049236736:0@lo:400:kworker.0 00000100:00100000:1.0:1787826048.869713:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1874663049236608:12345-0@lo:400:kworker.0 Request processed in 36us (1318us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826048.869720:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00080000:2.0:1787826048.869724:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826048.869730:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1787826048.869737:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:02000400:2.0:1787826048.869737:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787826048.869746:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787826048.869747:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1874663049237248:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826048.869756:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8064 00000020:00080000:1.0:1787826048.869757:0:187905:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1787826048.869766:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826048.869787:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1874663049237248:12345-0@lo:400:kworker.0 Request processed in 39us (1304us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826048.869795:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1787826048.869795:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e54a80 x1874663049237376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826048.869820:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049237120 00000100:00100000:2.0:1787826048.869821:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049236608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826048.869826:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049237120 00000100:00080000:2.0:1787826048.869837:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826048.869841:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826048.869844:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787826048.869847:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826048.869851:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8053 00000100:00100000:1.0:1787826048.869856:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12596 00000100:00080000:2.0:1787826048.869860:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826048.869876:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e55c00 x1874663049237504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826048.869877:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049237120:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787826048.869900:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049237248:0@lo:400:kworker.0 00010000:00020000:1.0:1787826048.869905:0:8415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826048.869939:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049237120:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 75us (7730us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826048.869946:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12596 00000100:00100000:1.0:1787826048.869967:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049237376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787826048.869999:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826048.870026:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049237504:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787826048.870048:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826048.870058:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049237376 00000100:00100000:2.0:1787826048.870064:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049237376 00000100:00080000:1.0:1787826048.870070:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826048.870077:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826048.870081:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049237120:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787826048.870082:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049237504 00000100:00100000:2.0:1787826048.870089:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049237504 00000100:00100000:2.0:1787826048.870108:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1787826048.870114:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049237376:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787826048.870126:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826048.870183:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049237376:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 66us (182us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826048.870191:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00080000:1.0:1787826048.870192:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826048.870197:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826048.870201:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049237376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787826048.870211:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1787826048.870216:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049237504:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787826048.870225:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826048.870257:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049237504:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 38us (208us total) trans 0 rc -19/-19 00000100:00080000:1.0:1787826048.870263:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1787826048.870263:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00080000:1.0:1787826048.870271:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826048.870276:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049237504:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787826048.872660:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049236480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10269us (11395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826048.872674:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5706 00000100:00080000:2.0:1787826048.873524:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826048.873530:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826048.873535:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787826048.873539:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826048.873544:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8064 00000100:00080000:2.0:1787826048.873552:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826048.873584:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e55c00 x1874663049237632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826048.873615:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049236864:0@lo:400:kworker.0 00000100:00100000:2.0:1787826048.873633:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049236992:0@lo:400:kworker.0 00000100:00100000:2.0:1787826048.873654:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049236480:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787826048.873678:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826048.873684:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826048.876720:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049237632:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787826048.876796:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826048.877247:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049237632 00000100:00100000:2.0:1787826048.877257:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049237632 00000100:00100000:2.0:1787826048.877302:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1787826048.877312:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049237632:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1787826048.877367:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826048.877424:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049237632:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 112us (626us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826048.877432:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00080000:1.0:1787826048.877522:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826048.877528:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826048.877532:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049237632:0@lo:38:ptlrpcd_00_01.0 00000400:00000100:0.0:1787826049.277695:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042954112 offset 0 length 224: 4 00000100:00100000:0.0:1787826049.277735:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826049.278097:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826049.278136:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826049.278175:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042954624 00000100:00100000:3.0:1787826049.278184:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042954624 00000100:00100000:3.0:1787826049.278240:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6923 00000100:00100000:3.0:1787826049.278251:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042954624:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826049.278320:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042954624:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826049.278352:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6923 00000100:00100000:0.0:1787826049.278512:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826049.278549:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042954496 00000100:00100000:3.0:1787826049.278555:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042954496 00000100:00100000:2.0:1787826049.278614:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042954368 00000100:00100000:3.0:1787826049.278673:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6924 00000100:00100000:2.0:1787826049.278681:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042954368 00000100:00100000:3.0:1787826049.278687:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042954496:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826049.278724:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042954240 00000100:00100000:2.0:1787826049.278728:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042954240 00000100:00100000:2.0:1787826049.278748:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:2.0:1787826049.278755:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042954368:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826049.278793:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042954368:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826049.278955:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042954496:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 270us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826049.279031:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6924 00000100:00080000:3.0:1787826049.279709:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826049.279714:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826049.279716:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826049.280547:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:2.0:1787826049.280576:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 884 00000100:00100000:2.0:1787826049.280582:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1874663042954240:12345-192.168.203.47@tcp:400:kworker.0 00000020:00080000:2.0:1787826049.280590:0:188682:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.47@tcp 00000100:00100000:2.0:1787826049.280667:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1874663042954240:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 83us (2530us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826049.280674:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 884 00000100:00100000:2.0:1787826049.284559:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826049.284729:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042954752 00000100:00100000:0.0:1787826049.284738:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042954752 00000100:00100000:0.0:1787826049.284782:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 885 00000100:00100000:0.0:1787826049.284790:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042954752:12345-192.168.203.47@tcp:38:ptlrpcd_01_01.0 00010000:00020000:0.0:1787826049.284810:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826049.284866:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042954752:12345-192.168.203.47@tcp:38:ptlrpcd_01_01.0 Request processed in 77us (317us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826049.284874:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 885 00010000:00010000:0.0:1787826049.878306:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826050.900747:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826051.925168:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826051.927785:0:184693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826051.927794:0:184693:0:(genops.c:885:class_export_put()) final put ffff8eb45eb96000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826051.927873:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb45eb96000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787826051.927929:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb45eb95800 for lustre-OST0000 00000001:00100000:2.0:1787826051.930837:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787826051.930849:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869976 is committed 00000020:00000080:2.0:1787826051.930855:0:187942:0:(genops.c:885:class_export_put()) final put ffff8eb442c28000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826051.931006:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb442c28000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787826051.931100:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb349087800 for lustre-MDT0001 00000001:00100000:0.0:1787826051.933624:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826051.933632:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb47f9a3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826051.936201:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f9a3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787826051.936437:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f9a1800 for lustre-OST0001 00010000:00010000:1.0:1787826052.949305:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826053.973284:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049237760:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787826053.973301:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826053.973307:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826053.973311:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826053.973317:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8115 00000100:00080000:0.0:1787826053.973341:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826053.973348:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826053.973372:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb349b6f480 x1874663049238016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826053.973380:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826053.973408:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826053.973412:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826053.973415:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826053.973419:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8115 00000100:00080000:0.0:1787826053.973422:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826053.973438:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826053.973453:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb349b6ed80 x1874663049238272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826053.973479:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049238400:0@lo:400:kworker.0 00000100:00080000:0.0:1787826053.973480:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826053.973489:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826053.973490:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826053.973495:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8115 00000100:00080000:0.0:1787826053.973498:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826053.973502:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826053.973519:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb349b6fb80 x1874663049238528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826053.973520:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826053.973544:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826053.973547:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826053.973550:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787826053.973550:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1787826053.973556:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8115 00000100:00080000:0.0:1787826053.973561:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1787826053.973561:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049238656:0@lo:400:kworker.0 00000100:00080000:0.0:1787826053.973569:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826053.973583:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb349b6ca80 x1874663049238784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826053.973595:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826053.973629:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049237888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826053.973639:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049237760 00000100:00100000:2.0:1787826053.973648:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049237760 00000400:00000100:0.0:1787826053.973659:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049237888 offset 0 length 224: 4 00000100:00100000:0.0:1787826053.973689:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826053.973696:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049238144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826053.973714:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5707 00000100:00100000:0.0:1787826053.973728:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826053.973728:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049237760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826053.973760:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00080000:0.0:1787826053.973779:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826053.973794:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049238400 00000100:00100000:0.0:1787826053.973799:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049238400 00000100:00100000:2.0:1787826053.973807:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049237760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826053.973814:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5707 00000100:00100000:2.0:1787826053.973845:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049238144 00000100:00100000:2.0:1787826053.973851:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049238144 00000100:00100000:0.0:1787826053.973862:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787826053.973874:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049238400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826053.973883:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787826053.973893:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049238144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826053.973923:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049238400:12345-0@lo:400:kworker.0 Request processed in 51us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826053.973931:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787826053.973945:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049238144:12345-0@lo:400:kworker.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826053.973953:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787826053.973967:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826053.974003:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049238144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826053.974028:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049237760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826053.974051:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049238400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826053.974490:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049238656 00000100:00100000:3.0:1787826053.974494:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049238656 00000100:00100000:3.0:1787826053.974530:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6925 00000100:00100000:3.0:1787826053.974537:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049238656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826053.974586:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049238656:12345-0@lo:400:kworker.0 Request processed in 50us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826053.974592:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6925 00000100:00100000:3.0:1787826053.974621:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049238656:0@lo:400:kworker.0 00000100:00080000:0.0:1787826053.976176:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826053.976200:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787826053.976506:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826053.976525:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049238016:0@lo:38:kworker.0 00000100:00100000:1.0:1787826053.976595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826053.976648:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049238272:0@lo:38:kworker.0 00000100:00100000:1.0:1787826053.976671:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826053.976690:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049238528:0@lo:38:kworker.0 00000100:00100000:1.0:1787826053.976713:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826053.976730:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049238784:0@lo:38:kworker.0 00000100:00100000:1.0:1787826053.976750:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826053.976799:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049238016 00000100:00100000:1.0:1787826053.976806:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049238016 00000100:00100000:1.0:1787826053.976839:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049238272 00000100:00100000:1.0:1787826053.976842:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049238272 00000100:00100000:1.0:1787826053.976851:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049238784 00000100:00100000:1.0:1787826053.976853:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049238784 00000100:00100000:1.0:1787826053.976866:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1787826053.976872:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049238016:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826053.976895:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826053.976950:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049238016:12345-0@lo:38:kworker.0 Request processed in 75us (354us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826053.976957:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1787826053.976976:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1787826053.976980:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049238272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826053.976990:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826053.977026:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049238272:12345-0@lo:38:kworker.0 Request processed in 43us (353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826053.977032:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1787826053.977045:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1787826053.977049:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049238784:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826053.977059:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826053.977083:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049238784:12345-0@lo:38:kworker.0 Request processed in 33us (333us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826053.977089:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1787826053.977111:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049238528 00000100:00100000:1.0:1787826053.977115:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049238528 00000100:00100000:1.0:1787826053.977134:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12597 00000100:00100000:1.0:1787826053.977138:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049238528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826053.977147:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826053.977174:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049238528:12345-0@lo:38:kworker.0 Request processed in 35us (460us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826053.977179:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12597 00000100:00080000:1.0:1787826053.977226:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826053.977231:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826053.977234:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049238016:0@lo:38:kworker.0 00000100:00080000:1.0:1787826053.977242:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826053.977246:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826053.977248:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049238272:0@lo:38:kworker.0 00000100:00080000:1.0:1787826053.977255:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826053.977257:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826053.977260:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049238528:0@lo:38:kworker.0 00000100:00080000:1.0:1787826053.977266:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826053.977269:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826053.977272:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049238784:0@lo:38:kworker.0 00000100:00100000:0.0:1787826053.977858:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049238912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826053.977898:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826053.977958:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049238912 00000100:00100000:2.0:1787826053.977964:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049238912 00000100:00100000:2.0:1787826053.978008:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5708 00000100:00100000:2.0:1787826053.978016:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049238912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826053.978041:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826053.978099:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049238912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826053.978106:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5708 00000100:00100000:1.0:1787826053.978286:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049238912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826054.397494:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826054.397547:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000400:00000100:3.0:1787826054.397575:0:3611:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042954880 offset 0 length 224: 4 00000100:00100000:3.0:1787826054.397600:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826054.397635:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042955392 00000100:00100000:3.0:1787826054.397644:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042955392 00000100:00100000:3.0:1787826054.397698:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042955264 00000100:00100000:3.0:1787826054.397701:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042955264 00000100:00100000:3.0:1787826054.397731:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6926 00000100:00080000:0.0:1787826054.397792:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826054.397796:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826054.397888:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042955136 00000100:00100000:1.0:1787826054.397893:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042955136 00000100:00100000:1.0:1787826054.397934:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:1.0:1787826054.397942:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042955136:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826054.398013:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042955136:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 73us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826054.398021:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:3.0:1787826054.398092:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042955392:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826054.398123:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042955392:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 382us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826054.402523:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6927 00000100:00100000:2.0:1787826054.402554:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042955264:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826054.402640:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042955264:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 103us (5038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826054.402648:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6927 00000100:00100000:2.0:1787826054.405953:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:2.0:1787826054.406012:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826054.409865:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042955008 00000100:00100000:0.0:1787826054.409883:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042955008 00000100:00100000:0.0:1787826054.410167:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 889 00000100:00100000:0.0:1787826054.410176:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042955008:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:0.0:1787826054.410200:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826054.410453:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6926 00000100:00100000:0.0:1787826054.411647:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042955008:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 1463us (5696us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826054.411659:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 889 00010000:00010000:0.0:1787826054.996671:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826056.020986:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826057.044708:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826058.074501:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826059.092542:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826059.092549:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826059.092553:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826059.092562:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8120 00000100:00080000:0.0:1787826059.092569:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826059.092576:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826059.092599:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb349b6c380 x1874663049239168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826059.092630:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826059.092633:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826059.092635:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826059.092638:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8120 00000100:00080000:0.0:1787826059.092641:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826059.092645:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826059.092659:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb349b6e680 x1874663049239424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826059.092674:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826059.092678:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826059.092679:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826059.092683:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8120 00000100:00080000:0.0:1787826059.092685:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826059.092688:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826059.092700:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb349b6fb80 x1874663049239680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826059.092726:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826059.092729:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826059.092731:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826059.092734:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8120 00000100:00080000:0.0:1787826059.092736:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826059.092739:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826059.092748:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb349b6c700 x1874663049240064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826059.092781:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049239552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826059.092844:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826059.092906:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826059.092913:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049239296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826059.092936:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826059.092964:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049239552 00000100:00100000:0.0:1787826059.092971:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049239552 00000100:00100000:0.0:1787826059.093018:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049239296 00000100:00100000:0.0:1787826059.093021:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049239296 00000100:00100000:0.0:1787826059.093045:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1787826059.093418:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826059.093433:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787826059.093444:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049239296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826059.093495:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049239296:12345-0@lo:400:kworker.0 Request processed in 55us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826059.093502:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787826059.093572:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049239296:0@lo:400:kworker.0 00000100:00100000:2.0:1787826059.093587:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826059.093594:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049240192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826059.093624:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826059.093657:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049240192 00000100:00100000:2.0:1787826059.093662:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049240192 00000100:00100000:2.0:1787826059.093695:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5709 00000100:00100000:2.0:1787826059.093702:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049240192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826059.093724:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826059.093759:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049240192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826059.093765:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5709 00000100:00080000:2.0:1787826059.093786:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826059.093806:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049240192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826059.094454:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049239552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826059.094502:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049239552:12345-0@lo:400:kworker.0 Request processed in 1449us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826059.094509:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787826059.094718:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049239552:0@lo:400:kworker.0 00000100:00100000:1.0:1787826059.094836:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049239040:0@lo:400:kworker.0 00000400:00000100:1.0:1787826059.094863:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049239040 offset 0 length 224: 4 00000100:00100000:1.0:1787826059.094885:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049239936:0@lo:400:kworker.0 00000100:00100000:1.0:1787826059.094904:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826059.094927:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826059.094933:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049239808:0@lo:400:kworker.0 00000100:00100000:1.0:1787826059.094950:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826059.094984:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049239168:0@lo:38:kworker.0 00000100:00100000:1.0:1787826059.095010:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826059.095026:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049239424:0@lo:38:kworker.0 00000100:00100000:1.0:1787826059.095046:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826059.095064:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049239680:0@lo:38:kworker.0 00000100:00100000:1.0:1787826059.095089:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826059.095103:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb349b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049240064:0@lo:38:kworker.0 00000100:00100000:1.0:1787826059.095120:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826059.095145:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049239168 00000100:00100000:1.0:1787826059.095150:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049239168 00000100:00100000:1.0:1787826059.095171:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049239424 00000100:00100000:1.0:1787826059.095174:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049239424 00000100:00100000:1.0:1787826059.095182:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049240064 00000100:00100000:1.0:1787826059.095184:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049240064 00000100:00100000:1.0:1787826059.095194:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1787826059.095200:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049239168:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826059.095219:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826059.095249:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049239168:12345-0@lo:38:kworker.0 Request processed in 48us (239us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826059.095255:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1787826059.095268:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1787826059.095271:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049239424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826059.095280:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826059.095297:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049239424:12345-0@lo:38:kworker.0 Request processed in 24us (250us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826059.095302:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1787826059.095310:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1787826059.095313:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049240064:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826059.095321:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826059.095358:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049240064:12345-0@lo:38:kworker.0 Request processed in 43us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826059.095363:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00080000:1.0:1787826059.095402:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826059.095407:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826059.095411:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049239168:0@lo:38:kworker.0 00000100:00080000:1.0:1787826059.095419:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826059.095422:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826059.095425:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049239424:0@lo:38:kworker.0 00000100:00080000:1.0:1787826059.095432:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826059.095434:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826059.095436:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049240064:0@lo:38:kworker.0 00000100:00100000:1.0:1787826059.095729:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049240320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826059.095757:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826059.095923:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049239936 00000100:00100000:0.0:1787826059.095929:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049239936 00000100:00100000:0.0:1787826059.095969:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049239808 00000100:00100000:0.0:1787826059.095972:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049239808 00000100:00100000:0.0:1787826059.096004:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6928 00000100:00100000:0.0:1787826059.096011:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049239936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826059.096056:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049239936:12345-0@lo:400:kworker.0 Request processed in 46us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826059.096063:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6928 00000100:00100000:0.0:1787826059.096083:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6929 00000100:00100000:0.0:1787826059.096090:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049239808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826059.096117:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049239808:12345-0@lo:400:kworker.0 Request processed in 28us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826059.096123:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6929 00000100:00100000:0.0:1787826059.096150:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049239680 00000100:00100000:0.0:1787826059.096154:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049239680 00000100:00100000:0.0:1787826059.096175:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12598 00000100:00100000:0.0:1787826059.096179:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049239680:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826059.096193:0:177390:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826059.096222:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049239680:12345-0@lo:38:kworker.0 Request processed in 42us (1132us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826059.096228:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12598 00000100:00100000:0.0:1787826059.096262:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049239808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826059.096272:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049239936:0@lo:400:kworker.0 00000100:00080000:0.0:1787826059.096291:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826059.096295:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826059.096298:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049239680:0@lo:38:kworker.0 00000100:00080000:0.0:1787826059.096344:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826059.096904:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826059.103599:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049240320 00000100:00100000:2.0:1787826059.103614:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049240320 00000100:00100000:2.0:1787826059.103689:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5710 00000100:00100000:2.0:1787826059.103701:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049240320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826059.103736:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826059.103974:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049240320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 274us (8214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826059.103986:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5710 00000100:00100000:1.0:1787826059.104113:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049240320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826059.514521:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000400:00000100:2.0:1787826059.514616:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042955520 offset 0 length 224: 4 00000100:00100000:2.0:1787826059.514639:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826059.514679:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826059.514732:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042955904 00000100:00100000:3.0:1787826059.514742:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042955904 00000100:00080000:0.0:1787826059.514840:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826059.514980:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6930 00000100:00100000:3.0:1787826059.514997:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042955904:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826059.515317:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042955904:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 323us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826059.516402:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6930 00000100:00100000:2.0:1787826059.518537:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826059.519277:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042956032 00000100:00100000:3.0:1787826059.519286:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042956032 00000100:00100000:3.0:1787826059.519378:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22533 00000100:00100000:3.0:1787826059.519397:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2388:x1874663042956032:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:3.0:1787826059.519426:0:43896:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce97df 00000100:00080000:3.0:1787826059.519434:0:43896:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787826059.519475:0:43896:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975533 00000100:00100000:3.0:1787826059.519621:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9ce6693-0634-46c5-bf21-5ca7d026d44e+2:2388:x1874663042956032:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 234us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826059.519629:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22533 00010000:00010000:3.0:1787826059.519664:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826059.519881:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826059.521401:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042955648 00000100:00100000:1.0:1787826059.521401:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042955776 00000100:00100000:0.0:1787826059.521414:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042955648 00000100:00100000:1.0:1787826059.521415:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042955776 00000100:00100000:0.0:1787826059.521526:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 893 00000100:00100000:0.0:1787826059.521533:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2388:x1874663042955648:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:0.0:1787826059.521555:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826059.521613:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2388:x1874663042955648:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 78us (6932us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826059.521619:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 893 00000100:00080000:2.0:1787826059.521737:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826059.522377:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 85 00000100:00100000:1.0:1787826059.522399:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042955776:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826059.522583:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042955776:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 197us (8070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826059.522591:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 85 00010000:00010000:1.0:1787826060.116971:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826061.142145:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826062.165445:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826063.190098:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826064.212503:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826064.212519:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049240448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826064.212589:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826064.225224:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1787826064.225970:0:3620:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826048/real 1787826048] req@ffff8eb47a1ffb80 x1874663049236224/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826064 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826064.226542:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049240448 00000100:00100000:2.0:1787826064.226557:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049240448 00000100:00100000:2.0:1787826064.226625:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5711 00000100:00100000:2.0:1787826064.226649:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049240448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826064.226682:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142528 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826064.226773:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049240448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (14184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826064.226781:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5711 00000100:00100000:0.0:1787826064.226850:0:3620:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8eb47a1ffb80 x1874663049236224/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826064.226861:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787826064.227136:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787826064.227142:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.147@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787826064.227145:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787826064.227152:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb47a1ffb80 x1874663049236224/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826064.227158:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826064.227168:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb349b6df80 x1874663049237888/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826069 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826064.227181:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb349b6ce00 x1874663049239040/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826075 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787826064.227197:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00100000:2.0:1787826064.227201:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049237888:0@lo:400:kworker.0 00000100:00080000:0.0:1787826064.227202:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787826064.227205:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787826064.227211:0:3620:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1787826064.227237:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049236224:0@lo:400:kworker.0 00000100:00100000:2.0:1787826064.227242:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826064.227258:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049240576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826064.227304:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826064.227403:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049240448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826064.227414:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb349b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049239040:0@lo:400:kworker.0 00000100:00080000:3.0:1787826064.228920:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826064.228932:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787826064.228936:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826064.228945:0:185677:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8052 00000100:00080000:3.0:1787826064.228955:0:185677:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826064.229578:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b44e00 x1874663049240704/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826064.229622:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826064.229627:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826064.229629:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826064.229633:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8125 00000100:00080000:3.0:1787826064.229637:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826064.229642:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826064.229659:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b46300 x1874663049240832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826064.229691:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826064.229694:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826064.229706:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826064.229710:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8125 00000100:00080000:3.0:1787826064.229712:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826064.229716:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826064.229726:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b45c00 x1874663049241088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826064.229741:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826064.229745:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826064.229747:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826064.229750:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8125 00000100:00080000:3.0:1787826064.229752:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826064.229755:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826064.229765:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b47800 x1874663049241344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826064.229775:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826064.229779:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826064.229780:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826064.229783:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8125 00000100:00080000:3.0:1787826064.229785:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826064.229788:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826064.229796:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b44a80 x1874663049241472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826064.229832:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049240960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826064.230079:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049240704:0@lo:250:kworker.0 00000400:00000100:2.0:1787826064.230133:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049240704 offset 0 length 520: 4 00000100:00100000:2.0:1787826064.230168:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049240832:0@lo:38:kworker.0 00000100:00100000:2.0:1787826064.230198:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826064.230226:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049241088:0@lo:38:kworker.0 00000100:00100000:2.0:1787826064.230246:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826064.230269:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049241344:0@lo:38:kworker.0 00000100:00100000:2.0:1787826064.230297:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826064.230319:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049241472:0@lo:38:kworker.0 00000100:00100000:2.0:1787826064.230389:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826064.230432:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049241344 00000100:00100000:2.0:1787826064.230440:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049241344 00000100:00100000:2.0:1787826064.230475:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12599 00000100:00100000:2.0:1787826064.230482:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049241344:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826064.230502:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826064.230541:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049241344:12345-0@lo:38:kworker.0 Request processed in 58us (243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826064.230549:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12599 00000100:00080000:2.0:1787826064.230587:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826064.230592:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826064.230595:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049241344:0@lo:38:kworker.0 00000100:00100000:3.0:1787826064.231554:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826064.231605:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826064.231616:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049241216:0@lo:400:kworker.0 00000100:00100000:3.0:1787826064.231646:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826064.231687:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049240832 00000100:00100000:3.0:1787826064.231695:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049240832 00000100:00100000:3.0:1787826064.234349:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049241088 00000100:00100000:3.0:1787826064.234372:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049241088 00000100:00100000:3.0:1787826064.234386:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049241472 00000100:00100000:3.0:1787826064.234389:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049241472 00000100:00100000:3.0:1787826064.234398:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049240960 00000100:00100000:3.0:1787826064.234401:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049240960 00000100:00100000:0.0:1787826064.236146:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049240576 00000100:00100000:0.0:1787826064.236163:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049240576 00000100:00100000:0.0:1787826064.236254:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5712 00000100:00100000:0.0:1787826064.236270:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049240576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826064.236315:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826064.236446:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049241216 00000100:00100000:3.0:1787826064.236452:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049241216 00000100:00100000:3.0:1787826064.236476:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787826064.236485:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049240960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826064.236606:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049240960:12345-0@lo:400:kworker.0 Request processed in 123us (5059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826064.236622:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787826064.236642:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787826064.236649:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049241216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826064.236679:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049241216:12345-0@lo:400:kworker.0 Request processed in 31us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826064.236684:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787826064.236696:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1787826064.236701:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049240832:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826064.236723:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826064.236774:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049240832:12345-0@lo:38:kworker.0 Request processed in 71us (6575us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826064.236780:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1787826064.236792:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1787826064.236796:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049241088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826064.236805:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826064.236829:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049241088:12345-0@lo:38:kworker.0 Request processed in 31us (6581us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826064.236835:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1787826064.236847:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1787826064.236852:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049241472:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826064.236863:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826064.236891:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049241472:12345-0@lo:38:kworker.0 Request processed in 37us (6502us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826064.236896:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1787826064.236963:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049241216:0@lo:400:kworker.0 00000100:00100000:3.0:1787826064.236977:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049240960:0@lo:400:kworker.0 00000100:00080000:2.0:1787826064.237276:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826064.237290:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826064.237295:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049240832:0@lo:38:kworker.0 00000100:00080000:2.0:1787826064.237309:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826064.237312:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826064.237315:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049241088:0@lo:38:kworker.0 00000100:00080000:2.0:1787826064.237351:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826064.237366:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826064.237369:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049241472:0@lo:38:kworker.0 00000100:00100000:0.0:1787826064.240111:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049240576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3832us (12793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826064.240128:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5712 00000100:00080000:0.0:1787826064.240204:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826064.240212:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826064.241280:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049240576:0@lo:13:osp-pre-0-1.0 00000400:00000100:3.0:1787826064.637795:0:3611:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042956160 offset 0 length 224: 4 00000100:00100000:3.0:1787826064.637847:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826064.637879:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826064.638124:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042956544 00000100:00100000:2.0:1787826064.638140:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042956544 00000100:00100000:2.0:1787826064.638225:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6931 00000100:00100000:2.0:1787826064.638236:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042956544:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826064.638316:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042956544:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 81us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826064.638346:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6931 00000100:00080000:2.0:1787826064.638383:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826064.639064:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826064.653705:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042956416 00000100:00100000:0.0:1787826064.653728:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042956416 00000100:00100000:0.0:1787826064.653860:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042956288 00000100:00100000:0.0:1787826064.653865:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042956288 00000100:00100000:0.0:1787826064.653906:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:0.0:1787826064.653920:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042956416:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826064.654049:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042956416:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 131us (16167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826064.654058:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:0.0:1787826064.654084:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 897 00000100:00100000:0.0:1787826064.654090:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663042956288:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:0.0:1787826064.654115:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826064.654147:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663042956288:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 55us (15088us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826064.654154:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 897 00000100:00080000:3.0:1787826064.654282:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787826065.244077:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787826065.247365:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:3.0:1787826065.247374:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb348a3e000/a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:0.0:1787826065.247566:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a3e000/a9ce6693-0634-46c5-bf21-5ca7d026d44e for lustre-OST0001 00000020:00000080:0.0:1787826065.247621:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb348a3c000 for lustre-OST0001 00000400:00000100:2.0:1787826065.663368:0:3612:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042956672 offset 0 length 520: 4 00000100:00100000:2.0:1787826065.663426:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826065.663459:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826065.663583:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826065.663616:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042957056 00000100:00100000:2.0:1787826065.663629:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042957056 00000100:00100000:2.0:1787826065.663695:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6932 00000100:00100000:2.0:1787826065.663707:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042957056:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826065.663794:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042957056:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826065.663803:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6932 00000100:00100000:0.0:1787826065.664732:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042956800 00000100:00100000:1.0:1787826065.664732:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042956928 00000100:00100000:0.0:1787826065.664742:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042956800 00000100:00100000:1.0:1787826065.664742:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042956928 00000100:00100000:0.0:1787826065.664792:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 89 00000100:00100000:1.0:1787826065.664797:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 898 00000100:00100000:0.0:1787826065.664802:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042956928:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826065.664802:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663042956800:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:1.0:1787826065.664827:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826065.667910:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042956928:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 3091us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826065.667927:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 89 00000100:00100000:1.0:1787826065.668178:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663042956800:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 3371us (4749us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826065.668187:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 898 00010000:00010000:3.0:1787826066.263538:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826067.284550:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826068.309028:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826069.333292:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826069.333307:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049241600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826069.333397:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826069.333466:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049241600 00000100:00100000:2.0:1787826069.333473:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049241600 00000100:00100000:2.0:1787826069.333528:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5713 00000100:00100000:2.0:1787826069.333537:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049241600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826069.333565:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826069.333607:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049241600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826069.333627:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5713 00000100:00080000:2.0:1787826069.333655:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826069.333668:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049241728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826069.333693:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826069.333729:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049241600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826069.333756:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049241728 00000100:00100000:2.0:1787826069.333759:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049241728 00000100:00100000:2.0:1787826069.333786:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5714 00000100:00100000:2.0:1787826069.333791:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049241728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826069.333806:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142528 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826069.333838:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049241728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826069.333843:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5714 00000100:00080000:2.0:1787826069.333858:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826069.333878:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049241728:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826069.334133:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826069.334752:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826069.334758:0:188541:0:(pinger.c:247:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787826069.334761:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826069.334764:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826069.334768:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826069.334774:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8131 00000100:00080000:3.0:1787826069.334778:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826069.334783:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826069.334806:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b46300 x1874663049241856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826069.334846:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826069.334850:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826069.334851:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826069.334854:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8131 00000100:00080000:3.0:1787826069.334858:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826069.334861:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826069.334872:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b45c00 x1874663049242112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826069.334886:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826069.334889:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826069.334890:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826069.334893:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8131 00000100:00080000:3.0:1787826069.334895:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826069.334898:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826069.334908:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481109c00 x1874663049242368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826069.334917:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826069.334919:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826069.334920:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826069.334923:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8131 00000100:00080000:3.0:1787826069.334925:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826069.334928:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826069.334937:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb48110aa00 x1874663049242496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826069.335046:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049241856:0@lo:38:kworker.0 00000100:00100000:0.0:1787826069.335109:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826069.335134:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049242112:0@lo:38:kworker.0 00000100:00100000:0.0:1787826069.335153:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826069.335170:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049242368:0@lo:38:kworker.0 00000100:00100000:0.0:1787826069.335193:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826069.335243:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049241984:0@lo:400:kworker.0 00000100:00100000:0.0:1787826069.335245:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049241856 00000100:00100000:0.0:1787826069.335250:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049241856 00000100:00100000:1.0:1787826069.335273:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826069.335274:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049242112 00000100:00100000:0.0:1787826069.335277:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049242112 00000100:00100000:0.0:1787826069.335290:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049241984 00000100:00100000:0.0:1787826069.335293:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049241984 00000100:00100000:1.0:1787826069.335294:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826069.335299:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049242240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826069.335347:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826069.335355:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049242240 00000100:00100000:0.0:1787826069.335358:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049242240 00000100:00100000:1.0:1787826069.335371:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787826069.335379:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049241984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826069.335383:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787826069.335388:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049242240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826069.335421:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049241984:12345-0@lo:400:kworker.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826069.335428:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787826069.335447:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1787826069.335451:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049241856:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826069.335469:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826069.335502:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049241856:12345-0@lo:38:kworker.0 Request processed in 49us (393us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826069.335508:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1787826069.335521:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1787826069.335525:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049242112:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826069.335534:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826069.335557:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049242112:12345-0@lo:38:kworker.0 Request processed in 31us (402us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826069.335562:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1787826069.336904:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049242240:12345-0@lo:400:kworker.0 Request processed in 1512us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826069.336915:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787826069.337066:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049242368 00000100:00100000:0.0:1787826069.337073:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049242368 00000100:00100000:0.0:1787826069.337176:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12600 00000100:00100000:0.0:1787826069.337182:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049242368:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826069.337261:0:177390:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826069.337446:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049242368:12345-0@lo:38:kworker.0 Request processed in 262us (2250us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826069.337453:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12600 00000100:00080000:0.0:1787826069.337477:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826069.338653:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049242496:0@lo:38:kworker.0 00000100:00100000:0.0:1787826069.338710:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826069.338774:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826069.338779:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826069.338783:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049241856:0@lo:38:kworker.0 00000100:00080000:0.0:1787826069.338794:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826069.338798:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826069.338800:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049242112:0@lo:38:kworker.0 00000100:00080000:0.0:1787826069.338810:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826069.338814:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826069.338817:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049242368:0@lo:38:kworker.0 00000100:00100000:1.0:1787826069.342170:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049242240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826069.342206:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049242496 00000100:00100000:1.0:1787826069.342214:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049242496 00000100:00100000:0.0:1787826069.342246:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049241984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826069.342276:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1787826069.342283:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049242496:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826069.342306:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826069.342413:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049242496:12345-0@lo:38:kworker.0 Request processed in 129us (3703us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826069.342421:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00080000:0.0:1787826069.342502:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826069.342508:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826069.342512:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049242496:0@lo:38:kworker.0 00010000:00010000:3.0:1787826070.356731:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826070.784809:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826070.784857:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826070.784897:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826070.784931:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042957312 00000100:00100000:1.0:1787826070.785012:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042957184 00000100:00100000:1.0:1787826070.785024:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042957184 00000100:00100000:1.0:1787826070.785077:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 902 00000100:00100000:1.0:1787826070.785087:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042957184:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:1.0:1787826070.785121:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826070.785201:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042957184:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 114us (303us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826070.785209:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 902 00000100:00100000:0.0:1787826070.785465:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042957312 00000100:00100000:0.0:1787826070.786726:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 92 00000100:00100000:0.0:1787826070.786745:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042957312:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826070.786828:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042957312:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 90us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826070.786836:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 92 00000100:00080000:0.0:1787826070.786878:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826070.791156:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042957440 00000100:00100000:3.0:1787826070.791180:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042957440 00000100:00100000:3.0:1787826070.791548:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6933 00000100:00100000:3.0:1787826070.791563:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042957440:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826070.791856:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042957440:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 295us (6995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826070.791865:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6933 00000100:00080000:0.0:1787826070.805474:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826071.390508:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826071.643775:0:190344:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787826071.643783:0:190344:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787826071.643785:0:190344:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787826071.643934:0:190344:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8eb3422b3000 00000020:01000004:2.0:1787826071.643955:0:190344:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787826071.643972:0:190344:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787826071.643990:0:190344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8eb3449f19b8) 00000020:00000080:2.0:1787826071.644010:0:190344:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787826071.916729:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787826071.922467:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787826071.924552:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787826071.925432:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787826071.925734:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787826071.926228:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787826071.926566:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787826071.927234:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787826071.927727:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787826071.928392:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787826071.928608:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787826071.929103:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787826071.929421:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787826071.929706:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787826071.939576:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787826071.943520:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.943851:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.944346:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.944651:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.945080:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.945375:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.945797:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.946207:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.946501:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.946871:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.947215:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.947730:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.948178:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.948708:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.949080:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.949368:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.949576:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.950550:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.950967:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.951374:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.951587:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.951944:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.952464:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.952739:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.953146:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.953560:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.954061:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.954374:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.954568:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.954921:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.955173:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787826071.955539:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787826071.956471:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787826071.957084:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787826071.957361:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787826071.957856:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787826071.958151:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787826071.958469:0:190344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1787826071.959557:0:190344:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787826071.961138:0:190344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787826071.961147:0:190344:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787826071.961160:0:190344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ceca2f 00000020:01000004:2.0:1787826071.961168:0:190344:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787826071.961179:0:190344:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787826071.961184:0:190344:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb3422b3000 from MGS 00000020:01000004:2.0:1787826071.961188:0:190344:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787826071.961199:0:190344:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8eb3449f0000) 00000020:00000080:2.0:1787826071.961210:0:190344:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787826071.961283:0:190344:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb3422b3000 from MGS, refs=2 00080000:01000000:2.0:1787826071.961288:0:190344:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787826071.961294:0:190344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ceca3d 00010000:00010000:2.0:1787826071.961459:0:190344:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1787826071.978568:0:190344:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787826071.984369:0:190349:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787826071.984618:0:190344:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787826071.984691:0:190344:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787826071.992308:0:190344:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787826071.992599:0:190344:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787826071.992791:0:190344:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787826071.992797:0:190344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787826072.002529:0:190344:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787826072.002544:0:190344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787826072.008577:0:190344:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787826072.008589:0:190344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787826072.009394:0:190344:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787826072.009422:0:190344:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1787826072.009424:0:190344:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1787826072.009428:0:190344:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1787826072.009433:0:190344:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 360, was 0): CONNECTING 00000100:00100000:3.0:1787826072.009438:0:190344:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:1.0:1787826072.404970:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826073.428732:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00020000:3.0:1787826074.069093:0:190344:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) 00000100:00020000:3.0:1787826074.085150:0:190344:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff8eb481b44e00 x1874663049240704/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787826074 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00020000:3.0:1787826074.117490:0:190344:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. 00000100:00100000:3.0:1787826074.136399:0:190344:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787826074.452449:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826074.452458:0:179516:0:(pinger.c:247:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787826074.452461:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826074.452464:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826074.452468:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826074.452477:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8136 00000100:00080000:2.0:1787826074.452481:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826074.452487:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826074.452510:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348e5fb80 x1874663049242624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826074.452532:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:3.0:1787826074.452533:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826074.452536:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826074.452537:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826074.452541:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8136 00000100:00080000:2.0:1787826074.452543:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826074.452547:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826074.452557:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348e5d500 x1874663049243008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826074.452587:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826074.452590:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826074.452592:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826074.452595:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8136 00000100:00080000:2.0:1787826074.452597:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826074.452600:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826074.452613:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348e5dc00 x1874663049243264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826074.452632:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826074.452635:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826074.452637:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826074.452639:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8136 00000100:00080000:2.0:1787826074.452641:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826074.452646:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826074.452659:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f6c1500 x1874663049243648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826074.452760:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049242752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826074.452825:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.452883:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049243520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826074.452909:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.452965:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049242752 00000100:00100000:2.0:1787826074.452972:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049242752 00000100:00100000:3.0:1787826074.453024:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049243136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826074.453054:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.453077:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826074.453083:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049243392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826074.453119:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049243136 00000100:00100000:3.0:1787826074.453123:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049243136 00000100:00100000:0.0:1787826074.456545:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826064/real 1787826064] req@ffff8eb481b44e00 x1874663049240704/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826074 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826074.456578:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8eb481b44e00 x1874663049240704/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826074 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826074.456601:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049242624:0@lo:38:kworker.0 00000100:00100000:0.0:1787826074.458427:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.458487:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049243008:0@lo:38:kworker.0 00000100:00100000:0.0:1787826074.458720:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.458747:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049243264:0@lo:38:kworker.0 00000100:00100000:0.0:1787826074.458775:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.458801:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049243648:0@lo:38:kworker.0 00000100:00100000:0.0:1787826074.458825:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826074.458844:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826074.458859:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787826074.458871:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049240704:0@lo:250:kworker.0 00000100:00100000:0.0:1787826074.458918:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049242624 00000100:00100000:0.0:1787826074.458925:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049242624 00000100:00100000:0.0:1787826074.458955:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049243008 00000100:00100000:0.0:1787826074.458958:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049243008 00000100:00100000:0.0:1787826074.458967:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049243648 00000100:00100000:0.0:1787826074.458969:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049243648 00000100:00100000:0.0:1787826074.458982:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1787826074.458989:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049242624:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826074.459009:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826074.459053:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049242624:12345-0@lo:38:kworker.0 Request processed in 62us (632us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826074.459060:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1787826074.459078:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1787826074.459082:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049243008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826074.459092:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826074.459116:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049243008:12345-0@lo:38:kworker.0 Request processed in 32us (396us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826074.459122:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1787826074.459133:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1787826074.463250:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787826074.463269:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049242880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826074.463359:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.463375:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049243776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826074.463401:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.463460:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.463498:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049243520 00000100:00100000:1.0:1787826074.463518:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049243520 00000100:00100000:1.0:1787826074.463562:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049243392 00000100:00100000:1.0:1787826074.463566:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049243392 00000100:00100000:0.0:1787826074.463637:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049243648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826074.463663:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826074.463707:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049243648:12345-0@lo:38:kworker.0 Request processed in 4568us (4881us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826074.463720:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1787826074.463739:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049242880 00000100:00100000:0.0:1787826074.463743:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049242880 00000100:00100000:2.0:1787826074.466066:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049243776 00000100:00100000:2.0:1787826074.466078:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049243776 00000100:00100000:2.0:1787826074.466131:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5715 00000100:00100000:2.0:1787826074.466154:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049243776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826074.466188:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826074.466266:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049243776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.466273:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5715 00000100:00100000:2.0:1787826074.466349:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5716 00000100:00100000:2.0:1787826074.466363:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049242752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826074.466379:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142528 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826074.466414:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049242752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (13590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.466420:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5716 10000000:01000000:2.0:1787826074.466461:0:190344:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1787826074.466475:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e800/0x878a5eea00ce7311 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce7318 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.466486:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e800/0x878a5eea00ce7311 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce7318 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.466492:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1787826074.469129:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787826074.469146:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049243136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826074.469240:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049243136:12345-0@lo:400:kworker.0 Request processed in 100us (16184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826074.469247:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787826074.469312:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049243136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826074.469401:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049243264 00000100:00100000:3.0:1787826074.469408:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049243264 00000100:00100000:3.0:1787826074.469432:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12601 00000100:00100000:3.0:1787826074.469437:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049243264:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826074.469456:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826074.469493:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049243264:12345-0@lo:38:kworker.0 Request processed in 55us (10718us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826074.469500:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12601 00000100:00080000:3.0:1787826074.469525:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826074.469529:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787826074.469532:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826074.469537:0:179516:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8131 00000100:00080000:3.0:1787826074.469541:0:179516:0:(import.c:589:import_select_connection()) MGC192.168.203.147@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826074.469545:0:179516:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826074.469570:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481109c00 x1874663049243904/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826074.469834:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826074.469840:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826074.469842:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826074.469863:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6934 00000100:00100000:3.0:1787826074.469874:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049243520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826074.469984:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049243520:12345-0@lo:400:kworker.0 Request processed in 112us (17073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826074.469991:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6934 00000100:00100000:1.0:1787826074.470004:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6935 00000100:00100000:1.0:1787826074.470012:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049243392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826074.470054:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049243392:12345-0@lo:400:kworker.0 Request processed in 43us (6593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.470745:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787826074.470849:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049242880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826074.470898:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049242880:12345-0@lo:400:kworker.0 Request processed in 145us (7539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.470904:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787826074.470981:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049242880:0@lo:400:kworker.0 00000100:00100000:0.0:1787826074.471003:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049243776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826074.471020:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049242752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826074.471029:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049243520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826074.471095:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049243392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826074.471103:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6935 00000100:00020000:0.0:1787826074.471128:0:3616:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8eb481109c00 x1874663049243904/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826074.473792:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.473811:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e800/0x878a5eea00ce7311 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce7318 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.473866:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34252e000/0x878a5eea00ce71c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce71c8 expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.473875:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34252e000/0x878a5eea00ce71c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce71c8 expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.473880:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.473902:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.473907:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34252e000/0x878a5eea00ce71c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce71c8 expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.473922:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ce7277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce727e expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.473928:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ce7277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce727e expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.473934:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.473937:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.473940:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ce7277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce727e expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.473948:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481715400/0x878a5eea00ce72bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce72c4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.473954:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481715400/0x878a5eea00ce72bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce72c4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.473959:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.473962:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.473965:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481715400/0x878a5eea00ce72bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce72c4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.473973:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ce72cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce72d2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.474227:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ce72cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce72d2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.474233:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.474238:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.474242:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ce72cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce72d2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.474252:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e400/0x878a5eea00ce72e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce72ee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.474259:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e400/0x878a5eea00ce72e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce72ee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.474263:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.474267:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.474270:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e400/0x878a5eea00ce72e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce72ee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.474278:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34252f400/0x878a5eea00ce72f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce72fc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.474294:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34252f400/0x878a5eea00ce72f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce72fc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.474299:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.474302:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.474305:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34252f400/0x878a5eea00ce72f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce72fc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.474313:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34252fa00/0x878a5eea00ce731f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce7326 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.474319:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34252fa00/0x878a5eea00ce731f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce7326 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.474359:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.474362:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.474366:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34252fa00/0x878a5eea00ce731f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce7326 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.474379:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ee00/0x878a5eea00ce72a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce72a8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.474386:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ee00/0x878a5eea00ce72a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce72a8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.474391:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.474394:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.474398:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb46e31ee00/0x878a5eea00ce72a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce72a8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.474410:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34252e600/0x878a5eea00ce71b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce71ba expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.474417:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34252e600/0x878a5eea00ce71b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce71ba expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.474423:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826074.474426:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.474429:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34252e600/0x878a5eea00ce71b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce71ba expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.474440:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481714400/0x878a5eea00ce7269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce7270 expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.474451:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481714400/0x878a5eea00ce7269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce7270 expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.474457:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787826074.474460:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.474463:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481714400/0x878a5eea00ce7269 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce7270 expref: -99 pid: 187893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.474471:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e000/0x878a5eea00ce72d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce72e0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.474476:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e000/0x878a5eea00ce72d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce72e0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.474481:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787826074.474483:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.474486:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb46e31e000/0x878a5eea00ce72d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce72e0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.474494:0:190344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34252e200/0x878a5eea00ce7303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ce730a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826074.475434:0:190344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34252e200/0x878a5eea00ce7303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ce730a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826074.475447:0:190344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787826074.475454:0:190344:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826074.475463:0:190344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34252e200/0x878a5eea00ce7303 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ce730a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826074.493783:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826074.493810:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1787826074.493816:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:0:1874663049243904:0@lo:250:kworker.0 00000100:00080000:3.0:1787826074.496160:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826074.496170:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787826074.496174:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826074.496182:0:179516:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8141 00000100:00080000:3.0:1787826074.496188:0:179516:0:(import.c:589:import_select_connection()) MGC192.168.203.147@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826074.496194:0:179516:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826074.496224:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb48110aa00 x1874663049244032/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826074.496294:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826074.496299:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826074.496303:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049242624:0@lo:38:kworker.0 00000100:00080000:3.0:1787826074.496315:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826074.496318:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826074.496321:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049243008:0@lo:38:kworker.0 00000100:00080000:3.0:1787826074.500935:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826074.500945:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826074.500950:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049243264:0@lo:38:kworker.0 00000100:00080000:3.0:1787826074.500963:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826074.500967:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826074.500970:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049243648:0@lo:38:kworker.0 00000100:00100000:3.0:1787826074.501013:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049244032:0@lo:250:kworker.0 00000100:00100000:3.0:1787826074.501076:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.501220:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049244032 00000100:00100000:0.0:1787826074.501227:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049244032 00000100:00100000:0.0:1787826074.501269:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826074.501277:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1874663049244032:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1787826074.501314:0:190351:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 205ad83e-e455-4070-92a2-f1e25b8f3f40@0@lo t0 exp 0000000000000000 cur 8141 last 0 00000020:00000080:0.0:1787826074.501365:0:190351:0:(genops.c:1385:class_connect()) connect: client 205ad83e-e455-4070-92a2-f1e25b8f3f40, cookie 0x878a5eea00ceca44 00000100:00080000:2.0:1787826074.501407:0:190344:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 362, was 0): CONNECTING 00000100:00080000:2.0:1787826074.501413:0:190344:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:0.0:1787826074.501510:0:190351:0:(import.c:65:import_set_state_nolock()) ffff8eb4727dc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826074.501574:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+5:3616:x1874663049244032:12345-0@lo:250:kworker.0 Request processed in 296us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.501582:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826074.501665:0:3616:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.147@tcp: committing for last_committed 0 gen 79 00000100:00080000:2.0:1787826074.501672:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.147@tcp: connect to target with instance 0 00000100:00080000:2.0:1787826074.501679:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787826074.501683:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787826074.501686:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787826074.501688:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787826074.501717:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787826074.501725:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049244032:0@lo:250:kworker.0 00000020:01000000:0.0:1787826074.501797:0:179516:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.147@tcp 10000000:01000000:0.0:1787826074.501816:0:179516:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1787826074.501819:0:179516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787826074.501821:0:179516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787826074.501822:0:179516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826074.501824:0:179516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826074.501825:0:179516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826074.501827:0:179516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826074.501828:0:179516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826074.501830:0:179516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826074.501831:0:179516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787826074.501891:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049244160:0@lo:253:kworker.0 00000100:00100000:2.0:1787826074.501936:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826074.502015:0:190344:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1787826074.502024:0:190344:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787826074.502066:0:190344:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787826074.502071:0:190344:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787826074.502177:0:190344:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787826074.502203:0:190344:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787826074.502206:0:190344:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787826074.502207:0:190344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787826074.502208:0:190344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826074.502209:0:190344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826074.502210:0:190344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826074.502211:0:190344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826074.502212:0:190344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826074.502213:0:190344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787826074.502215:0:190344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826074.502216:0:190344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787826074.502218:0:190344:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787826074.502220:0:190344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787826074.502221:0:190344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787826074.502222:0:190344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826074.502223:0:190344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826074.502225:0:190344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826074.502226:0:190344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826074.502226:0:190344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826074.502228:0:190344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787826074.502229:0:190344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826074.502230:0:190344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787826074.502245:0:190344:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787826074.502256:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049244288:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787826074.502299:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.502351:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049244160 00000100:00100000:3.0:1787826074.502356:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049244160 00000100:00100000:3.0:1787826074.502388:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049244288 00000100:00100000:3.0:1787826074.502391:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049244288 00000100:00100000:3.0:1787826074.502402:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826074.502408:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+6:3619:x1874663049244160:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1787826074.502428:0:190351:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1787826074.502548:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787826074.502555:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+6:190344:x1874663049244288:12345-0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787826074.502582:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99c00 going to sleep for 11 seconds 10000000:01000000:3.0:1787826074.502617:0:190354:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787826074.502671:0:190351:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 323 00000020:01000000:0.0:1787826074.503169:0:179516:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1787826074.503180:0:179516:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1787826074.503182:0:179516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787826074.503184:0:179516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826074.503185:0:179516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826074.503187:0:179516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826074.503188:0:179516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826074.503189:0:179516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826074.503191:0:179516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826074.503192:0:179516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826074.503193:0:179516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787826074.503273:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049244416:0@lo:253:kworker.0 00000100:00100000:3.0:1787826074.503344:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787826074.506201:0:179516:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1787826074.506221:0:179516:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1787826074.506224:0:179516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787826074.506226:0:179516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787826074.506227:0:179516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826074.506228:0:179516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826074.506229:0:179516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826074.506230:0:179516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826074.506232:0:179516:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826074.506233:0:179516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826074.506235:0:179516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787826074.506303:0:179516:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1787826074.506315:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049244544:0@lo:253:kworker.0 00000100:00100000:0.0:1787826074.506375:0:190353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1787826074.506383:0:190353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1787826074.506475:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.506494:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049244416 00000100:00100000:0.0:1787826074.506501:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049244416 00000100:00100000:0.0:1787826074.506626:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049244544 00000100:00100000:0.0:1787826074.506638:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049244544 00000100:00100000:0.0:1787826074.506791:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826074.506801:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3620:x1874663049244416:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787826074.506831:0:190355:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787826074.535225:0:190356:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787826074.535236:0:190356:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787826074.535240:0:190356:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787826074.535243:0:190356:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787826074.535833:0:190356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787826074.536070:0:190351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787826074.536097:0:190351:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787826074.537666:0:190351:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787826074.537677:0:190351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787826074.537695:0:190354:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826074.537701:0:190354:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826074.537724:0:190354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537740:0:190354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826074.537750:0:190354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050430s 00010000:00010000:2.0:1787826074.537754:0:190354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537761:0:190354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537768:0:190354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537775:0:190354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537781:0:190354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826074.537786:0:190354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537794:0:190354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537805:0:190354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537812:0:190354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.537818:0:190354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf38200/0x878a5eea00ceca4b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787826074.538042:0:190352:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787826074.538152:0:190355:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787826074.538262:0:190352:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787826074.538268:0:190352:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1787826074.538275:0:190352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787826074.538471:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3619:x1874663049244160:12345-0@lo:253:kworker.0 Request processed in 36059us (36531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.538486:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826074.538528:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787826074.538544:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3617:x1874663049244544:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1787826074.538572:0:190351:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:3.0:1787826074.538593:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787826074.538596:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787826074.538597:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826074.538599:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826074.538600:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826074.538601:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826074.538603:0:3619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826074.538605:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826074.538606:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787826074.538610:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049244160:0@lo:253:kworker.0 20000000:01000000:1.0:1787826074.545452:0:190355:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787826074.545469:0:190355:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787826074.545525:0:190351:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787826074.545599:0:190354:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826074.545606:0:190354:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826074.545631:0:190354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545649:0:190354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826074.545660:0:190354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055991s 00010000:00010000:3.0:1787826074.545664:0:190354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545671:0:190354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545678:0:190354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545686:0:190354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545693:0:190354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826074.545697:0:190354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545706:0:190354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545719:0:190354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545727:0:190354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.545737:0:190354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34ab18800/0x878a5eea00ceca52 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826074.547764:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3620:x1874663049244416:12345-0@lo:253:kworker.0 Request processed in 40954us (44409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.547783:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1787826074.547988:0:3620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787826074.547992:0:3620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826074.547993:0:3620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826074.547994:0:3620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826074.547995:0:3620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826074.547997:0:3620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826074.547998:0:3620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826074.548000:0:3620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826074.548001:0:3620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787826074.548005:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049244416:0@lo:253:kworker.0 00000100:00100000:0.0:1787826074.548505:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+6:190344:x1874663049244288:12345-0@lo:253:mount.lustre.0 Request processed in 45949us (46204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.548514:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787826074.548709:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049244288:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787826074.548721:0:190344:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787826074.548723:0:190344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787826074.548725:0:190344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787826074.548726:0:190344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826074.548727:0:190344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826074.548728:0:190344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826074.548729:0:190344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826074.548730:0:190344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826074.548731:0:190344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787826074.548733:0:190344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826074.548734:0:190344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787826074.548762:0:190344:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb3422b3000 from lustre-MDT0000 10000000:01000000:3.0:1787826074.548793:0:190344:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787826074.548795:0:190344:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787826074.548804:0:190344:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8eb3422b3000 10000000:01000000:3.0:1787826074.548807:0:190344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787826074.548812:0:190344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8eb3422b3000 10000000:01000000:3.0:1787826074.548814:0:190344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787826074.548818:0:190344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb3422b3000 from 1 10000000:01000000:3.0:1787826074.548820:0:190344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787826074.548859:0:190344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.548868:0:190344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.548882:0:190344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826074.548901:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049244672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826074.548950:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.548986:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.549225:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049244672 00000100:00100000:0.0:1787826074.549233:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049244672 00000100:00100000:0.0:1787826074.549277:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787826074.549295:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+6:190344:x1874663049244672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826074.549308:0:190353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826074.549354:0:190353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ed400/0x878a5eea00ceca60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceca59 expref: -99 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.549377:0:190353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ed400/0x878a5eea00ceca60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceca59 expref: 7 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.549388:0:190353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ed400/0x878a5eea00ceca60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceca59 expref: 7 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.549396:0:190353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed400, rc 0) 00000100:00100000:0.0:1787826074.549432:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:190344:x1874663049244672:12345-0@lo:101:mount.lustre.0 Request processed in 138us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.549438:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787826074.550920:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049244672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826074.550957:0:190344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.550969:0:190344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826074.550985:0:190344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787826074.551001:0:190344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.551008:0:190344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826074.551016:0:190344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787826074.551022:0:190344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787826074.551029:0:190344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8eb3422b3000 10000000:01000000:3.0:1787826074.551032:0:190344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787826074.551035:0:190344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787826074.551038:0:190344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787826074.551066:0:190344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.551075:0:190344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.551084:0:190344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826074.551102:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049244800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826074.551154:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.551891:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99c00 going to sleep for 11 seconds 20000000:01000000:2.0:1787826074.553607:0:190351:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826074.553628:0:190351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787826074.553734:0:190354:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826074.553739:0:190354:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826074.553761:0:190354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553776:0:190354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826074.553785:0:190354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055991s 00010000:00010000:3.0:1787826074.553790:0:190354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553797:0:190354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553804:0:190354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553811:0:190354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553821:0:190354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826074.553825:0:190354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553832:0:190354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553845:0:190354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553858:0:190354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.553864:0:190354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34ab19e00/0x878a5eea00ceca6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826074.554002:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+6:3617:x1874663049244544:12345-0@lo:253:kworker.0 Request processed in 15462us (47523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.554011:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787826074.554048:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049244800 00000100:00100000:2.0:1787826074.554055:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049244800 00000020:01000004:3.0:1787826074.554134:0:3617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787826074.554136:0:3617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787826074.554138:0:3617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826074.554139:0:3617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826074.554140:0:3617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826074.554142:0:3617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826074.554143:0:3617:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826074.554145:0:3617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826074.554147:0:3617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787826074.554150:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049244544:0@lo:253:kworker.0 00000100:00100000:0.0:1787826074.554875:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826074.554892:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+6:190344:x1874663049244800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826074.554908:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826074.554925:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724edc00/0x878a5eea00ceca75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceca67 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.556506:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724edc00/0x878a5eea00ceca75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceca67 expref: 7 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.556523:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724edc00/0x878a5eea00ceca75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceca67 expref: 7 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.556533:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724edc00, rc 0) 00000100:00100000:0.0:1787826074.556616:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:190344:x1874663049244800:12345-0@lo:101:mount.lustre.0 Request processed in 1729us (5461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.556624:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787826074.556641:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049244800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826074.556660:0:190344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.556669:0:190344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826074.556746:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049244928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826074.556793:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.556833:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.556889:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049244928 00000100:00100000:1.0:1787826074.556895:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049244928 00000100:00100000:1.0:1787826074.556935:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787826074.556944:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:190344:x1874663049244928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826074.557082:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:190344:x1874663049244928:12345-0@lo:501:mount.lustre.0 Request processed in 138us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.557092:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787826074.557403:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049244928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826074.557451:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049245056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826074.557495:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.557515:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.557564:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049245056 00000100:00100000:1.0:1787826074.557568:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049245056 00000100:00100000:1.0:1787826074.557597:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787826074.557604:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:190344:x1874663049245056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826074.558779:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:190344:x1874663049245056:12345-0@lo:503:mount.lustre.0 Request processed in 1169us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.558791:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826074.560872:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049245056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826074.567559:0:190357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190357:1874663049245184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826074.567642:0:190357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.567726:0:190357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.572359:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049245184 00000100:00100000:0.0:1787826074.572373:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049245184 00000100:00100000:0.0:1787826074.572429:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826074.572439:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:190357:x1874663049245184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826074.574263:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:190357:x1874663049245184:12345-0@lo:502:llog_process_th.0 Request processed in 1817us (6613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.574276:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787826074.575980:0:190357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190357:1874663049245184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787826074.576158:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826074.576172:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826074.576174:0:190357:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787826074.576179:0:190357:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787826074.576182:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826074.576198:0:190357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8eb343ea19b8) 00000020:00000080:1.0:1787826074.576225:0:190357:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1787826074.576232:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787826074.576461:0:190357:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787826074.576470:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ceca83 00000020:00000080:1.0:1787826074.576682:0:190357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787826074.576687:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826074.576691:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826074.576692:0:190357:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787826074.576695:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826074.576699:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826074.576700:0:190357:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787826074.576703:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826074.576710:0:190357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8eb343ea3370) 00000020:00000080:1.0:1787826074.576723:0:190357:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1787826074.576727:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787826074.576729:0:190357:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787826074.576732:0:190357:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787826074.576739:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826074.576785:0:190357:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb3422b3000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787826074.576797:0:190357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8eb343ea4d28) 00000020:00000080:1.0:1787826074.576807:0:190357:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1787826074.576863:0:190357:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787826074.576869:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ceca98 00000020:00000080:1.0:1787826074.576957:0:190357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787826074.576963:0:190357:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787826074.576968:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x878a5eea00ceca9f 00080000:01000000:1.0:1787826074.576973:0:190357:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787826074.576975:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecaa6 00010000:00010000:2.0:1787826074.706274:0:190357:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1787826074.706439:0:190357:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: a9ce6693-0634-46c5-bf21-5ca7d026d44e idx: 0 lr: 330712484066 srv lr: 335007449088 lx: 0 gen 18 00000001:00080000:2.0:1787826074.706480:0:190357:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 330712483740 srv lr: 335007449088 lx: 0 gen 21 00000001:00000004:2.0:1787826074.706502:0:190357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 79, last_transno is 335007449088 00000001:00080000:2.0:1787826074.706593:0:190357:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1787826074.706644:0:190357:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953a480: xid 1874663042950784, transno 335007449219, client gen 18, slot idx 0 00000001:00080000:2.0:1787826074.706653:0:190357:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953a600: xid 1874663042951296, transno 335007449220, client gen 18, slot idx 1 00000001:00080000:2.0:1787826074.706658:0:190357:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953a780: xid 1874663042841472, transno 330712484066, client gen 18, slot idx 2 00000001:00080000:2.0:1787826074.706663:0:190357:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953ad80: xid 1874663048748160, transno 330712483739, client gen 21, slot idx 3 00000001:00080000:2.0:1787826074.706668:0:190357:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953ac00: xid 1874663048748416, transno 330712483740, client gen 21, slot idx 4 00000001:00080000:2.0:1787826074.706672:0:190357:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953a9c0: xid 1874663035574656, transno 322122554723, client gen 18, slot idx 5 00000001:00080000:2.0:1787826074.706677:0:190357:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953a3c0: xid 1874663041393408, transno 330712482189, client gen 18, slot idx 6 00000020:00000080:2.0:1787826074.707097:0:190357:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8eb3449f3370) 00000020:00000080:2.0:1787826074.707116:0:190357:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1787826074.707188:0:190357:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787826074.707195:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecac2 00000020:00000080:2.0:1787826074.716428:0:190357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787826074.724265:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x878a5eea00cecac9 00000020:00000080:0.0:1787826074.726586:0:190357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787826074.726600:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826074.726607:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826074.726609:0:190357:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787826074.726612:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787826074.726615:0:190357:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787826074.726616:0:190357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826074.726618:0:190357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826074.726619:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787826074.726622:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826074.726623:0:190357:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787826074.726626:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826074.726630:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826074.726631:0:190357:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787826074.726636:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787826074.726684:0:190357:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787826074.726710:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826074.726714:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826074.726715:0:190357:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787826074.726717:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826074.726720:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826074.726722:0:190357:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787826074.726725:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787826074.726730:0:190357:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:0.0:1787826074.726758:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787826074.726775:0:190357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8eb481d599b8) 00000020:00000080:0.0:1787826074.726798:0:190357:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787826074.726805:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787826074.726867:0:190357:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787826074.726873:0:190357:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787826074.726882:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecad7 00010000:00080000:0.0:1787826074.726926:0:190357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb47f75d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1787826074.729746:0:190357:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1787826074.737254:0:190357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826074.737267:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787826074.737317:0:190357:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787826074.737471:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cecade 00000100:00080000:0.0:1787826074.737483:0:190357:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826074.737500:0:190357:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb47f75d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826074.737537:0:190357:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b46300 x1874663049245312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826074.737592:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049245312:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826074.737662:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.737760:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049245312 00000100:00100000:3.0:1787826074.737769:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049245312 00000100:00100000:3.0:1787826074.737806:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12602 00000100:00100000:3.0:1787826074.737814:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049245312:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787826074.737839:0:177390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8141 last 0 00000020:00000080:3.0:1787826074.737879:0:177390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cecae5 00000004:00100000:3.0:1787826074.737894:0:177390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787826074.738004:0:177390:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3e000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787826074.738071:0:190357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787826074.738156:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826074.738161:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826074.738163:0:190357:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787826074.738167:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787826074.738169:0:190357:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787826074.738171:0:190357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826074.738173:0:190357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826074.738174:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787826074.738177:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826074.738178:0:190357:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787826074.738181:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787826074.738185:0:190357:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787826074.738189:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826074.738190:0:190357:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787826074.738192:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787826074.738196:0:190357:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:0.0:1787826074.738217:0:190357:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787826074.738220:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787826074.738235:0:190357:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8eb46a870000) 00000020:00000080:0.0:1787826074.738250:0:190357:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787826074.738256:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787826074.738348:0:190357:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787826074.738354:0:190357:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787826074.738359:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecaf3 00010000:00080000:0.0:1787826074.738384:0:190357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb476e68800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1787826074.738567:0:190357:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:0.0:1787826074.740242:0:190357:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787826074.740278:0:190357:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787826074.740871:0:190357:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 77, last_idx 78 00000040:00080000:1.0:1787826074.742172:0:190357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826074.742205:0:190357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].79, 64 off13248 00000040:00080000:1.0:1787826074.747196:0:190357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13c:0x0].1, 64 off8256 00000040:00080000:0.0:1787826074.749744:0:190363:0:(llog.c:805:llog_process_thread()) index: 78, lh_last_idx: 79 synced_idx: 0 lgh_last_idx: 79 00000040:00080000:0.0:1787826074.749755:0:190363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x138:0x0] at index 78 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1787826074.752463:0:190363:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 78, last_idx 79 00000040:00080000:0.0:1787826074.752498:0:190363:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x138:0x0] at index 78 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1787826074.752644:0:190363:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 79 synced_idx: 79 lgh_last_idx: 79 00000040:00080000:0.0:1787826074.752649:0:190363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13c:0x0] at index 79 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1787826074.753249:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049245312:12345-0@lo:38:llog_process_th.0 Request processed in 15427us (15579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826074.753264:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12602 00000100:00100000:2.0:1787826074.753419:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826074.753429:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 4 00000100:00080000:2.0:1787826074.753438:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787826074.753444:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787826074.753449:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f75d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787826074.753500:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049245312:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1787826074.753953:0:190357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826074.753965:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787826074.754016:0:190357:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787826074.754035:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cecafa 00000100:00080000:2.0:1787826074.754042:0:190357:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826074.754047:0:190357:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb476e68800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826074.754079:0:190357:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb48162aa00 x1874663049245440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826074.754107:0:190357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787826074.754179:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826074.754184:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826074.754186:0:190357:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787826074.754189:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826074.754191:0:190357:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787826074.754193:0:190357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826074.754195:0:190357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826074.754196:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826074.754198:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826074.754200:0:190357:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826074.754202:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826074.754206:0:190357:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787826074.754209:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826074.754211:0:190357:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787826074.754214:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826074.754217:0:190357:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:2.0:1787826074.754238:0:190357:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787826074.754241:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826074.754252:0:190357:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8eb341a6b370) 00000020:00000080:2.0:1787826074.754267:0:190357:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1787826074.754272:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826074.754361:0:190357:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787826074.754367:0:190357:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787826074.754372:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecb08 00010000:00080000:2.0:1787826074.754400:0:190357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb47bfd3800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1787826074.754594:0:190357:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1787826074.754658:0:190357:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787826074.754671:0:190357:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787826074.754913:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049245440:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787826074.754975:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.755459:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049245440 00000100:00100000:2.0:1787826074.755467:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049245440 00000100:00100000:2.0:1787826074.755502:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22534 00000100:00100000:2.0:1787826074.755510:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3616:x1874663049245440:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1787826074.755535:0:12319:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8141 last 0 00000020:00000080:2.0:1787826074.755558:0:12319:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cecb0f 00002000:00100000:2.0:1787826074.755572:0:12319:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8eb47bfd0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787826074.755576:0:12319:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787826074.755580:0:12319:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787826074.755643:0:12319:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787826074.755666:0:12319:0:(import.c:65:import_set_state_nolock()) ffff8eb47bfd2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826074.755764:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049245440:12345-0@lo:8:llog_process_th.0 Request processed in 253us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.755772:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22534 00000040:00080000:3.0:1787826074.755924:0:190357:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 77, last_idx 78 00000040:00080000:3.0:1787826074.756785:0:190357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826074.756814:0:190357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].79, 64 off13248 00000040:00080000:3.0:1787826074.756958:0:190357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13e:0x0].1, 64 off8256 00000040:00080000:2.0:1787826074.759229:0:190365:0:(llog.c:805:llog_process_thread()) index: 78, lh_last_idx: 79 synced_idx: 0 lgh_last_idx: 79 00000040:00080000:2.0:1787826074.759237:0:190365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13a:0x0] at index 78 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1787826074.759456:0:190365:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 78, last_idx 79 00000040:00080000:2.0:1787826074.759476:0:190365:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x13a:0x0] at index 78 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1787826074.760834:0:190365:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 79 synced_idx: 79 lgh_last_idx: 79 00000040:00080000:2.0:1787826074.760843:0:190365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13e:0x0] at index 79 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787826074.761637:0:190357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826074.761650:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787826074.761691:0:190357:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787826074.761709:0:190357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cecb16 00000100:00080000:3.0:1787826074.761718:0:190357:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826074.761723:0:190357:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8eb47bfd3800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826074.761757:0:190357:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb48110aa00 x1874663049245568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826074.761773:0:190357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787826074.761823:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826074.761827:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826074.761828:0:190357:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787826074.761831:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826074.761834:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826074.761836:0:190357:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787826074.761838:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787826074.761840:0:190357:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787826074.761842:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826074.761844:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826074.761845:0:190357:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787826074.761848:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826074.761850:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826074.761852:0:190357:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787826074.761855:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787826074.761889:0:190357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190357:1874663049245696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826074.763532:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826074.763550:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049245824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826074.763620:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.763666:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049245824 00000100:00100000:1.0:1787826074.763673:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049245824 00000100:00100000:1.0:1787826074.763710:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12603 00000100:00100000:1.0:1787826074.763718:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049245824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826074.763766:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445466112 avail 1299226624 00000100:00100000:1.0:1787826074.763809:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049245824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.763817:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12603 00000100:00100000:1.0:1787826074.763863:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049245824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826074.764442:0:190357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.764471:0:190357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.766189:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826074.766202:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 8 00000100:00080000:0.0:1787826074.766209:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787826074.766215:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787826074.766218:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb476e68800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787826074.766230:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787826074.766238:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049245440:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1787826074.766366:0:190363:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787826074.766443:0:190363:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8141593117676ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787826074.766449:0:190363:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787826074.766534:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049245952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826074.766600:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.766650:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049245952 00000100:00100000:0.0:1787826074.766656:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049245952 00000100:00100000:0.0:1787826074.766702:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5717 00000100:00100000:0.0:1787826074.766712:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049245952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826074.766732:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826074.766772:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049245952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.766779:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5717 00000100:00080000:0.0:1787826074.766801:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826074.766828:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049245952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826074.767350:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049245696 00000100:00100000:1.0:1787826074.767356:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049245696 00000100:00100000:1.0:1787826074.767387:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826074.767395:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:190357:x1874663049245696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826074.767505:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:190357:x1874663049245696:12345-0@lo:502:llog_process_th.0 Request processed in 110us (3064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.767512:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787826074.769054:0:190357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190357:1874663049245696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826074.769106:0:190357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826074.769116:0:190357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826074.769118:0:190357:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787826074.769123:0:190357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787826074.769212:0:190344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787826074.769260:0:190344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:2.0:1787826074.773238:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049245568:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787826074.773353:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826074.773506:0:190344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.773517:0:190344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826074.773527:0:190344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb3422b3000 from 1 10000000:01000000:3.0:1787826074.773530:0:190344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826074.773566:0:190344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.773574:0:190344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.773588:0:190344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826074.773606:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826074.773640:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.773657:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.775203:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049245568 00000100:00100000:1.0:1787826074.775215:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049245568 00000100:00100000:1.0:1787826074.775264:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22535 00000100:00100000:1.0:1787826074.775272:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3616:x1874663049245568:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1787826074.775314:0:179223:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8141 last 0 00000020:00000080:1.0:1787826074.775361:0:179223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cecb24 00002000:00100000:1.0:1787826074.775377:0:179223:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8eb343211000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787826074.775381:0:179223:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787826074.775384:0:179223:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787826074.775453:0:179223:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787826074.775478:0:179223:0:(import.c:65:import_set_state_nolock()) ffff8eb34b9e1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826074.775567:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049245568:12345-0@lo:8:llog_process_th.0 Request processed in 293us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.775575:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22535 00000100:00100000:1.0:1787826074.775658:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787826074.775666:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787826074.775674:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787826074.775679:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787826074.775682:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47bfd3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787826074.775700:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787826074.775705:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049245568:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1787826074.775849:0:190365:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787826074.775908:0:190365:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8141602582223ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787826074.775915:0:190365:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787826074.775980:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049246208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826074.776028:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787826074.776133:0:190345:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787826074.776178:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049246208 00000100:00100000:1.0:1787826074.776182:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049246208 00000100:00100000:1.0:1787826074.776224:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5718 00000100:00100000:1.0:1787826074.776232:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049246208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826074.776249:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142528 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826074.776298:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049246208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.776304:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5718 00000100:00100000:1.0:1787826074.776357:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049246208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826074.776534:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049246080 00000100:00100000:0.0:1787826074.776539:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049246080 00000100:00100000:0.0:1787826074.776575:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826074.776583:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:190344:x1874663049246080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826074.776592:0:190353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826074.776609:0:190353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecb1d expref: -99 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.776632:0:190353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 9 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.776643:0:190353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 9 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.776652:0:190353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed600, rc 0) 00000100:00100000:0.0:1787826074.776686:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:190344:x1874663049246080:12345-0@lo:101:mount.lustre.0 Request processed in 104us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.776696:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787826074.776741:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826074.777762:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826074.777781:0:190344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.777806:0:190344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826074.778557:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246336:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787826074.778619:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.778650:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.779549:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049246336 00000100:00100000:1.0:1787826074.779559:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049246336 00000100:00100000:1.0:1787826074.779611:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826074.779622:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:190344:x1874663049246336:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787826074.779642:0:190355:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787826074.779667:0:190355:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787826074.779670:0:190355:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787826074.779672:0:190355:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787826074.779674:0:190355:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 326 00000100:00100000:1.0:1787826074.779787:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:190344:x1874663049246336:12345-0@lo:256:mount.lustre.0 Request processed in 166us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.779796:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787826074.779893:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246336:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787826074.780605:0:190344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787826074.780621:0:190344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.780631:0:190344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826074.780640:0:190344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb3422b3000 from 1 10000000:01000000:3.0:1787826074.780643:0:190344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826074.780672:0:190344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.780679:0:190344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.780688:0:190344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826074.780706:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826074.780754:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.780787:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.780811:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049246464 00000100:00100000:0.0:1787826074.780817:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049246464 00000100:00100000:0.0:1787826074.780854:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787826074.780863:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:190344:x1874663049246464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826074.780873:0:190353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826074.780885:0:190353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ede00/0x878a5eea00cecb39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecb32 expref: -99 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.780914:0:190353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ede00/0x878a5eea00cecb39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecb32 expref: 10 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.780923:0:190353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ede00/0x878a5eea00cecb39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecb32 expref: 10 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.780931:0:190353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ede00, rc 0) 00000100:00100000:0.0:1787826074.780959:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190344:x1874663049246464:12345-0@lo:101:mount.lustre.0 Request processed in 98us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.780965:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787826074.780981:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826074.780993:0:190344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.781002:0:190344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826074.781220:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826074.781246:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.781263:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.782802:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049246592 00000100:00100000:0.0:1787826074.782812:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049246592 00000100:00100000:0.0:1787826074.782850:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787826074.782860:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190344:x1874663049246592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826074.783041:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190344:x1874663049246592:12345-0@lo:501:mount.lustre.0 Request processed in 182us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.783048:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787826074.783215:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826074.783292:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826074.783372:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.783401:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.783591:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049246720 00000100:00100000:1.0:1787826074.783596:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049246720 00000100:00100000:1.0:1787826074.783640:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787826074.783648:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190344:x1874663049246720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826074.783747:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190344:x1874663049246720:12345-0@lo:503:mount.lustre.0 Request processed in 100us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.783755:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787826074.783774:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049246720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826074.784532:0:190367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190367:1874663049246848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826074.784576:0:190367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.784605:0:190367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.784704:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049246848 00000100:00100000:0.0:1787826074.784709:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049246848 00000100:00100000:0.0:1787826074.784742:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826074.784750:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190367:x1874663049246848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826074.785253:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190367:x1874663049246848:12345-0@lo:502:llog_process_th.0 Request processed in 502us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.785261:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787826074.785366:0:190367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190367:1874663049246848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826074.785392:0:190367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826074.785402:0:190367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826074.785404:0:190367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787826074.785412:0:190367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb3422b3000 00000020:00000080:2.0:1787826074.785415:0:190367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787826074.785423:0:190367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826074.785425:0:190367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826074.785426:0:190367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787826074.785429:0:190367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826074.785431:0:190367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826074.785432:0:190367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787826074.785434:0:190367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb3422b3000 00000020:00000080:2.0:1787826074.785436:0:190367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787826074.785590:0:190367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190367:1874663049246976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826074.785627:0:190367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.785695:0:190367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4811fb540 going to sleep for 11 seconds 00000004:00080000:1.0:1787826074.785767:0:190345:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787826074.785850:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049246976 00000100:00100000:0.0:1787826074.785855:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049246976 00000100:00100000:0.0:1787826074.785891:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787826074.785899:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190367:x1874663049246976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826074.785997:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190367:x1874663049246976:12345-0@lo:502:llog_process_th.0 Request processed in 89us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.786004:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787826074.786271:0:190367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190367:1874663049246976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826074.786302:0:190367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826074.786308:0:190367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826074.786309:0:190367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787826074.786313:0:190367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787826074.786554:0:190344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1787826074.786599:0:190344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787826074.786648:0:190344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.786659:0:190344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826074.786719:0:190344:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787826074.786722:0:190344:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8eb3422b3000 10000000:01000000:0.0:1787826074.786725:0:190344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8eb3422b3000 10000000:01000000:0.0:1787826074.786728:0:190344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787826074.786733:0:190344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb3422b3000 from 1 10000000:01000000:0.0:1787826074.786736:0:190344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826074.786762:0:190344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.786770:0:190344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.786779:0:190344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826074.786793:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049247104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826074.786827:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.786848:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec79f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.786920:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049247104 00000100:00100000:1.0:1787826074.786926:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049247104 00000100:00100000:1.0:1787826074.786959:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787826074.786968:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:190344:x1874663049247104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826074.786978:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826074.787001:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb479b3f200/0x878a5eea00cecb47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecb40 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.787021:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb479b3f200/0x878a5eea00cecb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecb40 expref: 11 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.787031:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb479b3f200/0x878a5eea00cecb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecb40 expref: 11 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.787039:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f200, rc 0) 00000100:00100000:1.0:1787826074.787071:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190344:x1874663049247104:12345-0@lo:101:mount.lustre.0 Request processed in 104us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.787076:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787826074.787240:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049247104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826074.787252:0:190344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.787261:0:190344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826074.787319:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049247232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826074.787364:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.787381:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec79f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.787394:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049247232 00000100:00100000:0.0:1787826074.787398:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049247232 00000100:00100000:0.0:1787826074.787422:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787826074.787429:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:190344:x1874663049247232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826074.787542:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:190344:x1874663049247232:12345-0@lo:501:mount.lustre.0 Request processed in 113us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.787552:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787826074.787589:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049247232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826074.787613:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049247360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826074.787648:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.787661:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec79f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.787673:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049247360 00000100:00100000:0.0:1787826074.787676:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049247360 00000100:00100000:0.0:1787826074.787696:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787826074.787702:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:190344:x1874663049247360:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826074.787772:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:190344:x1874663049247360:12345-0@lo:503:mount.lustre.0 Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.787779:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787826074.787815:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049247360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826074.788446:0:190369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190369:1874663049247488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826074.788499:0:190369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.788528:0:190369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec7a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.788627:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049247488 00000100:00100000:0.0:1787826074.788632:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049247488 00000100:00100000:0.0:1787826074.788666:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787826074.788673:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190369:x1874663049247488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826074.788762:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190369:x1874663049247488:12345-0@lo:502:llog_process_th.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.788769:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787826074.791467:0:190369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190369:1874663049247488:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787826074.791553:0:190369:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787826074.791573:0:190369:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8eb344e64d28) 00000020:00000080:3.0:1787826074.791599:0:190369:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787826074.791691:0:190369:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb3422b3000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787826074.791695:0:190369:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb3422b3000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787826074.791698:0:190369:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb3422b3000 4 00010000:00080000:3.0:1787826074.791727:0:190369:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb348a3d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1787826074.796651:0:190369:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1787826074.797112:0:190369:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787826074.797155:0:190369:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787826074.797168:0:190369:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x878a5eea00cecb55 00000100:00080000:3.0:1787826074.797177:0:190369:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826074.797184:0:190369:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb348a3d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826074.797217:0:190369:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f6c1500 x1874663049247616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826074.797241:0:190369:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787826074.798671:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049247616:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826074.798745:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.798783:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049247616 00000100:00100000:3.0:1787826074.798922:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049247616 00000100:00100000:3.0:1787826074.798962:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1787826074.798970:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049247616:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826074.799039:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049247616:12345-0@lo:38:llog_process_th.0 Request processed in 67us (293us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787826074.799046:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1787826074.801993:0:190369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190369:1874663049247744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826074.802074:0:190369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.802117:0:190369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826074.802388:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049247744 00000100:00100000:2.0:1787826074.802395:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049247744 00000100:00100000:2.0:1787826074.802445:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826074.802456:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190369:x1874663049247744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826074.802580:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190369:x1874663049247744:12345-0@lo:502:llog_process_th.0 Request processed in 125us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.802588:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787826074.802703:0:190369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190369:1874663049247744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826074.802887:0:190369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190369:1874663049247872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826074.802931:0:190369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826074.802956:0:190369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445379c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.802978:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049247872 00000100:00100000:0.0:1787826074.802984:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049247872 00000100:00100000:0.0:1787826074.803011:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787826074.803019:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190369:x1874663049247872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826074.808830:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787826074.808845:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826074.808853:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787826074.808858:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049247616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826074.809226:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190369:x1874663049247872:12345-0@lo:502:llog_process_th.0 Request processed in 6205us (6291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.809240:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787826074.813502:0:190369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:190369:1874663049247872:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787826074.813551:0:190369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787826074.814003:0:190344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787826074.814042:0:190344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787826074.814101:0:190344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.814112:0:190344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826074.814165:0:190344:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787826074.814168:0:190344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826074.814169:0:190344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826074.814170:0:190344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826074.814171:0:190344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826074.814172:0:190344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826074.814174:0:190344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826074.814175:0:190344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826074.814176:0:190344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826074.814178:0:190344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787826074.814181:0:190344:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787826074.814183:0:190344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826074.814185:0:190344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826074.814186:0:190344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826074.814187:0:190344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826074.814188:0:190344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826074.814189:0:190344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826074.814189:0:190344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826074.814190:0:190344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826074.814191:0:190344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826074.814192:0:190344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787826074.814215:0:190344:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787826074.814232:0:190344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049248000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787826074.814311:0:190344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.814373:0:190344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.814396:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049248000 00000100:00100000:0.0:1787826074.814402:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049248000 00000100:00100000:0.0:1787826074.814445:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787826074.814454:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190344:x1874663049248000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787826074.814481:0:190355:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787826074.814495:0:190355:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787826074.826379:0:190355:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826074.826434:0:190355:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787826074.829506:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:190344:x1874663049248000:12345-0@lo:253:mount.lustre.0 Request processed in 15044us (15186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.829522:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787826074.829635:0:190344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:190344:1874663049248000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787826074.829651:0:190344:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787826074.829654:0:190344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826074.829655:0:190344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826074.829656:0:190344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826074.829658:0:190344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826074.829659:0:190344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826074.829660:0:190344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826074.829661:0:190344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826074.829662:0:190344:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826074.829664:0:190344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826074.829665:0:190344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787826074.829678:0:190344:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787826074.835910:0:190354:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826074.835918:0:190354:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826074.835941:0:190354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.835959:0:190354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 10 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.835968:0:190354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.836008:0:190354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 10 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826074.836021:0:190354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 10 pid: 190353 timeout: 8241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826074.836035:0:190354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:190354:1874663049248128:0@lo:104: 00000100:00100000:2.0:1787826074.836105:0:190354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.836155:0:190354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.836211:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049248128 00000100:00100000:0.0:1787826074.836219:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049248128 00000100:00100000:0.0:1787826074.836269:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4767 00000100:00100000:0.0:1787826074.836279:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:190354:x1874663049248128:12345-0@lo:104: 00010000:00010000:0.0:1787826074.836301:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.836380:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826074.836387:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:190354:x1874663049248128:12345-0@lo:104: Request processed in 110us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.836395:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4767 00010000:00010000:0.0:1787826074.836417:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826074.836422:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.836430:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826074.836434:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.836443:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826074.836450:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826074.836456:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826074.836493:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.836500:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826074.836517:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.836524:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19e00/0x878a5eea00cecb1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cecb2b expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826074.836537:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826074.836539:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826074.836540:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826074.836550:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049248256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826074.836579:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.836719:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049248256 00000100:00100000:1.0:1787826074.836724:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049248256 00010000:00010000:1.0:1787826074.836818:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 11 pid: 190353 timeout: 8241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826074.836888:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12219 00000100:00100000:1.0:1787826074.836897:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:3617:x1874663049248256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826074.836919:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826074.836925:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 11 pid: 190353 timeout: 8241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.836936:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 11 pid: 190353 timeout: 8241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.836952:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.836959:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826074.836971:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001054478s 00010000:00010000:1.0:1787826074.836976:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.836992:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.836999:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.837005:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.837010:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826074.837015:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.837021:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.837030:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826074.837041:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826074.837076:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:3617:x1874663049248256:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.837094:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12219 00010000:00010000:3.0:1787826074.837155:0:190354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cecb1d expref: 10 pid: 190353 timeout: 8241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826074.837170:0:190354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:190354:1874663049248128:0@lo:104: 00010000:00010000:3.0:1787826074.837187:0:190354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.837196:0:190354:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.837201:0:190354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826074.837208:0:190354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf39c00/0x878a5eea00cecb5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826074.837312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049248256:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787826074.847140:0:190344:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 330712484068 00000040:01000000:1.0:1787826074.851711:0:190344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787826074.852183:0:190376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787826074.852391:0:190344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1787826074.852886:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.852987:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.853015:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0fc00 going to sleep for 11 seconds 00000040:01000000:3.0:1787826074.853512:0:190344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787826074.853552:0:190344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787826074.854089:0:190344:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787826074.854097:0:190344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787826074.854138:0:190344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826074.855074:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049248384 00000100:00100000:0.0:1787826074.855085:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049248384 00000100:00100000:0.0:1787826074.855141:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12604 00000100:00100000:0.0:1787826074.855151:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826074.855258:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 108us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.855266:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12604 00000100:00100000:1.0:1787826074.855642:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248384:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787826074.855679:0:190377:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787826074.855719:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248512:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.855760:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.855787:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049248512 00000100:00100000:1.0:1787826074.855866:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049248512 00000100:00100000:1.0:1787826074.855900:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12605 00000100:00100000:1.0:1787826074.855909:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248512:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.856005:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248512:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.856011:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12605 00000100:00100000:1.0:1787826074.856035:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.856048:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248512:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.856106:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248640:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.856129:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.856152:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049248640 00000100:00100000:1.0:1787826074.856155:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049248640 00000100:00100000:1.0:1787826074.856177:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12606 00000100:00100000:1.0:1787826074.856183:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248640:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.856226:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248640:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 42us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.856232:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12606 00000100:00100000:1.0:1787826074.856249:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.856261:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248640:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.856350:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.856405:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.856428:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049248768 00000100:00100000:1.0:1787826074.856432:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049248768 00000100:00100000:1.0:1787826074.856454:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12607 00000100:00100000:1.0:1787826074.856461:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248768:12345-0@lo:1000:lod0000_rec0001.0 00000020:00080000:2.0:1787826074.856901:0:190375:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 330712484068 00000020:00080000:2.0:1787826074.856906:0:190375:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484068 00000040:00080000:3.0:1787826074.858855:0:190344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787826074.859440:0:190344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787826074.859481:0:190344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787826074.859593:0:190344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787826074.860069:0:190344:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x82:0x0] (8/32) registered 00000100:00100000:1.0:1787826074.860738:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248768:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 4272us (4328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.860750:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12607 00000100:00100000:1.0:1787826074.860793:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.860818:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248768:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787826074.860861:0:190377:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 9, last_idx 11 00000100:00100000:1.0:1787826074.860963:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.861019:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.861052:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826074.861853:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049248896 00000100:00100000:2.0:1787826074.861862:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049248896 00000100:00100000:2.0:1787826074.861919:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12608 00000100:00100000:2.0:1787826074.861928:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826074.862114:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049248896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 186us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.862121:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12608 00000100:00100000:1.0:1787826074.862265:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049248896:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787826074.862318:0:190377:0:(llog.c:805:llog_process_thread()) index: 10, lh_last_idx: 11 synced_idx: 0 lgh_last_idx: 11 00000040:00080000:1.0:1787826074.862355:0:190377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240001f58:0x1:0x0] at index 10 of catalog [0x2400007ec:0x1:0x0] 00000100:00100000:1.0:1787826074.862420:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049249024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.862452:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.862470:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826074.862749:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049249024 00000100:00100000:2.0:1787826074.862755:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049249024 00000100:00100000:2.0:1787826074.862799:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12609 00000100:00100000:2.0:1787826074.862808:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049249024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826074.862868:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049249024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.862875:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12609 00000100:00100000:1.0:1787826074.863299:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049249024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.864137:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049249152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826074.864213:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826074.864255:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049249152 00000100:00100000:1.0:1787826074.864260:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049249152 00000040:00080000:0.0:1787826074.864359:0:190376:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x20001a210:0x1:0x0] first idx 5, last_idx 6 00000040:00080000:0.0:1787826074.864445:0:190376:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1787826074.864450:0:190376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200026560:0x1:0x0] at index 6 of catalog [0x20001a210:0x1:0x0] 00000040:00080000:0.0:1787826074.864666:0:190376:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200026560:0x1:0x0] at index 6 of catalog [0x20001a210:0x1:0x0] 00000040:00080000:0.0:1787826074.864683:0:190376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 6 count 1 00000004:00080000:0.0:1787826074.864745:0:190376:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787826074.865710:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12610 00000100:00100000:1.0:1787826074.865729:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049249152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826074.867975:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.868017:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049249152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826074.868141:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049249280:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826074.868179:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.868211:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826074.868948:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049249280 00000100:00100000:2.0:1787826074.868959:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049249280 00000100:00100000:2.0:1787826074.869012:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12611 00000100:00100000:2.0:1787826074.869021:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:190377:x1874663049249280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826074.869103:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:190377:x1874663049249280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.869112:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12611 00000100:00100000:0.0:1787826074.869990:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b45c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049249280:0@lo:1000:lod0000_rec0001.0 00000004:00080000:0.0:1787826074.870053:0:190377:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47f986f00 with version 1 00000040:00080000:0.0:1787826074.870074:0:190377:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 10, last_idx 11 00000004:00080000:0.0:1787826074.870084:0:190377:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47f9860c0 with version 2 00000040:00080000:0.0:1787826074.870088:0:190377:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240001f58:0x1:0x0] at index 10 of catalog [0x2400007ec:0x1:0x0] 00000004:00080000:2.0:1787826074.870899:0:190361:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb460285300 version 1 rpc_version 1 00000020:00100000:2.0:1787826074.870930:0:190361:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826074.870940:0:190361:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb48162bb80 x1874663049249536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826074.870961:0:190361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190361:1874663049249536:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826074.871021:0:190361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.871054:0:190361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826074.871136:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049249152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2070us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826074.871150:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12610 00000100:00100000:1.0:1787826074.871181:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049249536 00000100:00100000:1.0:1787826074.871187:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049249536 00000100:00100000:1.0:1787826074.871218:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12612 00000100:00100000:1.0:1787826074.871226:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190361:x1874663049249536:12345-0@lo:1000:osp_up1-0.0 00000001:00080000:1.0:1787826074.883038:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869977 is committed 00000001:00100000:1.0:1787826074.883048:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787826074.883233:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:190361:x1874663049249536:12345-0@lo:1000:osp_up1-0.0 Request processed in 12002us (12206us total) trans 17179869977 rc 0/0 00000100:00100000:0.0:1787826074.883244:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12612 00010000:00080000:3.0:1787826074.884079:0:190344:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 335007449220 00010000:00080000:1.0:1787826074.884732:0:190378:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 190378 00010000:02000000:1.0:1787826074.884748:0:190378:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1787826074.884752:0:190378:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787826074.884754:0:190378:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1787826074.884850:0:190344:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787826074.884864:0:190344:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787826074.884882:0:190344:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787826074.884910:0:190344:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787826074.885789:0:190344:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826074.886049:0:190344:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000004:00080000:2.0:1787826074.892941:0:190361:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869977 committed transno 17179869977 00000100:00100000:2.0:1787826074.892949:0:190361:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869977 gen 2 00000100:00100000:2.0:1787826074.892975:0:190361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190361:1874663049249536:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826074.893009:0:190361:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb460285300 version 2 rpc_version 2 00000020:00100000:2.0:1787826074.893033:0:190361:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826074.893041:0:190361:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb48162bb80 x1874663049249792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826074.893062:0:190361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190361:1874663049249792:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826074.893123:0:190361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.893154:0:190361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826074.893190:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826074.893218:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826074.893244:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042957952 00000100:00100000:2.0:1787826074.893251:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042957952 00000100:00100000:2.0:1787826074.893319:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6936 00000100:00100000:2.0:1787826074.893352:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042957952:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826074.893407:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042957952:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 57us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.893415:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6936 00000100:00080000:2.0:1787826074.893437:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826074.893481:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826074.893605:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826074.893628:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042957568 00000100:00100000:2.0:1787826074.893632:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042957568 00000100:00100000:2.0:1787826074.893655:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:2.0:1787826074.893661:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2388:x1874663042957568:12345-192.168.203.47@tcp:250:kworker.0 00010000:00080000:2.0:1787826074.893679:0:190351:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7528148b-9bee-4d31-b597-8aae3b0b4982@192.168.203.47@tcp t0 exp 0000000000000000 cur 8141 last 0 00000020:00000080:2.0:1787826074.893708:0:190351:0:(genops.c:1385:class_connect()) connect: client 7528148b-9bee-4d31-b597-8aae3b0b4982, cookie 0x878a5eea00cecb63 00000100:00080000:2.0:1787826074.893860:0:190351:0:(import.c:65:import_set_state_nolock()) ffff8eb349797800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826074.893901:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+5:2388:x1874663042957568:12345-192.168.203.47@tcp:250:kworker.0 Request processed in 238us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.893908:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:2.0:1787826074.893940:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042957824 00000100:00100000:2.0:1787826074.893944:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042957824 00000100:00100000:2.0:1787826074.893976:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042957696 00000100:00100000:2.0:1787826074.893979:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042957696 00000100:00100000:2.0:1787826074.893998:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:2.0:1787826074.894006:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042957824:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826074.894035:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042957824:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.894041:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:2.0:1787826074.894057:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 907 00000100:00100000:2.0:1787826074.894061:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042957696:12345-192.168.203.47@tcp:38:kworker.0 00010000:00080000:2.0:1787826074.894079:0:187905:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'a9ce6693-0634-46c5-bf21-5ca7d026d44e' at ffff8eb34df92000, cookie 0x878a5eea00cecaad 00010000:00080000:2.0:1787826074.894084:0:187905:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp recovering/t330712482189 exp ffff8eb34df92000 cur 8141 last 1787826074 00010000:02000400:2.0:1787826074.894091:0:187905:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1787826074.894097:0:187905:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1787826074.894111:0:187905:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787826074.894230:0:187905:0:(import.c:65:import_set_state_nolock()) ffff8eb343644800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826074.894259:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042957696:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 196us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.894266:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 907 00000100:00080000:2.0:1787826074.894299:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826074.895815:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049249792 00000100:00100000:0.0:1787826074.895825:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049249792 00000100:00100000:0.0:1787826074.895870:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12613 00000100:00100000:0.0:1787826074.895880:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:190361:x1874663049249792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826074.896083:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190361:x1874663049249792:12345-0@lo:1000:osp_up1-0.0 Request processed in 204us (2959us total) trans 17179869978 rc 0/0 00000100:00100000:0.0:1787826074.896091:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12613 00000100:00100000:2.0:1787826074.898022:0:190361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190361:1874663049249792:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826074.899715:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049249920:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826074.899906:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.899939:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826074.900045:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049249920 00000100:00100000:2.0:1787826074.900053:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049249920 00000100:00100000:2.0:1787826074.900109:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12614 00000100:00100000:2.0:1787826074.900119:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049249920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826074.900346:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049249920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 203us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826074.900354:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12614 00000100:00100000:0.0:1787826074.907114:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049249920:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787826074.907173:0:190377:0:(llog.c:805:llog_process_thread()) index: 11, lh_last_idx: 11 synced_idx: 11 lgh_last_idx: 11 00000040:00080000:0.0:1787826074.907178:0:190377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240001f58:0x2:0x0] at index 11 of catalog [0x2400007ec:0x1:0x0] 00000100:00100000:0.0:1787826074.907259:0:190377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049250048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826074.907355:0:190377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826074.907390:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049250048 00000100:00100000:0.0:1787826074.907396:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049250048 00000100:00100000:0.0:1787826074.907441:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12615 00000100:00100000:0.0:1787826074.907450:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049250048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826074.907523:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190377:x1874663049250048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826074.907531:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12615 00000100:00100000:0.0:1787826074.907558:0:190377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.907572:0:190377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190377:1874663049250048:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787826074.907616:0:190377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787826074.907655:0:190377:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47f986240 with version 3 00000004:00080000:0.0:1787826074.907693:0:190377:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8eb47f986900 with version 4 00000040:00080000:0.0:1787826074.907697:0:190377:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240001f58:0x2:0x0] at index 11 of catalog [0x2400007ec:0x1:0x0] 00000040:00080000:0.0:1787826074.907712:0:190377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 11 count 1 00000004:00080000:0.0:1787826074.907777:0:190377:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787826074.907781:0:190377:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1787826074.913422:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826074.913480:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663041393408 00000100:00100000:0.0:1787826074.913501:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663041393408 00000100:00100000:0.0:1787826074.913553:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 908 00000100:00100000:0.0:1787826074.913567:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663041393408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00080000:0.0:1787826074.913587:0:188682:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449221, current: 330712482189, replaying 00000020:02000000:0.0:1787826074.913593:0:188682:0:(tgt_handler.c:403:tgt_handle_request0()) *** cfs_fail_loc=302, val=2147483648*** 00000004:00080000:2.0:1787826074.915313:0:190361:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb460285300 version 3 rpc_version 3 00000020:00100000:2.0:1787826074.915374:0:190361:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826074.915385:0:190361:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb48162b100 x1874663049250304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826074.915410:0:190361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190361:1874663049250304:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826074.915474:0:190361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.915508:0:190361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826074.915530:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049250304 00000100:00100000:2.0:1787826074.915537:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049250304 00000100:00100000:2.0:1787826074.915581:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12616 00000100:00100000:2.0:1787826074.915591:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190361:x1874663049250304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826074.933694:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663041393408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 20121us (20270us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826074.933707:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 908 00000100:00100000:2.0:1787826074.934506:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:190361:x1874663049250304:12345-0@lo:1000:osp_up1-0.0 Request processed in 18912us (19027us total) trans 17179869979 rc 0/0 00000100:00100000:2.0:1787826074.934519:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12616 00000100:00100000:2.0:1787826074.934602:0:190361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190361:1874663049250304:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826074.934616:0:190361:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb460285300 version 4 rpc_version 4 00000020:00100000:2.0:1787826074.934649:0:190361:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826074.934656:0:190361:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb481629880 x1874663049250560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826074.934677:0:190361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190361:1874663049250560:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826074.934731:0:190361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826074.934758:0:190361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441374c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826074.935712:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049250560 00000100:00100000:0.0:1787826074.935722:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049250560 00000100:00100000:0.0:1787826074.935873:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12617 00000100:00100000:0.0:1787826074.935883:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:190361:x1874663049250560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826074.936607:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:190361:x1874663049250560:12345-0@lo:1000:osp_up1-0.0 Request processed in 722us (1870us total) trans 17179869980 rc 0/0 00000100:00100000:0.0:1787826074.936617:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12617 00010000:00080000:1.0:1787826074.937582:0:190378:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1787826074.938842:0:190361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190361:1874663049250560:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787826075.480204:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826076.153465:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826076.153706:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042958080 00000100:00100000:1.0:1787826076.153717:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042958080 00000100:00100000:1.0:1787826076.153769:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:1.0:1787826076.153779:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+5:15163:x1874663042958080:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826076.153796:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826076.153815:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb479b3f800/0x878a5eea00cecb6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f09f expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.153844:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb479b3f800/0x878a5eea00cecb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f09f expref: 6 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.153856:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb479b3f800/0x878a5eea00cecb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f09f expref: 6 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.153865:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f800, rc 0) 00000100:00100000:1.0:1787826076.153920:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+6:15163:x1874663042958080:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 142us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.153928:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:2.0:1787826076.169447:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826076.175860:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042958208 00000100:00100000:1.0:1787826076.175877:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042958208 00000100:00100000:1.0:1787826076.175982:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:1.0:1787826076.175993:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+6:15163:x1874663042958208:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826076.176018:0:190351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1787826076.176040:0:190351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826076.176044:0:190351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787826076.176047:0:190351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787826076.176050:0:190351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787826076.176052:0:190351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 327 00000100:00100000:2.0:1787826076.187406:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+6:15163:x1874663042958208:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 Request processed in 11403us (17958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826076.187420:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:3.0:1787826076.197566:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826076.198154:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042958336 00000100:00100000:0.0:1787826076.198167:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042958336 00000100:00100000:0.0:1787826076.198239:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:0.0:1787826076.198252:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+6:15163:x1874663042958336:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.198281:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826076.198303:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ed000/0x878a5eea00cecb71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0a6 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.198354:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ed000/0x878a5eea00cecb71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0a6 expref: 7 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.198365:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ed000/0x878a5eea00cecb71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0a6 expref: 7 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.198375:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed000, rc 0) 00000100:00100000:0.0:1787826076.198437:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+7:15163:x1874663042958336:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 187us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.198444:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:0.0:1787826076.212417:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826076.213181:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042958464 00000100:00100000:1.0:1787826076.213191:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042958464 00000100:00100000:1.0:1787826076.213250:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:1.0:1787826076.213260:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+7:15163:x1874663042958464:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.213461:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+8:15163:x1874663042958464:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 201us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.213469:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:0.0:1787826076.222824:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826076.223840:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042958592 00000100:00100000:2.0:1787826076.223853:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042958592 00000100:00100000:2.0:1787826076.223916:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:2.0:1787826076.223926:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+8:15163:x1874663042958592:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.224087:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+8:15163:x1874663042958592:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 162us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826076.224097:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:0.0:1787826076.237970:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 10000000:01000000:0.0:1787826076.244455:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826076.244463:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb3422b3000 from 327 10000000:01000000:0.0:1787826076.244468:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826076.244531:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.244543:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.244554:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.244592:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049250688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.244822:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.246453:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.247356:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042958720 00000100:00100000:1.0:1787826076.247368:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042958720 00000100:00100000:0.0:1787826076.249167:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049250688 00000100:00100000:0.0:1787826076.249177:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049250688 00000100:00100000:0.0:1787826076.249210:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:0.0:1787826076.249220:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+8:15163:x1874663042958720:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.249236:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826076.249252:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ec000/0x878a5eea00cecb7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0ad expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.249290:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ec000/0x878a5eea00cecb7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0ad expref: 9 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.249302:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ec000/0x878a5eea00cecb7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0ad expref: 9 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.249311:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ec000, rc 0) 00000100:00100000:0.0:1787826076.249395:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042958720:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 176us (11436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.249403:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:0.0:1787826076.249437:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787826076.249447:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:6488:x1874663049250688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.249454:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826076.249463:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecb78 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.249482:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecb78 expref: 11 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.249490:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecb78 expref: 11 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.249498:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed600, rc 0) 00000100:00100000:0.0:1787826076.249558:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049250688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (4736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.249566:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787826076.250396:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049250688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.250415:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.250424:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.250482:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049250816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.250538:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.250568:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.250582:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049250816 00000100:00100000:0.0:1787826076.251194:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049250816 00000100:00100000:0.0:1787826076.251233:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787826076.251240:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049250816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826076.251261:0:190352:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826076.251285:0:190352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826076.251289:0:190352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 327 00000100:00100000:0.0:1787826076.251404:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049250816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.251411:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787826076.251450:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049250816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787826076.251495:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826076.251502:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.251510:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826076.251519:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787826076.251521:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb34df96000 from 52 10000000:01000000:0.0:1787826076.251905:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826076.251932:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.251940:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.251948:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.251964:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049250944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.251997:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.252018:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.252034:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049250944 00000100:00100000:0.0:1787826076.252037:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049250944 00000100:00100000:0.0:1787826076.252065:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787826076.252072:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049250944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.252081:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826076.252093:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ec400/0x878a5eea00cecb94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecb8d expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.252112:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ec400/0x878a5eea00cecb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecb8d expref: 12 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.252122:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ec400/0x878a5eea00cecb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecb8d expref: 12 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.252130:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ec400, rc 0) 00000100:00100000:0.0:1787826076.252158:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049250944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.252164:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787826076.252196:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049250944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.252207:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb94 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.252215:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecb94 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.252364:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.252393:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.252406:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.252417:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049251072 00000100:00100000:0.0:1787826076.252420:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049251072 00000100:00100000:0.0:1787826076.252439:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787826076.252445:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049251072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.252552:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049251072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.252558:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787826076.252582:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.252626:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.252670:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.252683:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.252694:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049251200 00000100:00100000:0.0:1787826076.252697:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049251200 00000100:00100000:0.0:1787826076.252715:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787826076.252721:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049251200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.252960:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049251200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.252967:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787826076.253007:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826076.253986:0:190432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1787826076.254082:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1787826076.254110:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787826076.254120:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb94 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.254129:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb94 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826076.254143:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826076.254146:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb34df96000 from 324 10000000:01000000:0.0:1787826076.254148:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826076.254178:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.254187:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.254196:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.254216:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.254362:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.254384:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.254402:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049251328 00000100:00100000:0.0:1787826076.254407:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049251328 00000100:00100000:0.0:1787826076.254442:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787826076.254451:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049251328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.254463:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826076.254475:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ec200/0x878a5eea00cecba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecb9b expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.254496:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ec200/0x878a5eea00cecba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecb9b expref: 13 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.254506:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ec200/0x878a5eea00cecba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecb9b expref: 13 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.254519:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ec200, rc 0) 00000100:00100000:0.0:1787826076.254550:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049251328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.254556:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787826076.254658:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.254670:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecba2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.254679:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecba2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.254730:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.254842:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.254855:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.254866:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049251456 00000100:00100000:0.0:1787826076.254870:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049251456 00000100:00100000:0.0:1787826076.254886:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787826076.254891:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049251456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826076.254902:0:190352:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826076.254916:0:190352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826076.254920:0:190352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1787826076.254923:0:190352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1787826076.254925:0:190352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1787826076.254928:0:190352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 327 00000100:00100000:0.0:1787826076.254993:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049251456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.255004:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787826076.255030:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787826076.255105:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826076.255111:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecba2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.255119:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecba2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826076.255126:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787826076.255128:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1787826076.255130:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787826076.255147:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.255154:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.255161:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.255173:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.255198:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.255211:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.255221:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049251584 00000100:00100000:0.0:1787826076.255224:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049251584 00000100:00100000:0.0:1787826076.255242:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787826076.255249:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049251584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.255256:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826076.255286:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ecc00/0x878a5eea00cecbb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecba9 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.255300:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ecc00/0x878a5eea00cecbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecba9 expref: 14 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.255309:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ecc00/0x878a5eea00cecbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecba9 expref: 14 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.255316:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ecc00, rc 0) 00000100:00100000:0.0:1787826076.255364:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049251584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.255370:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787826076.255398:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.255408:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbb0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.255416:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecbb0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.255467:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.255491:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.255505:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458967d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.255516:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049251712 00000100:00100000:0.0:1787826076.255520:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049251712 00000100:00100000:0.0:1787826076.255539:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787826076.255544:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049251712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.255685:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049251712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.255692:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787826076.255719:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.255913:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.255959:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.255975:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458967d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.255987:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049251840 00000100:00100000:0.0:1787826076.255990:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049251840 00000100:00100000:0.0:1787826076.256009:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787826076.256017:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049251840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.263078:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826076.263189:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042958848 00000100:00100000:1.0:1787826076.263199:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042958848 00000100:00100000:1.0:1787826076.263254:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:1.0:1787826076.263264:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042958848:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.263440:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042958848:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 176us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.263449:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:1.0:1787826076.266110:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049251840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10086us (10141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.266123:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787826076.266476:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826076.271498:0:190434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1787826076.271886:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1787826076.271932:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787826076.271944:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbb0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.271956:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbb0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826076.271966:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1787826076.271969:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb34df96000 from 1 10000000:01000000:1.0:1787826076.271971:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787826076.272007:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.272016:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.272027:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826076.272051:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.272128:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826076.272174:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.272224:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049251968 00000100:00100000:3.0:1787826076.272233:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049251968 00000100:00100000:3.0:1787826076.272289:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787826076.272299:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049251968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826076.272313:0:190355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826076.272349:0:190355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34ab19200/0x878a5eea00cecbbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecbb7 expref: -99 pid: 190355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.272372:0:190355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34ab19200/0x878a5eea00cecbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecbb7 expref: 15 pid: 190355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.272383:0:190355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34ab19200/0x878a5eea00cecbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecbb7 expref: 15 pid: 190355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.272391:0:190355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19200, rc 0) 00000100:00100000:3.0:1787826076.272434:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049251968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.272442:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787826076.282789:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826076.282915:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049251968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.282942:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbbe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.282954:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecbbe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826076.282972:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787826076.282977:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbbe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.282983:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbbe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826076.282992:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787826076.282996:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb34df96000 from 7 10000000:01000000:0.0:1787826076.282998:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826076.283028:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.283035:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.283045:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.283066:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.283109:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.283147:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458967d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.283280:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042958976 00000100:00100000:1.0:1787826076.283287:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042958976 00000100:00100000:1.0:1787826076.283356:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049252096 00000100:00100000:1.0:1787826076.283359:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049252096 00000100:00100000:1.0:1787826076.283379:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:1.0:1787826076.283387:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042958976:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.283509:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042958976:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 121us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.283516:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:1.0:1787826076.283541:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787826076.283547:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049252096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826076.283555:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826076.283566:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb479b3ea00/0x878a5eea00cecbcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecbc5 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.283584:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb479b3ea00/0x878a5eea00cecbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecbc5 expref: 16 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.283593:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb479b3ea00/0x878a5eea00cecbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecbc5 expref: 16 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.283601:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ea00, rc 0) 00000100:00100000:1.0:1787826076.283629:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049252096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.283634:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826076.284346:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.284362:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.284371:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecbcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826076.284432:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.284459:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.284484:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458967d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.284531:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049252224 00000100:00100000:3.0:1787826076.284536:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049252224 00000100:00100000:3.0:1787826076.284567:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787826076.284574:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049252224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.284659:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049252224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.284666:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826076.285547:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.285585:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.285630:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.285663:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458967d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.286605:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049252352 00000100:00100000:3.0:1787826076.286616:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049252352 00000100:00100000:3.0:1787826076.286673:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787826076.286682:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049252352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.286825:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049252352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.286833:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787826076.286920:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826076.288375:0:190435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787826076.288564:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787826076.288599:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826076.288609:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.288620:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826076.288629:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787826076.288632:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb481220000 from 52 10000000:01000000:1.0:1787826076.288635:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826076.288666:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.288679:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.288688:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826076.288710:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.288764:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826076.288808:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.291214:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049252480 00000100:00100000:0.0:1787826076.291228:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049252480 00000100:00100000:0.0:1787826076.291301:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826076.291313:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049252480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.291357:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826076.291377:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724eda00/0x878a5eea00cecbda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecbd3 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.291403:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724eda00/0x878a5eea00cecbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecbd3 expref: 17 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.291414:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724eda00/0x878a5eea00cecbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecbd3 expref: 17 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.291423:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724eda00, rc 0) 00000100:00100000:0.0:1787826076.291502:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049252480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.291508:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787826076.292646:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826076.292673:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.292685:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecbda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826076.292761:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.292807:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826076.292844:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.293306:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049252608 00000100:00100000:3.0:1787826076.293312:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049252608 00000100:00100000:3.0:1787826076.293375:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787826076.293384:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049252608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.293515:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049252608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.293523:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787826076.293705:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.293743:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.293789:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826076.293822:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.295440:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049252736 00000100:00100000:3.0:1787826076.295452:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049252736 00000100:00100000:3.0:1787826076.295499:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787826076.295509:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049252736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.295650:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049252736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.295658:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787826076.295918:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.301475:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826076.301516:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042959104 00000100:00100000:0.0:1787826076.301525:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042959104 00000100:00100000:0.0:1787826076.301571:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:0.0:1787826076.301580:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042959104:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826076.301596:0:190351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826076.301623:0:190351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65600/0x878a5eea00cecbe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0b4 expref: -99 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.301651:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65600/0x878a5eea00cecbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0b4 expref: 10 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.301663:0:190351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65600/0x878a5eea00cecbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0b4 expref: 10 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826076.301672:0:190351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65600, rc 0) 00000100:00100000:0.0:1787826076.301719:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+10:15163:x1874663042959104:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 140us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.301726:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00000040:00080000:2.0:1787826076.301973:0:190436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1787826076.302169:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1787826076.302190:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826076.302199:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.302207:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826076.302216:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787826076.302219:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1787826076.302222:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787826076.302246:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.302253:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.302261:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826076.302298:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.302375:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826076.302412:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826076.304776:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049252864 00000100:00100000:2.0:1787826076.304789:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049252864 00000100:00100000:2.0:1787826076.304843:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787826076.304854:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049252864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826076.304869:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826076.304885:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf39400/0x878a5eea00cecbef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecbe8 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.305112:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf39400/0x878a5eea00cecbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecbe8 expref: 18 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.305123:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf39400/0x878a5eea00cecbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecbe8 expref: 18 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.305131:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39400, rc 0) 00000100:00100000:2.0:1787826076.305195:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049252864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826076.305202:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787826076.305258:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826076.305286:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.305295:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecbef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826076.305384:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.305416:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826076.305437:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826076.305450:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049252992 00000100:00100000:2.0:1787826076.305454:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049252992 00000100:00100000:2.0:1787826076.305478:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787826076.305485:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049252992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.312306:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049252992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6812us (6880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826076.312339:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787826076.312408:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049252992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.312463:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.312516:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826076.312536:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826076.312553:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049253120 00000100:00100000:2.0:1787826076.312559:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049253120 00000100:00100000:2.0:1787826076.312591:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787826076.312600:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a4bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049253120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.318382:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a4bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049253120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5771us (5854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826076.318396:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826076.318399:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.325458:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000040:00080000:1.0:1787826076.325653:0:190438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000100:00100000:1.0:1787826076.325738:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042959232 00000100:00100000:1.0:1787826076.325747:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042959232 00000100:00100000:1.0:1787826076.325785:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:1.0:1787826076.325794:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a4bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:15163:x1874663042959232:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.325901:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a4bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:15163:x1874663042959232:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 106us (450us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826076.325909:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 55 00000020:01000000:2.0:1787826076.328570:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1787826076.328614:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787826076.328625:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.328637:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826076.328646:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787826076.328649:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb481220000 from 7 10000000:01000000:2.0:1787826076.328652:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826076.328689:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.328696:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.328708:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826076.328731:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.328791:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826076.328839:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.328963:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049253248 00000100:00100000:1.0:1787826076.328973:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049253248 00000100:00100000:1.0:1787826076.329035:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787826076.329045:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049253248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826076.329060:0:190351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826076.329074:0:190351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb479b3e600/0x878a5eea00cecbfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecbf6 expref: -99 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.329099:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb479b3e600/0x878a5eea00cecbfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecbf6 expref: 19 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.329110:0:190351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb479b3e600/0x878a5eea00cecbfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecbf6 expref: 19 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.329123:0:190351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e600, rc 0) 00000100:00100000:1.0:1787826076.329170:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049253248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.329176:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787826076.329262:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826076.329286:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbfd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.329295:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecbfd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826076.329377:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.329403:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826076.329421:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.330895:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049253376 00000100:00100000:1.0:1787826076.330906:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049253376 00000100:00100000:1.0:1787826076.330950:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787826076.330958:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049253376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.331122:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049253376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.331130:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787826076.331184:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.331243:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.331298:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826076.331346:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.331361:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049253504 00000100:00100000:1.0:1787826076.331365:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049253504 00000100:00100000:1.0:1787826076.331388:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787826076.331395:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049253504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.331776:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049253504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 380us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.331784:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787826076.331834:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826076.336076:0:190440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787826076.336380:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787826076.336403:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787826076.336414:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbfd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.336426:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecbfd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826076.336436:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787826076.336439:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb47bfd6800 from 52 10000000:01000000:3.0:1787826076.336442:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787826076.336481:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.336489:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.336501:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826076.336525:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.336590:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826076.336631:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450cee300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.336651:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049253632 00000100:00100000:3.0:1787826076.336657:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049253632 00000100:00100000:3.0:1787826076.336699:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787826076.336707:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049253632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826076.336720:0:190353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826076.336731:0:190353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34ab19600/0x878a5eea00cecc0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecc04 expref: -99 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.336753:0:190353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34ab19600/0x878a5eea00cecc0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecc04 expref: 20 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.336764:0:190353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34ab19600/0x878a5eea00cecc0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecc04 expref: 20 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.336783:0:190353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19600, rc 0) 00000100:00100000:3.0:1787826076.336820:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049253632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.336826:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787826076.336873:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826076.336885:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc0b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.336907:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecc0b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826076.336960:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.336986:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826076.337000:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450cee300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.337012:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049253760 00000100:00100000:3.0:1787826076.337016:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049253760 00000100:00100000:3.0:1787826076.337037:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787826076.337043:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049253760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.337299:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049253760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.337306:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787826076.338899:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.338957:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.339037:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826076.339084:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.339689:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049253888 00000100:00100000:3.0:1787826076.339697:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049253888 00000100:00100000:3.0:1787826076.339749:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787826076.339758:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049253888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.339890:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049253888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.340025:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787826076.344349:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049253888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826076.352544:0:190441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1787826076.352657:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1787826076.352689:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787826076.352700:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc0b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.352716:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc0b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826076.352726:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787826076.352729:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787826076.352731:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787826076.352771:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.352777:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.352787:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826076.352811:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.352878:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826076.352930:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450cee300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.352980:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049254016 00000100:00100000:1.0:1787826076.352987:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049254016 00000100:00100000:1.0:1787826076.353036:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787826076.353046:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049254016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826076.353060:0:190352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826076.353073:0:190352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb479b3fc00/0x878a5eea00cecc19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecc12 expref: -99 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.353096:0:190352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb479b3fc00/0x878a5eea00cecc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecc12 expref: 21 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.353107:0:190352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb479b3fc00/0x878a5eea00cecc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecc12 expref: 21 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.353115:0:190352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fc00, rc 0) 00000100:00100000:1.0:1787826076.353162:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049254016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.353169:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787826076.353185:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826076.353198:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc19 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.353208:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecc19 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826076.353268:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.353303:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826076.353341:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450cee300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.353591:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049254144 00000100:00100000:1.0:1787826076.353596:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049254144 00000100:00100000:1.0:1787826076.353632:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787826076.353640:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049254144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.353925:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049254144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.353933:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787826076.354115:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.354151:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.354201:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.354239:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4589679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.354297:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049254272 00000100:00100000:3.0:1787826076.354302:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049254272 00000100:00100000:3.0:1787826076.354354:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787826076.354362:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049254272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.355574:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049254272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1206us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.355584:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787826076.355597:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826076.356864:0:190443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1787826076.357187:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787826076.357218:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787826076.357229:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc19 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.357240:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc19 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826076.357249:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787826076.357252:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb47bfd6800 from 7 10000000:01000000:3.0:1787826076.357254:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826076.357296:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.357303:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.357312:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826076.357357:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.357427:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826076.357462:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f630240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.358872:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049254400 00000100:00100000:1.0:1787826076.358881:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049254400 00000100:00100000:1.0:1787826076.359079:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787826076.359092:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049254400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826076.359109:0:190353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826076.359125:0:190353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb479b3f000/0x878a5eea00cecc27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecc20 expref: -99 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.359152:0:190353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb479b3f000/0x878a5eea00cecc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecc20 expref: 22 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.359162:0:190353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb479b3f000/0x878a5eea00cecc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecc20 expref: 22 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.359169:0:190353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f000, rc 0) 00000100:00100000:1.0:1787826076.359247:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049254400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826076.359254:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787826076.359321:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826076.359468:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc27 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826076.359477:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecc27 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826076.359543:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.359577:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826076.359601:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049254528 00000100:00100000:0.0:1787826076.359606:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049254528 00000100:00100000:2.0:1787826076.359615:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826076.359632:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787826076.359639:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049254528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826076.359781:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049254528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826076.359789:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787826076.359800:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.359827:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.359870:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826076.359905:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.360000:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049254656 00000100:00100000:3.0:1787826076.360005:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049254656 00000100:00100000:3.0:1787826076.360038:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787826076.360046:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049254656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826076.360144:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049254656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.360151:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787826076.361586:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826076.363177:0:190445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787826076.363856:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787826076.363881:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826076.363892:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc27 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.363908:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc27 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826076.363916:0:6488:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1787826076.363918:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8eb46a873370 from 1 10000000:01000000:1.0:1787826076.363920:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787826076.363960:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.363967:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.363977:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826076.363999:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.364061:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826076.364107:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.364486:0:190351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049254784 00000100:00100000:3.0:1787826076.364494:0:190351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049254784 00000100:00100000:3.0:1787826076.364539:0:190351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787826076.364548:0:190351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049254784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826076.364561:0:190351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826076.364574:0:190351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34ab18000/0x878a5eea00cecc35 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecc2e expref: -99 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.364597:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34ab18000/0x878a5eea00cecc35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecc2e expref: 23 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.364608:0:190351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34ab18000/0x878a5eea00cecc35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecc2e expref: 23 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.364616:0:190351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18000, rc 0) 00000100:00100000:3.0:1787826076.364663:0:190351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049254784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.364671:0:190351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787826076.364815:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826076.364831:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc35 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.364840:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecc35 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826076.364855:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787826076.364859:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc35 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.364869:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc35 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826076.364876:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787826076.364878:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8eb46a873370 from 1 10000000:01000000:1.0:1787826076.364880:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787826076.364896:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.364903:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.364911:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826076.364924:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.364953:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826076.364984:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826076.365851:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049254912 00000100:00100000:3.0:1787826076.365859:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049254912 00000100:00100000:3.0:1787826076.365901:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787826076.365909:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049254912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826076.365919:0:190353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826076.365933:0:190353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cecc43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecc3c expref: -99 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.365952:0:190353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cecc43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecc3c expref: 24 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.365962:0:190353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cecc43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecc3c expref: 24 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826076.365970:0:190353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18400, rc 0) 00000100:00100000:3.0:1787826076.366028:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049254912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826076.366034:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787826076.366561:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049254912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826076.366581:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc43 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.366590:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecc43 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826076.366653:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049255040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826076.366687:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826076.366856:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049255040 00000100:00100000:2.0:1787826076.366861:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049255040 00000100:00100000:2.0:1787826076.366900:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787826076.366909:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049255040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826076.366984:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049255040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (296us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826076.366991:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787826076.367547:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826076.367566:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049255040:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787826076.367598:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787826076.367606:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc43 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.367615:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecc43 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826076.502610:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826077.529988:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826078.548435:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826079.572457:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826079.572644:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826079.572668:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049255168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826079.572738:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826079.572819:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049255168 00000100:00100000:0.0:1787826079.572826:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049255168 00000100:00100000:0.0:1787826079.572893:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5719 00000100:00100000:0.0:1787826079.572908:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049255168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826079.572937:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826079.572980:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049255168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826079.572987:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5719 00000100:00080000:0.0:1787826079.573007:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826079.573058:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049255168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826079.576370:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049255296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826079.576438:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826079.577207:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049255296 00000100:00100000:1.0:1787826079.577217:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049255296 00000100:00100000:1.0:1787826079.577287:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5720 00000100:00100000:1.0:1787826079.577298:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049255296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826079.577345:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142528 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1787826079.577436:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826079.584456:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049255296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7149us (8007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826079.584472:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5720 00000100:00100000:0.0:1787826079.585269:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049255296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826079.995503:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826079.995708:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826079.995748:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826079.995785:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042959616 00000100:00100000:0.0:1787826079.995794:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042959616 00000100:00100000:0.0:1787826079.995858:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6937 00000100:00100000:0.0:1787826079.995869:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042959616:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826079.995951:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042959616:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826079.995958:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6937 00000100:00080000:0.0:1787826079.995982:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826079.996316:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042959360 00000100:00100000:1.0:1787826079.996321:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042959360 00000100:00100000:1.0:1787826079.996375:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00100000:1.0:1787826079.996383:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042959360:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826079.996420:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042959360:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826079.996426:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00100000:2.0:1787826079.998964:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042959488 00000100:00100000:2.0:1787826079.998977:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042959488 00000100:00100000:2.0:1787826079.999044:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:2.0:1787826079.999055:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042959488:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826079.999135:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042959488:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 82us (3640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826079.999144:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00080000:0.0:1787826079.999419:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826080.084472:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826080.084479:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826080.084483:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826080.084491:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8141 00000100:00080000:2.0:1787826080.084496:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826080.084502:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826080.084544:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481629500 x1874663049255552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826080.084575:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826080.084578:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826080.084580:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826080.084583:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8141 00000100:00080000:2.0:1787826080.084586:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826080.084589:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826080.084599:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f6f8380 x1874663049255808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826080.084612:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826080.084615:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826080.084617:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826080.084620:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8141 00000100:00080000:2.0:1787826080.084622:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826080.084625:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826080.084635:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448cd9880 x1874663049256064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826080.084643:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826080.084646:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826080.084647:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826080.084650:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8141 00000100:00080000:2.0:1787826080.084651:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826080.084655:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826080.084664:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448cd8380 x1874663049256192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826080.084687:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787826080.084690:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826080.084692:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826080.084696:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb348a3d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826080.084706:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448cd8a80 x1874663049256704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826080.084751:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049255424:0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.084815:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826080.084868:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049256448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.084898:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826080.084935:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826080.084941:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049256320:0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.084965:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826080.085001:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049255680:0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.085039:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826080.085057:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049256576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.085077:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826080.085092:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826080.085097:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049255936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826080.085113:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049256320 00000100:00100000:2.0:1787826080.085118:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826080.085122:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049256320 00000100:00100000:2.0:1787826080.085156:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049256448 00000100:00100000:2.0:1787826080.085160:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049256448 00000100:00100000:0.0:1787826080.085163:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12618 00000100:00100000:0.0:1787826080.085172:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049256320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.085190:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049256576 00000100:00100000:2.0:1787826080.085193:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049256576 00000100:00100000:2.0:1787826080.085212:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6938 00000100:00100000:2.0:1787826080.085218:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049256448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826080.085226:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:3620:x1874663049256320:12345-0@lo:400:kworker.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826080.085233:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12618 00000100:00100000:2.0:1787826080.085259:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049256448:12345-0@lo:400:kworker.0 Request processed in 42us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826080.085266:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6938 00000100:00100000:2.0:1787826080.085277:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6939 00000100:00100000:2.0:1787826080.085283:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049256576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826080.085303:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049255424 00000100:00100000:3.0:1787826080.085309:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049255424 00000100:00100000:2.0:1787826080.085342:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049256576:12345-0@lo:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826080.085348:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6939 00000100:00100000:3.0:1787826080.085355:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787826080.085365:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049255680 00000100:00100000:2.0:1787826080.085369:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049255680 00000100:00100000:2.0:1787826080.085395:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049255936 00000100:00100000:2.0:1787826080.085398:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049255936 00000100:00100000:2.0:1787826080.085416:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826080.085422:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049255680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.085453:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049255680:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826080.085459:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826080.085470:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787826080.085476:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049255936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.085502:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049255936:12345-0@lo:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826080.085508:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1787826080.085525:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826080.085529:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826080.085531:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826080.085565:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049255936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.085565:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049256320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826080.085575:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049255680:0@lo:400:kworker.0 00000100:00100000:2.0:1787826080.085576:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049256448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826080.085586:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049256576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826080.085620:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049255424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826080.085657:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049255424:12345-0@lo:400:kworker.0 Request processed in 296us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826080.085666:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787826080.085682:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049255424:0@lo:400:kworker.0 00000100:00100000:1.0:1787826080.087158:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049255552:0@lo:38:kworker.0 00000100:00100000:1.0:1787826080.087209:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826080.087297:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049255808:0@lo:38:kworker.0 00000100:00100000:1.0:1787826080.087323:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826080.087490:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049256064:0@lo:38:kworker.0 00000100:00100000:1.0:1787826080.087541:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1787826080.087545:0:184693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787826080.087567:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826080.087567:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049256192:0@lo:38:kworker.0 00000001:00100000:3.0:1787826080.087580:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787826080.087584:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049256832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826080.087595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826080.087620:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826080.087649:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049256064 00000100:00100000:0.0:1787826080.087656:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049256064 00000100:00100000:0.0:1787826080.087679:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049256832 00000100:00100000:0.0:1787826080.087682:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049256832 00000100:00100000:0.0:1787826080.087708:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12619 00000100:00100000:0.0:1787826080.087714:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049256064:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826080.087738:0:177390:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8eb34df97000, cookie 0x878a5eea00cecab4 00010000:00080000:0.0:1787826080.087743:0:177390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8eb34df97000 cur 8146 last 1787826074 00000004:00100000:0.0:1787826080.087760:0:177390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787826080.087772:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049255552 00000100:00100000:2.0:1787826080.087778:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049255552 00000100:00100000:2.0:1787826080.087815:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049255808 00000100:00100000:2.0:1787826080.087819:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049255808 00000100:00100000:2.0:1787826080.087844:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1787826080.087849:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049255552:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787826080.087866:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8146 last 0 00000020:00000080:2.0:1787826080.087911:0:187904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x878a5eea00cecc4a 00000004:00100000:2.0:1787826080.087930:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826080.087931:0:177390:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e5800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787826080.087957:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb46e35d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826080.087991:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049256064:12345-0@lo:38:kworker.0 Request processed in 275us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826080.088000:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12619 00000100:00100000:2.0:1787826080.088005:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874663049255552:12345-0@lo:38:kworker.0 Request processed in 153us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826080.088019:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12620 00000100:00100000:0.0:1787826080.088028:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049256832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826080.088052:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826080.088087:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:3617:x1874663049256832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826080.088094:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12620 00000100:00100000:2.0:1787826080.088123:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1787826080.088140:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049256832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826080.088146:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:2.0:1787826080.088153:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049255808:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787826080.088169:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8146 last 0 00000020:00000080:2.0:1787826080.088188:0:187904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x878a5eea00cecc51 00000004:00100000:2.0:1787826080.088195:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826080.088211:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb46e35a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826080.088240:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874663049255808:12345-0@lo:38:kworker.0 Request processed in 86us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826080.088263:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00010000:00080000:0.0:1787826080.089415:0:190378:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787826080.089424:0:190378:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 335007449221 00000020:00080000:0.0:1787826080.089429:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826080.089433:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 335007449221 00000020:00080000:0.0:1787826080.089437:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826080.089439:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 335007449221 00000100:00100000:1.0:1787826080.090109:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049256704:0@lo:38:kworker.0 00000100:00100000:1.0:1787826080.090153:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826080.090197:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049256192 00000100:00100000:0.0:1787826080.090205:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049256192 00010000:00080000:1.0:1787826080.090206:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481629500 x1874663049255552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826080.090223:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 79 00000100:00080000:1.0:1787826080.091253:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8eb481629500 x1874663049255552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826095 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826080.091265:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787826080.091270:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826080.091275:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787826080.091280:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049255552:0@lo:38:kworker.0 00010000:00080000:1.0:1787826080.091306:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb44f6f8380 x1874663049255808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826080.091318:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 79 00000100:00080000:1.0:1787826080.092102:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8eb44f6f8380 x1874663049255808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826095 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826080.092111:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787826080.092115:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826080.092120:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787826080.092124:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049255808:0@lo:38:kworker.0 00000100:00080000:1.0:1787826080.092145:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 79 00000100:00080000:1.0:1787826080.092152:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787826080.092156:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1787826080.092158:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 330712483740 gen 2 00000100:00080000:1.0:1787826080.092161:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff8eb48165c000 from lustre-MDT0000_UUID committed 330712483740 last 0 00000100:00080000:1.0:1787826080.092164:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1787826080.092376:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049256064:0@lo:38:kworker.0 00010000:00080000:1.0:1787826080.092412:0:190621:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1787826080.092417:0:190621:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1787826080.092422:0:190621:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1787826080.092805:0:190621:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787826080.092851:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049256960:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787826080.092910:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826080.092963:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049256960 00000100:00100000:1.0:1787826080.092972:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049256960 00000100:00100000:1.0:1787826080.093012:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12621 00000100:00100000:1.0:1787826080.093021:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049256960:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1787826080.093042:0:177390:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb46ea69f80 x1874663049256960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:436/0 lens 224/0 e 0 to 0 dl 1787826091 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826080.093058:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049256960:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 39us (149us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826080.093064:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12621 00000020:00080000:1.0:1787826080.093083:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787826080.093087:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449221 00000100:00100000:0.0:1787826080.094905:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049256704 00000100:00100000:0.0:1787826080.094915:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049256704 00000100:00100000:3.0:1787826080.095079:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1787826080.095088:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049256192:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787826080.095114:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8146 last 0 00000020:00000080:3.0:1787826080.095154:0:187906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x878a5eea00cecc58 00000004:00100000:3.0:1787826080.095169:0:187906:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787826080.095202:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb44908d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826080.095291:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874663049256192:12345-0@lo:38:kworker.0 Request processed in 202us (7694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826080.095298:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1787826080.095317:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:3.0:1787826080.095321:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049256704:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787826080.095350:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8146 last 0 00000020:00000080:3.0:1787826080.095371:0:187906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x878a5eea00cecc5f 00000004:00100000:3.0:1787826080.095377:0:187906:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787826080.095392:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb44908e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826080.095420:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049256704:12345-0@lo:38:kworker.0 Request processed in 97us (5268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826080.095427:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00010000:00080000:1.0:1787826080.095706:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb448cd8380 x1874663049256192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826080.095723:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 79 00000100:00080000:1.0:1787826080.096835:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8eb448cd8380 x1874663049256192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826095 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826080.096846:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787826080.096851:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826080.096854:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787826080.096860:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049256192:0@lo:38:kworker.0 00010000:00080000:1.0:1787826080.096885:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb448cd8a80 x1874663049256704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826080.096897:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 79 00000100:00080000:1.0:1787826080.096902:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787826080.096906:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787826080.096908:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787826080.096912:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049256704:0@lo:38:kworker.0 00000001:02000400:2.0:1787826080.245102:0:190630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787826080.596464:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787826081.110514:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869980 is committed 00000020:00000004:0.0:1787826081.254455:0:190682:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826081.254662:0:190682:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787826081.620604:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787826082.177588:0:190732:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826082.177860:0:190732:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787826082.645186:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826083.668497:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826084.693309:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826084.693347:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049257088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826084.693418:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826084.693493:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049257088 00000100:00100000:1.0:1787826084.693501:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049257088 00000100:00100000:1.0:1787826084.693565:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5721 00000100:00100000:1.0:1787826084.693576:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049257088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826084.693606:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826084.693664:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049257088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826084.693671:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5721 00000100:00080000:2.0:1787826084.693690:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826084.693717:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049257088:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787826084.694084:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826084.694185:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826084.694197:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049257216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826084.694242:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826084.694706:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049257216 00000100:00100000:3.0:1787826084.694713:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049257216 00000100:00100000:3.0:1787826084.694758:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5722 00000100:00100000:3.0:1787826084.694767:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049257216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826084.694789:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142528 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826084.694835:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049257216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826084.694841:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5722 00000100:00100000:3.0:1787826084.694878:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049257216:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787826084.694942:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826085.121072:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826085.121119:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826085.121157:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826085.121367:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042959872 00000100:00100000:1.0:1787826085.121377:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042959872 00000100:00100000:1.0:1787826085.121430:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:1.0:1787826085.121438:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042959872:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826085.121502:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042959872:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 64us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826085.121508:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:2.0:1787826085.121822:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042960128 00000100:00100000:2.0:1787826085.121834:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042960128 00000100:00100000:2.0:1787826085.121889:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6940 00000100:00100000:2.0:1787826085.121898:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042960128:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826085.121935:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042960128:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826085.121942:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6940 00000100:00100000:3.0:1787826085.122113:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042960000 00000100:00100000:3.0:1787826085.122118:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042960000 00000100:00100000:3.0:1787826085.122161:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00100000:3.0:1787826085.122168:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042960000:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826085.122201:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042960000:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 34us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826085.122207:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00080000:1.0:1787826085.122739:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826085.122744:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826085.204688:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049257344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826085.204763:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826085.205360:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049257344 00000100:00100000:0.0:1787826085.205369:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049257344 00000100:00100000:0.0:1787826085.205431:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12622 00000100:00100000:0.0:1787826085.205442:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049257344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826085.205479:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826085.205540:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049257344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826085.205548:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12622 00000100:00100000:3.0:1787826085.205627:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869980 gen 2 00000004:00080000:3.0:1787826085.205633:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869978 committed transno 17179869980 00000004:00080000:3.0:1787826085.205650:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869979 committed transno 17179869980 00000004:00080000:3.0:1787826085.205665:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869980 committed transno 17179869980 00000100:00100000:3.0:1787826085.205684:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049257344:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1787826085.206562:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826085.206568:0:179516:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1787826085.206620:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049257472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.206670:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826085.206699:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049257984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.206722:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826085.206738:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049258496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.206764:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826085.206783:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787826085.206789:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049257856:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.206807:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826085.206833:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049258368:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.206858:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826085.207595:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049257472 00000100:00100000:3.0:1787826085.207602:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049257472 00000100:00100000:3.0:1787826085.207650:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787826085.207660:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049257472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.207716:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049257472:12345-0@lo:400:kworker.0 Request processed in 57us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826085.207724:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787826085.207758:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049258496 00000100:00100000:3.0:1787826085.207761:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049258496 00000100:00100000:3.0:1787826085.207795:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6941 00000100:00100000:3.0:1787826085.207801:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049258496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.207852:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049258496:12345-0@lo:400:kworker.0 Request processed in 51us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826085.207859:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6941 00000100:00100000:3.0:1787826085.207877:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049257984 00000100:00100000:3.0:1787826085.208062:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049257984 00000100:00100000:3.0:1787826085.208095:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049257856 00000100:00100000:3.0:1787826085.208098:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049257856 00000100:00100000:3.0:1787826085.208112:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049258368 00000100:00100000:3.0:1787826085.208114:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049258368 00000100:00100000:3.0:1787826085.208390:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787826085.208398:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049257984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.208439:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049257984:12345-0@lo:400:kworker.0 Request processed in 42us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826085.208444:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787826085.208455:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787826085.208461:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049257856:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826085.208471:0:188992:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb481d55180 x1874663049257856/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:441/0 lens 224/0 e 0 to 0 dl 1787826096 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826085.208501:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049257856:12345-0@lo:400:kworker.0 Request processed in 40us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826085.208506:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787826085.208516:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787826085.208522:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049258368:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826085.208531:0:188992:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb481d57b80 x1874663049258368/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:441/0 lens 224/0 e 0 to 0 dl 1787826096 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826085.208558:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049258368:12345-0@lo:400:kworker.0 Request processed in 36us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826085.208564:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1787826085.208588:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826085.208593:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826085.208609:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049257600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.208638:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826085.208659:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049258112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.208679:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826085.208694:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049258624:0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.208718:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826085.208744:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049257600 00000100:00100000:3.0:1787826085.208748:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049257600 00000100:00100000:3.0:1787826085.208769:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787826085.208775:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049257600:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826085.208782:0:188992:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb348e5e680 x1874663049257600/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:441/0 lens 224/0 e 0 to 0 dl 1787826096 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826085.208814:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049257600:12345-0@lo:400:kworker.0 Request processed in 39us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826085.208821:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1787826085.208859:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb46ea68a80 x1874663049257600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826085.208872:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049257600:0@lo:400:kworker.0 00000100:00100000:2.0:1787826085.209272:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049258112 00000100:00100000:2.0:1787826085.209277:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049258112 00000100:00100000:2.0:1787826085.209308:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049258624 00000100:00100000:2.0:1787826085.209311:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049258624 00000100:00100000:2.0:1787826085.209358:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6942 00000100:00100000:2.0:1787826085.209365:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049258112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826085.209407:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049258112:12345-0@lo:400:kworker.0 Request processed in 43us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826085.209413:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6942 00000100:00100000:2.0:1787826085.209425:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6943 00000100:00100000:2.0:1787826085.209430:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049258624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826085.209453:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049258624:12345-0@lo:400:kworker.0 Request processed in 23us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826085.209458:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6943 00000100:00080000:2.0:1787826085.209484:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826085.209504:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049258112:0@lo:400:kworker.0 00000100:00100000:2.0:1787826085.209512:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049258624:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.209718:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049257728:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.209755:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826085.209777:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049258240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.209797:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826085.209822:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049258752:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.209844:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826085.209875:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049258240 00000100:00100000:1.0:1787826085.209878:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049258240 00000100:00100000:1.0:1787826085.209902:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6944 00000100:00100000:1.0:1787826085.209908:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049258240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826085.210055:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049257728 00000100:00100000:0.0:1787826085.210060:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049257728 00000100:00100000:0.0:1787826085.210093:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049258752 00000100:00100000:0.0:1787826085.210096:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049258752 00000100:00100000:0.0:1787826085.210113:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787826085.210120:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049257728:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826085.210269:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb46ea6a300 x1874663049257856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826085.210287:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049257856:0@lo:400:kworker.0 00010000:00080000:3.0:1787826085.210311:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb44f6c0e00 x1874663049258368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826085.210320:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049258368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.210345:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049257472:0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.210357:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049257984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.210369:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049258496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826085.210401:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787826085.210409:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049258752:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826085.210419:0:188992:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb481d56300 x1874663049258752/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:441/0 lens 224/0 e 0 to 0 dl 1787826096 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826085.210520:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826085.212633:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049257728:12345-0@lo:400:kworker.0 Request processed in 2503us (2867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826085.212646:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787826085.213249:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049257728:0@lo:400:kworker.0 00000100:00100000:1.0:1787826085.217153:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049258240:12345-0@lo:400:kworker.0 Request processed in 7235us (7345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826085.217168:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6944 00000100:00100000:3.0:1787826085.218597:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049258752:12345-0@lo:400:kworker.0 Request processed in 8181us (8743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826085.218611:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787826085.226431:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049258240:0@lo:400:kworker.0 00010000:00080000:2.0:1787826085.226463:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb44f6c2d80 x1874663049258752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826085.226475:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049258752:0@lo:400:kworker.0 00010000:00010000:2.0:1787826085.716532:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826086.740487:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826087.765499:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826088.790144:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826089.812843:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049258880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826089.812913:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826089.813035:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049258880 00000100:00100000:3.0:1787826089.813044:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049258880 00000100:00100000:3.0:1787826089.813116:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5723 00000100:00100000:3.0:1787826089.813126:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049258880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826089.813158:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142528 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826089.813212:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049258880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826089.813219:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5723 00000100:00080000:0.0:1787826089.813348:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826089.813386:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049258880:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826089.813524:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826089.814529:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826089.814545:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049259008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826089.814591:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826089.814686:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049259008 00000100:00100000:2.0:1787826089.814693:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049259008 00000100:00100000:2.0:1787826089.814751:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5724 00000100:00100000:2.0:1787826089.814761:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049259008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826089.814785:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826089.814827:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049259008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826089.814834:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5724 00000100:00080000:0.0:1787826089.814892:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826089.814921:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049259008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826090.236487:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826090.236540:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826090.236578:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826090.236666:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042960256 00000100:00100000:1.0:1787826090.236677:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042960256 00000100:00100000:1.0:1787826090.236734:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00100000:1.0:1787826090.236746:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2390:x1874663042960256:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826090.236815:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2390:x1874663042960256:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826090.236823:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00100000:3.0:1787826090.237047:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042960512 00000100:00100000:3.0:1787826090.237104:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042960512 00000100:00100000:3.0:1787826090.237157:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6945 00000100:00100000:3.0:1787826090.237166:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042960512:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826090.237215:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042960512:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 50us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826090.237222:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6945 00000100:00080000:0.0:1787826090.237295:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826090.237403:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042960384 00000100:00100000:2.0:1787826090.237408:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042960384 00000100:00100000:2.0:1787826090.237461:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 106 00000100:00100000:2.0:1787826090.237470:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042960384:12345-192.168.203.47@tcp:400:kworker.0 00000100:00080000:0.0:1787826090.237602:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826090.238142:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042960384:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 671us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826090.238150:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 106 00000100:00100000:0.0:1787826090.324605:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049259392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826090.324682:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826090.324841:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049259136:0@lo:400:kworker.0 00000100:00100000:2.0:1787826090.324891:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826090.324932:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826090.324938:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049259264:0@lo:400:kworker.0 00000100:00100000:2.0:1787826090.324968:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826090.325002:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049259392 00000100:00100000:2.0:1787826090.325010:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049259392 00000100:00100000:3.0:1787826090.325027:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049259136 00000100:00100000:3.0:1787826090.325032:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049259136 00000100:00100000:2.0:1787826090.325066:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049259264 00000100:00100000:2.0:1787826090.325070:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049259264 00000100:00100000:3.0:1787826090.325070:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787826090.325078:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049259136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826090.325088:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787826090.325093:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049259392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.325128:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049259136:12345-0@lo:400:kworker.0 Request processed in 50us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826090.325135:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787826090.325184:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787826090.325192:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049259264:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826090.325203:0:188992:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb448cd8a80 x1874663049259264/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:446/0 lens 224/0 e 0 to 0 dl 1787826101 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826090.325490:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049259264:12345-0@lo:400:kworker.0 Request processed in 299us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826090.325498:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1787826090.326378:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481d56680 x1874663049259264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826090.326394:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049259264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.326407:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049259136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.326487:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826090.326498:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049259648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826090.326541:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826090.326589:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049259648 00000100:00100000:3.0:1787826090.326595:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049259648 00000100:00100000:3.0:1787826090.326891:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12623 00000100:00100000:3.0:1787826090.326904:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049259648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826090.326938:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:3.0:1787826090.326981:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049259648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826090.326987:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12623 00000100:00100000:3.0:1787826090.327012:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049259520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.327038:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826090.327084:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049259648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826090.327114:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049259520 00000100:00100000:3.0:1787826090.327118:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049259520 00000100:00100000:3.0:1787826090.327144:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787826090.327150:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049259520:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826090.327160:0:188682:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb348e5fb80 x1874663049259520/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:446/0 lens 224/0 e 0 to 0 dl 1787826101 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826090.327209:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049259520:12345-0@lo:400:kworker.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826090.327216:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1787826090.328156:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826090.328162:0:179516:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1787826090.328238:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049259776:0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.328285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826090.328312:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049260288:0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.328352:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826090.328373:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826090.328417:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049259776 00000100:00100000:3.0:1787826090.328423:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049259776 00000100:00100000:3.0:1787826090.328459:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787826090.328467:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049259776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.328510:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049259776:12345-0@lo:400:kworker.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826090.328516:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787826090.328541:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049260032:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.328565:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826090.328585:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049260544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.328611:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826090.328735:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049260160:0@lo:400:kworker.0 00010000:00080000:3.0:1787826090.329408:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481d54e00 x1874663049259520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826090.329424:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049259520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.329446:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826090.329452:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049259904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.330431:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826090.330484:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049259776:0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.330545:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049260288 00000100:00100000:1.0:1787826090.330550:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049260288 00000100:00100000:1.0:1787826090.330587:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049260032 00000100:00100000:1.0:1787826090.330590:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049260032 00000100:00100000:1.0:1787826090.330612:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6946 00000100:00100000:1.0:1787826090.330618:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049260288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.330666:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049260288:12345-0@lo:400:kworker.0 Request processed in 47us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826090.330672:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6946 00000100:00100000:1.0:1787826090.330689:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6947 00000100:00100000:1.0:1787826090.330696:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049260032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.330725:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049260032:12345-0@lo:400:kworker.0 Request processed in 30us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826090.330732:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6947 00000100:00100000:1.0:1787826090.332193:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049260544 00000100:00100000:1.0:1787826090.332206:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049260544 00000100:00100000:1.0:1787826090.332248:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049260160 00000100:00100000:1.0:1787826090.332252:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049260160 00000100:00100000:1.0:1787826090.332267:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787826090.332275:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049260544:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787826090.332292:0:187906:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb348e5f100 x1874663049260544/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:446/0 lens 224/0 e 0 to 0 dl 1787826101 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826090.332461:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049260544:12345-0@lo:400:kworker.0 Request processed in 186us (3848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826090.332468:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787826090.332485:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787826090.332491:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049260160:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787826090.332499:0:187906:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb481233800 x1874663049260160/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:446/0 lens 224/0 e 0 to 0 dl 1787826101 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826090.332528:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049260160:12345-0@lo:400:kworker.0 Request processed in 38us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826090.332534:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1787826090.332575:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481232d80 x1874663049260160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826090.332587:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049260160:0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.332600:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049260288:0@lo:400:kworker.0 00000100:00080000:1.0:1787826090.332653:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826090.332664:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826090.334672:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049259392:12345-0@lo:400:kworker.0 Request processed in 9568us (9980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826090.334688:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787826090.334956:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049259392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.335308:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826090.335434:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049260416:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.335469:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826090.335483:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049259904 00000100:00100000:1.0:1787826090.335491:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049259904 00000100:00100000:3.0:1787826090.335503:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049260032:0@lo:400:kworker.0 00010000:00080000:3.0:1787826090.335516:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481230e00 x1874663049260544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826090.335526:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049260544:0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.335539:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049260416 00000100:00100000:1.0:1787826090.335542:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049260416 00000100:00080000:3.0:1787826090.335574:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826090.335575:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6948 00000100:00100000:1.0:1787826090.335584:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049259904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.335645:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049259904:12345-0@lo:400:kworker.0 Request processed in 63us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826090.335651:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6948 00000100:00100000:1.0:1787826090.335667:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6949 00000100:00100000:1.0:1787826090.335673:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049260416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826090.335702:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049260416:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826090.335709:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6949 00000100:00100000:3.0:1787826090.335722:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049259904:0@lo:400:kworker.0 00000100:00100000:3.0:1787826090.335732:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049260416:0@lo:400:kworker.0 00010000:00010000:3.0:1787826090.837361:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826091.294970:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826091.296275:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042960640 00000100:00100000:3.0:1787826091.296288:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042960640 00000100:00100000:3.0:1787826091.296375:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 113 00000100:00100000:3.0:1787826091.296387:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042960640:12345-192.168.203.47@tcp:38:ptlrpcd_rcv.0 00010000:02000400:3.0:1787826091.296421:0:187906:0:(ldlm_lib.c:974:target_handle_reconnect()) lustre-MDT0000: Client a9ce6693-0634-46c5-bf21-5ca7d026d44e (at 192.168.203.47@tcp) reconnected, waiting for 2 clients in recovery for 0:53 00010000:00080000:3.0:1787826091.324748:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp recovering/t330712482189 exp ffff8eb34df92000 cur 8158 last 1787826091 00000004:00100000:3.0:1787826091.324787:0:187906:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.203.47@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1787826091.324817:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb343644800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1787826091.324827:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb343644800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826091.324923:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042960640:12345-192.168.203.47@tcp:38:ptlrpcd_rcv.0 Request processed in 28536us (29961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826091.324935:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 113 00000100:00100000:3.0:1787826091.330110:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826091.330458:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663041393408 00000100:00100000:1.0:1787826091.330468:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663041393408 00000100:00100000:1.0:1787826091.330540:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 913 00000100:00100000:1.0:1787826091.330552:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663041393408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00080000:1.0:1787826091.330570:0:188992:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449221, current: 330712482189, replaying 00010000:00010000:1.0:1787826091.330581:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826091.330619:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cecc66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d64bee expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826091.334894:0:188992:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4218us 00000004:00080000:0.0:1787826091.366207:0:188992:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff8eb481d55c00 x1874663041393408/t0(330712482189) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 520/3488 e 0 to 0 dl 1787826102 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00000400:0.0:1787826091.366223:0:188992:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff8eb481d55c00 x1874663041393408/t330712482189(330712482189) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 520/3488 e 0 to 0 dl 1787826102 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00200000:0.0:1787826091.392101:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00080000:0.0:1787826091.392129:0:188992:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x17e0:0x0], cookie = 0x878a5eea00cba2c0 00000004:00080000:0.0:1787826091.392132:0:188992:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x878a5eea00cba2c0 in new mfd 00010000:00010000:0.0:1787826091.392206:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cecc66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.392299:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb45edbd200) 00010000:00010000:0.0:1787826091.392303:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826091.392309:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e200/0x878a5eea00cecc66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.392546:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e200, rc 0) 00000100:00100000:0.0:1787826091.392630:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663041393408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 62071us (62520us total) trans 330712482189 rc 301/301 00000100:00100000:0.0:1787826091.392640:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 913 00000100:00100000:2.0:1787826091.397598:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826091.397738:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042950784 00000100:00100000:3.0:1787826091.397749:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042950784 00000100:00100000:3.0:1787826091.397826:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 914 00000100:00100000:3.0:1787826091.397837:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042950784:12345-192.168.203.47@tcp:101:multiop.0 00010000:00080000:3.0:1787826091.397860:0:188682:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449221, current: 335007449219, replaying 00010000:00010000:3.0:1787826091.397871:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826091.398019:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cecc74 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f075 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826091.398298:0:188682:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x1bd0:0x0], cookie = 0x878a5eea00cec995 00000004:00080000:3.0:1787826091.398302:0:188682:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x878a5eea00cec995 in new mfd 00010000:00010000:3.0:1787826091.398449:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cecc74 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f075 expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.398464:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb472727900) 00010000:00010000:3.0:1787826091.398467:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826091.398472:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cecc74 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f075 expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.398491:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18e00, rc 0) 00000100:00100000:3.0:1787826091.398547:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2388:x1874663042950784:12345-192.168.203.47@tcp:101:multiop.0 Request processed in 712us (957us total) trans 335007449219 rc 301/301 00000100:00100000:3.0:1787826091.398555:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 914 00000100:00100000:3.0:1787826091.401655:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826091.401730:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042952192 00000100:00100000:1.0:1787826091.401740:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042952192 00000100:00100000:1.0:1787826091.401802:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 915 00000100:00100000:1.0:1787826091.401814:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2388:x1874663042952192:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00080000:1.0:1787826091.401833:0:187906:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449221, current: 335007449221, replaying 00000100:00100000:1.0:1787826091.401849:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2388:x1874663042952192:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 39us (205us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826091.401856:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 915 00000020:00080000:0.0:1787826091.402025:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826091.402029:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 335007449221, next_transno: 335007449221 00010000:00080000:0.0:1787826091.402033:0:190378:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (335007449221) 00000020:00080000:0.0:1787826091.402036:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826091.402045:0:190378:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1874663042952192 t335007449221 from 192.168.203.47@tcp req@ffff8eb481d56680 x1874663042952192/t0(335007449221) o36->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 528/0 e 0 to 0 dl 1787826102 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826091.402215:0:190378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402241:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402258:0:190378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402272:0:190378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402279:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402286:0:190378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402680:0:190378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402689:0:190378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402695:0:190378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402701:0:190378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826091.402705:0:190378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402712:0:190378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402725:0:190378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb480de3d00) 00010000:00010000:0.0:1787826091.402728:0:190378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826091.402731:0:190378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402737:0:190378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64800/0x878a5eea00cecc82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826091.402755:0:190378:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0e16881 reply state 000000008b881f96 transno 335007449221 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402764:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.402770:0:190378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3b00) 00010000:00010000:0.0:1787826091.402772:0:190378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826091.402774:0:190378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787826091.403187:0:190378:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787826091.403209:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826091.403223:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449222 00000020:00080000:0.0:1787826091.403228:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826091.403230:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449222 00000100:00100000:3.0:1787826091.406390:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826091.406471:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042952704 00000100:00100000:0.0:1787826091.406481:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042952704 00000100:00100000:0.0:1787826091.406543:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 916 00000100:00100000:0.0:1787826091.406554:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2388:x1874663042952704:12345-192.168.203.47@tcp:36:rm.0 00010000:00080000:0.0:1787826091.406573:0:188992:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 335007449222, current: 335007449222, replaying 00000100:00100000:0.0:1787826091.406592:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2388:x1874663042952704:12345-192.168.203.47@tcp:36:rm.0 Request processed in 41us (211us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826091.406599:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 916 00000020:00080000:2.0:1787826091.406762:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826091.406766:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 335007449222, next_transno: 335007449222 00010000:00080000:2.0:1787826091.406771:0:190378:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (335007449222) 00000020:00080000:2.0:1787826091.406775:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826091.406784:0:190378:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1874663042952704 t335007449222 from 192.168.203.47@tcp req@ffff8eb481d54e00 x1874663042952704/t0(335007449222) o36->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 512/0 e 0 to 0 dl 1787826102 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826091.406876:0:190378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.406902:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.406915:0:190378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.406930:0:190378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.406938:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.406946:0:190378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407040:0:190378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407050:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407057:0:190378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407283:0:190378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407295:0:190378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407303:0:190378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407308:0:190378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826091.407312:0:190378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407320:0:190378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407364:0:190378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd1:0x0].0x0 (ffff8eb448d12800) 00010000:00010000:2.0:1787826091.407368:0:190378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826091.407372:0:190378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407379:0:190378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00cecc9e lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407400:0:190378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407407:0:190378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407411:0:190378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407416:0:190378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826091.407419:0:190378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407425:0:190378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407433:0:190378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb448d12700) 00010000:00010000:2.0:1787826091.407435:0:190378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826091.407438:0:190378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407444:0:190378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00cecc90 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826091.407456:0:190378:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050312b1f reply state 00000000270ea6e6 transno 335007449222 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407468:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.407475:0:190378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3b00) 00010000:00010000:2.0:1787826091.407478:0:190378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826091.407480:0:190378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1787826091.407548:0:190378:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787826091.407567:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826091.407570:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449223 00000020:00080000:2.0:1787826091.407573:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826091.407575:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449223 00000100:00100000:2.0:1787826091.415106:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826091.415147:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826091.415218:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042960768 00000100:00100000:0.0:1787826091.415228:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042960768 00000100:00100000:0.0:1787826091.415286:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042960896 00000100:00100000:0.0:1787826091.415290:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042960896 00000100:00100000:0.0:1787826091.415314:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 917 00000100:00100000:0.0:1787826091.415355:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042960768:12345-192.168.203.47@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787826091.415381:0:187904:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8eb448cd9880 x1874663042960768/t0(0) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826102 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826091.415396:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042960768:12345-192.168.203.47@tcp:101:ldlm_lock_repla.0 Request processed in 74us (299us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826091.415404:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 917 00000100:00100000:0.0:1787826091.415416:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 918 00000100:00100000:0.0:1787826091.415424:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042960896:12345-192.168.203.47@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787826091.415432:0:187904:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8eb448cd8700 x1874663042960896/t0(0) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826102 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826091.415442:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042960896:12345-192.168.203.47@tcp:101:ldlm_lock_repla.0 Request processed in 21us (296us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826091.415448:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 918 00000020:00080000:2.0:1787826091.415534:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826091.415539:0:190378:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 335007449223 00010000:00080000:2.0:1787826091.415542:0:190378:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1787826091.415545:0:190378:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826091.415551:0:190378:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826091.415554:0:190378:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826091.415560:0:190378:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.47@tcp: req@ffff8eb448cd9880 x1874663042960768/t0(0) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826102 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826091.415577:0:190378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826091.415603:0:190378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cecca5 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d64bee expref: -99 pid: 190378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.415629:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cecca5 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 13 pid: 190378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.415643:0:190378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cecca5 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 13 pid: 190378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.415651:0:190378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39600, rc 0) 00010000:00080000:2.0:1787826091.415711:0:190378:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1787826091.415722:0:190378:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826091.415724:0:190378:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826091.415729:0:190378:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.47@tcp: req@ffff8eb448cd8700 x1874663042960896/t0(0) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 328/0 e 0 to 0 dl 1787826102 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826091.415739:0:190378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826091.415749:0:190378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceccac lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d64b3f expref: -99 pid: 190378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.415764:0:190378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceccac lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64b3f expref: 13 pid: 190378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.415775:0:190378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceccac lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64b3f expref: 13 pid: 190378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.415782:0:190378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38c00, rc 0) 00010000:00080000:2.0:1787826091.415800:0:190378:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1787826091.415807:0:190378:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1787826091.425868:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826091.425988:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042961024 00000100:00100000:2.0:1787826091.425999:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042961024 00000100:00100000:2.0:1787826091.426061:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 114 00000100:00100000:2.0:1787826091.426073:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:2388:x1874663042961024:12345-192.168.203.47@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1787826091.426094:0:188682:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb46ea6b800 x1874663042961024/t0(0) o400->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 224/0 e 0 to 0 dl 1787826102 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826091.426122:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:2388:x1874663042961024:12345-192.168.203.47@tcp:400:ptlrpcd_rcv.0 Request processed in 52us (265us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826091.426130:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 114 00010000:00080000:1.0:1787826091.426203:0:190378:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787826091.426356:0:190378:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 79, last_transno is 339302416384 00000001:00100000:2.0:1787826091.429398:0:190345:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000001:00100000:2.0:1787826091.429422:0:190345:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1787826091.429444:0:190345:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449222 is committed 00000001:00080000:1.0:1787826091.429533:0:190378:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1787826091.429569:0:190378:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1787826091.429582:0:190378:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8eb46ea69f80 x1874663049256960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:448/0 lens 224/0 e 1 to 0 dl 1787826103 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826091.429696:0:190378:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.47@tcp: req@ffff8eb46ea6b800 x1874663042961024/t0(0) o400->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:447/0 lens 224/0 e 0 to 0 dl 1787826102 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1787826091.429754:0:190378:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:17, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1787826091.430253:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787826091.430263:0:3616:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8eb46ea6a680 x1874663049256960/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1787826108 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826091.430272:0:3616:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8eb46ea6a680 x1874663049256960/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1787826108 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826091.430279:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787826091.430290:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1787826091.430296:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000245c9e2c): req@ffff8eb34ddd4a80 x1874663049236352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826064 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826091.430313:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049256960:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787826091.430396:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826091.430409:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049260672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826091.430451:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826091.430526:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049260672 00000100:00100000:2.0:1787826091.430533:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049260672 00000100:00100000:2.0:1787826091.430582:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12624 00000100:00100000:2.0:1787826091.430594:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049260672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826091.430626:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:3.0:1787826091.430627:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826091.430661:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049236352 00000100:00100000:3.0:1787826091.430666:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049236352 00000100:00100000:2.0:1787826091.430682:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1874663049260672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826091.430690:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12624 00000100:00100000:3.0:1787826091.430698:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12625 00000100:00100000:3.0:1787826091.430708:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049236352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826091.430722:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:3.0:1787826091.430764:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049236352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826091.430771:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12625 00000100:00100000:3.0:1787826091.430805:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049260672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826091.431250:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049236352:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787826091.431265:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431279:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431287:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431294:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826091.431298:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431306:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431344:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3b00) 00010000:00010000:0.0:1787826091.431348:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826091.431352:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431359:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecc89 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431376:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431382:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431388:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431398:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826091.431401:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431407:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431413:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb480de3b00) 00010000:00010000:0.0:1787826091.431415:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826091.431418:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.431423:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cecc97 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826091.440737:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826091.440944:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042959744 00000100:00100000:2.0:1787826091.440954:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042959744 00000100:00100000:2.0:1787826091.441032:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 919 00000100:00100000:2.0:1787826091.441043:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+8:156822:x1874663042959744:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826091.441064:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826091.441086:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceccb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0bb expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.441153:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceccba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.441178:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceccba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.441194:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceccba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826091.441244:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787826091.441248:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826091.441270:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceccba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.441295:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38400/0x878a5eea00ceccb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0bb expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.441315:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceccba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0bb expref: 9 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.441353:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb448d12500) 00010000:00010000:2.0:1787826091.441356:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826091.441360:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39000, rc 0) 00000100:00100000:2.0:1787826091.441418:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156822:x1874663042959744:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 377us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826091.441425:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 919 00000100:00100000:3.0:1787826091.446708:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826091.451762:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042961152 00000100:00100000:0.0:1787826091.451778:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042961152 00000100:00100000:0.0:1787826091.451845:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 920 00000100:00100000:0.0:1787826091.451856:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156822:x1874663042961152:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826091.451891:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:0.0:1787826091.451966:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156822:x1874663042961152:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 111us (5268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826091.451974:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 920 00000100:00100000:3.0:1787826091.457952:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826091.458007:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042961280 00000100:00100000:0.0:1787826091.458017:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042961280 00000100:00100000:0.0:1787826091.458083:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 921 00000100:00100000:0.0:1787826091.458093:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156822:x1874663042961280:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826091.458132:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826091.458211:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156822:x1874663042961280:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 119us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826091.458218:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 921 00000100:00100000:3.0:1787826091.469958:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826091.470049:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042961408 00000100:00100000:1.0:1787826091.470058:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042961408 00000100:00100000:1.0:1787826091.470117:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5725 00000100:00100000:1.0:1787826091.470127:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156822:x1874663042961408:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:1.0:1787826091.470159:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826091.470242:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156822:x1874663042961408:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 117us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826091.470250:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5725 00000100:00100000:3.0:1787826091.479417:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826091.479614:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042961536 00000100:00100000:1.0:1787826091.479625:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042961536 00000100:00100000:1.0:1787826091.479670:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22536 00000100:00100000:1.0:1787826091.479678:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:0+-99:2388:x1874663042961536:12345-192.168.203.47@tcp:8:lfs.0 00010000:00080000:1.0:1787826091.479711:0:179222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp t0 exp 0000000000000000 cur 8158 last 0 00000020:00000080:1.0:1787826091.479741:0:179222:0:(genops.c:1385:class_connect()) connect: client a9ce6693-0634-46c5-bf21-5ca7d026d44e, cookie 0x878a5eea00ceccc1 00002000:00100000:1.0:1787826091.479753:0:179222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a9ce6693-0634-46c5-bf21-5ca7d026d44e/ffff8eb47f9a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787826091.479768:0:179222:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787826091.479840:0:179222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787826091.479868:0:179222:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826091.479938:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042961536:12345-192.168.203.47@tcp:8:lfs.0 Request processed in 259us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826091.479946:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22536 00000004:00000080:0.0:1787826091.483609:0:190378:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb65b87dfbe10 00100000:10000000:0.0:1787826091.483623:0:190378:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:2.0:1787826091.488303:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826091.488522:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042961664 00000100:00100000:3.0:1787826091.488532:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042961664 00000100:00100000:3.0:1787826091.488599:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5726 00000100:00100000:3.0:1787826091.488610:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156822:x1874663042961664:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826091.488637:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826091.488698:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:156822:x1874663042961664:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 89us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826091.488706:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5726 00000004:00080000:1.0:1787826091.489321:0:190746:0:(mdd_orphans.c:363:mdd_orphan_key_test_and_delete()) Found orphan [0x20001a9e3:0x1bd0:0x0] count 1, skip it 00000100:00080000:2.0:1787826091.489341:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787826091.489482:0:190364:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x1842:0x0] 00000100:00100000:1.0:1787826091.489525:0:190364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190364:1874663049260800:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787826091.489572:0:190364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826091.489593:0:190364:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1787826091.489806:0:190366:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x17e7:0x0] 00000100:00100000:2.0:1787826091.489828:0:190366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190366:1874663049260928:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787826091.489858:0:190366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826091.489883:0:190366:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f630900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826091.489902:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049260800 00000100:00100000:2.0:1787826091.489908:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049260800 00000100:00100000:2.0:1787826091.489947:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049260928 00000100:00100000:2.0:1787826091.489958:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049260928 00000100:00100000:2.0:1787826091.489983:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22537 00000100:00100000:2.0:1787826091.489992:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:190364:x1874663049260800:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787826091.490004:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22538 00000100:00100000:1.0:1787826091.490011:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:190366:x1874663049260928:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787826091.490015:0:151857:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6241 -> diff = -31 00002000:02000040:2.0:1787826091.490019:0:151857:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6211 to 0x280000401:6241) 00002000:00080000:1.0:1787826091.490021:0:43901:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6177 -> diff = -58 00002000:02000040:1.0:1787826091.490024:0:43901:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6120 to 0x2c0000401:6177) 00002000:00010000:1.0:1787826091.490070:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1821:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.490077:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490092:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1821:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.490096:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1821:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.490102:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490116:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490126:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490133:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490147:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826091.490247:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1820:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.490253:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490260:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1820:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.490263:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1820:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.490267:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490275:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490283:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490291:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490308:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826091.490385:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x181f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.490391:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490399:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181f:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.490402:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.490406:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490415:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490422:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490430:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490444:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787826091.490486:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x181e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.490491:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490625:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181e:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.490632:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.490637:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490647:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490655:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490663:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490675:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787826091.490714:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x181d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.490720:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490727:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181d:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.490730:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.490734:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490743:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490750:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490758:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490766:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787826091.490800:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x181c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.490806:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490814:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181c:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.490816:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.490820:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490829:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490836:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490844:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490852:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787826091.490885:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x181b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.490890:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490897:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181b:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.490900:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.490904:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490913:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490920:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490928:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490937:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1787826091.490970:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x181a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.490975:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490982:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181a:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.490985:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x181a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.490989:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.490998:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491006:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491012:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491020:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1787826091.491050:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1819:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.491115:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491125:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1819:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.491127:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1819:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.491132:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491141:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491150:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491157:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491179:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1787826091.491222:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1818:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.491227:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491235:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1818:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.491238:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1818:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.491242:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491250:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491259:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491266:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491274:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1787826091.491307:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1817:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.491313:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491320:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1817:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.491355:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1817:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.491360:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491369:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491378:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491385:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491394:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1787826091.491430:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1816:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.491434:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491442:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1816:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.491445:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1816:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.491449:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491458:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491465:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491474:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.491483:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:3.0:1787826091.493467:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1787826091.493480:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493492:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fe00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.493497:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493507:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493531:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493539:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008815ebec/0x878a5eea00ceccc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493563:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1787826091.493567:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493572:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.493575:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493583:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493591:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493598:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db7965b7/0x878a5eea00cecccf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493608:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1787826091.493612:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493619:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.493622:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493629:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493636:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493643:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f6b72f/0x878a5eea00ceccd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493653:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1787826091.493656:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493662:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.493665:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493672:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493680:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493688:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002874cb91/0x878a5eea00ceccdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493698:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1787826091.493702:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493708:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.493711:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493718:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493726:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493733:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d513ddc4/0x878a5eea00cecce4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493742:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787826091.493745:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493752:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.493755:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493763:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493771:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493778:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00cecceb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493924:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787826091.493929:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493935:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.493938:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493946:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493964:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493971:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ceccf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493983:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787826091.493986:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.493993:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.493996:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494003:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494011:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494018:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ceccf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494028:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826091.494031:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494037:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.494040:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494051:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494059:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494065:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cecd00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494075:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826091.494079:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494085:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.494087:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494094:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494104:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494111:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cecd07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494127:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826091.494131:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494137:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.494139:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494146:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494155:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494161:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cecd0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494182:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.494186:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494191:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.494195:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494207:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494226:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494233:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cecd15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.494244:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.494246:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.494248:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.494257:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.494262:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826091.495395:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1815:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.495405:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495421:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1815:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.495425:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1815:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.495431:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495443:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495452:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495459:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495479:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826091.495546:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1814:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.495552:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495560:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1814:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.495563:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1814:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.495567:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495575:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495583:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495590:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495604:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826091.495636:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1813:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.495640:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495648:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1813:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.495651:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1813:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.495655:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495663:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495671:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495678:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495688:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787826091.495714:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1812:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.495718:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495724:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1812:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.495727:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1812:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.495730:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495738:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495745:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495752:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495766:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787826091.495791:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1811:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.495796:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495802:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1811:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.495805:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1811:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.495809:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495819:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495825:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495832:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495838:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787826091.495861:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1810:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.495865:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495872:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1810:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.495875:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1810:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.495879:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495887:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495894:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495901:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495908:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787826091.495932:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x180f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.495936:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495942:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180f:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.495945:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.495948:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495956:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495964:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495972:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.495980:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1787826091.496008:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x180e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.496013:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.496019:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180e:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.496022:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.496026:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.496034:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.496042:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.496049:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499409:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1787826091.499425:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499439:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.499444:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499455:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499477:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499487:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cecd1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499522:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787826091.499526:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499534:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.499537:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499545:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499556:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499563:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cecd23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499576:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787826091.499580:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499587:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.499591:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499599:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499610:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499618:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00cecd2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499631:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787826091.499635:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499642:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.499646:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499654:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499664:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499671:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00cecd31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499685:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826091.499689:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499696:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.499699:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499708:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499717:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499725:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cecd38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499736:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826091.499739:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499746:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.499749:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499761:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499771:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499779:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cecd3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499791:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826091.499795:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499802:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.499805:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499813:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499823:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499830:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00cecd46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499848:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.499852:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499859:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.499862:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499870:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499880:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.499888:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.499890:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.499891:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.499900:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.499906:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.500547:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.503222:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1787826091.503239:0:43901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cecd4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826091.503415:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x180d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.503423:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503436:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180d:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.503440:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.503445:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503457:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503467:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503474:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503495:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826091.503523:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.503530:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.503538:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc0e34230) 00002000:00010000:1.0:1787826091.503542:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x180c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.503542:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503548:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.503552:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503555:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180c:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.503558:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.503562:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.503568:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503570:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.503576:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cecd54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503578:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503585:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.503594:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.503597:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503602:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787826091.503603:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.503606:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.503613:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.503622:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.503629:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028f0ef1c/0x878a5eea00cecd5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826091.503633:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x180b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.503638:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503645:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180b:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.503646:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.503648:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.503648:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.503650:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.503652:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503660:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503667:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503679:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503700:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826091.503736:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x180a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.503741:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503749:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180a:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.503752:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x180a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.503756:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503765:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503772:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503779:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503791:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826091.503829:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1809:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.503834:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503843:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1809:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.503846:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1809:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.503850:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503858:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503865:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503872:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503883:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787826091.503918:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1808:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.503923:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503931:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1808:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.503934:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1808:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.503938:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503946:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503954:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503961:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.503969:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787826091.504003:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1807:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.504008:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504015:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1807:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.504018:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1807:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.504022:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504030:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504038:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504045:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504060:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787826091.504096:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1806:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.504100:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504108:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1806:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.504112:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1806:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.504115:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504123:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504131:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504138:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.504146:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787826091.509370:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787826091.509385:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509400:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.509405:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509415:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509437:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509444:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f59e3479/0x878a5eea00cecd62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509467:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787826091.509470:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509477:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.509480:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509487:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509497:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509515:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00cecd69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509527:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826091.509531:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509537:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.509541:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509549:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509558:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509565:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c8d34fd/0x878a5eea00cecd70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509576:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826091.509581:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509587:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.509590:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509598:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509608:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509615:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025445e6a/0x878a5eea00cecd77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509627:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826091.509631:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509637:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.509640:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509654:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509664:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509671:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6347ae2/0x878a5eea00cecd7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509683:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.509686:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509693:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.509696:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509703:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509711:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509717:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbee5f82/0x878a5eea00cecd85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.509734:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.509735:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.509737:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.509752:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.509756:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826091.509872:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1805:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.509880:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.509891:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1805:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.509896:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1805:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.509901:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.509911:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.509919:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.509926:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.509951:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826091.510025:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1804:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.510031:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510038:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1804:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.510041:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1804:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.510045:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510055:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510063:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510071:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510090:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826091.510128:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1803:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.510133:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510141:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1803:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.510145:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1803:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.510149:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510157:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510176:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510183:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510194:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787826091.510232:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1802:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.510237:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510245:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1802:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:1.0:1787826091.510248:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1802:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.510251:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510259:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510266:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510272:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510280:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:1.0:1787826091.510509:0:43901:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6119 00000100:00100000:1.0:1787826091.510604:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:190366:x1874663049260928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20589us (20740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826091.510613:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22538 00010000:00010000:1.0:1787826091.510645:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787826091.510651:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510659:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.510663:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510672:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510685:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510693:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8c95c3d/0x878a5eea00cecd8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510709:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826091.510712:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510719:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.510722:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510730:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510739:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510747:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bf116cb/0x878a5eea00cecd93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510764:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826091.510768:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510775:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.510778:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510786:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510795:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510802:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055233f7a/0x878a5eea00cecd9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510814:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826091.510817:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510823:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.510827:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510842:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510850:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510857:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b951e62/0x878a5eea00cecda1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.510868:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.510870:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.510871:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.511162:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826091.512410:0:190366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190366:1874663049260928:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787826091.512429:0:190366:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1821:0x0] from OST, last_created [0x2c0000401:0x1821:0x0]last_used is [0x2c0000401:0x17e7:0x0] 00000100:00100000:0.0:1787826091.512507:0:190366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190366:1874663049261184:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787826091.512558:0:190366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826091.512584:0:190366:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a7b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826091.512606:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049261056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826091.512630:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826091.512667:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049261184 00000100:00100000:0.0:1787826091.512675:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049261184 00000100:00100000:0.0:1787826091.512713:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22539 00000100:00100000:0.0:1787826091.512721:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:190366:x1874663049261184:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787826091.512756:0:43896:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6178 00010000:00010000:3.0:1787826091.513666:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.513704:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826091.514395:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049261056 00000100:00100000:3.0:1787826091.514404:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049261056 00000100:00100000:3.0:1787826091.514450:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5727 00000100:00100000:3.0:1787826091.514460:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049261056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826091.514479:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580288 pending 896 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826091.514561:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049261056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826091.514569:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5727 00000100:00100000:0.0:1787826091.519318:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:190366:x1874663049261184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6590us (6752us total) trans 4294975534 rc 0/0 00000100:00100000:0.0:1787826091.519345:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22539 00000100:00100000:1.0:1787826091.519385:0:190366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190366:1874663049261184:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787826091.519399:0:190366:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1821:0x0]-[0x2c0000401:0x1841:0x0] 00000100:00100000:0.0:1787826091.519405:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049261056:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1787826091.524032:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1861:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826091.524046:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524140:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1861:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:2.0:1787826091.524145:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1861:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826091.524152:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524179:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524191:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524198:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524299:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826091.524440:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826091.524448:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524457:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.524461:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524469:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524492:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826091.524576:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1860:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826091.524582:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524591:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1860:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:2.0:1787826091.524594:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1860:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826091.524598:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524608:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524612:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00cecda8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524615:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524623:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524633:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826091.524637:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524643:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826091.524643:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826091.524647:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524654:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524665:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524672:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b60ed46/0x878a5eea00cecdaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826091.524677:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x185f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826091.524681:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.524683:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.524685:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.524687:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826091.524689:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185f:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:2.0:1787826091.524692:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826091.524696:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524710:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524717:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524725:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524744:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826091.524782:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x185e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826091.524786:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524793:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185e:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:2.0:1787826091.524796:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826091.524800:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524808:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524815:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524827:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524850:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787826091.524890:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x185d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826091.524895:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524902:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185d:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:2.0:1787826091.524905:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826091.524909:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524917:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524924:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524930:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524946:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787826091.524952:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826091.524956:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524963:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826091.524966:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524973:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524982:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.524989:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abd7fdf7/0x878a5eea00cecdb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525001:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826091.525005:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525011:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826091.525014:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525021:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525029:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525037:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cecdbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525046:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826091.525050:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525056:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.525207:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.525226:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.525240:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826091.525485:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525494:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525506:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525514:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000349c5da0/0x878a5eea00cecdc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525526:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826091.525528:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826091.525528:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x185c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826091.525530:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.525534:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525543:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185c:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.525547:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.525551:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525560:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525569:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525576:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525595:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.525611:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.525617:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525625:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.525628:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.525633:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x185b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826091.525636:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525638:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525646:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185b:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:0.0:1787826091.525648:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525649:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.525653:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525655:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00cecdcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525662:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525668:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.525669:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525670:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.525671:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.525676:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525699:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826091.525734:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x185a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.525739:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525744:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.525747:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185a:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:0.0:1787826091.525749:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525750:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.525754:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525756:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.525759:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525763:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525771:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525773:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525780:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525784:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525793:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.525800:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cecdd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525812:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.525815:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525822:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.525825:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.525826:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1859:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.525831:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525832:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525839:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1859:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:0.0:1787826091.525842:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525843:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.525847:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525850:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00cecdd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525856:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525864:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.525866:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.525868:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.525870:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.525872:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525893:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826091.525930:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1858:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.525935:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525943:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1858:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.525946:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1858:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.525950:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525954:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826091.525959:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525959:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525967:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.525968:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525971:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525977:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525979:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.525989:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.525995:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826091.525997:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00cecde0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526009:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826091.526012:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526019:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826091.526022:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526030:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.526030:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1857:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526034:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526039:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526041:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1857:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.526044:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826091.526048:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00cecde7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526048:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526057:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526064:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526071:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.526071:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526073:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826091.526074:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.526085:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826091.526094:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826091.526097:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526104:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826091.526107:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526114:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.526118:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1856:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526122:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526124:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526131:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbc8e118/0x878a5eea00cecdee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526131:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1856:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.526134:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.526138:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.526143:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826091.526145:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826091.526147:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.526147:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526154:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526161:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526190:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826091.526226:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1855:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526231:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526240:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1855:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.526242:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.526246:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526254:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526262:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526268:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526278:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787826091.526305:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826091.526310:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.526315:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1854:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826091.526318:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.526319:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526321:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526345:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1854:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:0.0:1787826091.526348:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526348:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1854:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.526352:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526358:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526360:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526367:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00cecdf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526369:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526375:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526390:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787826091.526392:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826091.526394:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526400:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.526404:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526411:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526420:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.526422:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1853:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526427:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526428:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede97902/0x878a5eea00cecdfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526435:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1853:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.526438:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826091.526440:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.526442:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526443:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526450:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.526452:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526453:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526459:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526461:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526467:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526470:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526474:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.526476:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9872244/0x878a5eea00cece03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526487:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.526490:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526496:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.526499:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.526501:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1852:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526505:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526507:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526513:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1852:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.526516:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826091.526517:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526520:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526525:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0be8c2f/0x878a5eea00cece0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526529:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526535:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.526537:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.526537:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526539:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.526544:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526564:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826091.526600:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1851:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526605:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526612:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1851:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.526615:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1851:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.526619:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526628:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526635:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526638:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.526642:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526643:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526650:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.526652:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.526653:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526661:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526671:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526678:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00cece11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.526684:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1850:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526688:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526695:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1850:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.526697:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1850:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.526701:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526708:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526712:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.526715:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526716:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526722:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.526724:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526726:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526732:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.526733:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526742:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526749:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d513ddc4/0x878a5eea00cece18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526761:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1787826091.526762:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x184f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826091.526765:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526766:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526771:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.526774:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184f:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:0.0:1787826091.526775:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526777:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.526781:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526782:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526789:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526797:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526805:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526805:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526813:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002874cb91/0x878a5eea00cece1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526814:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.526824:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.526827:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526834:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.526837:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.526843:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x184e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526848:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526849:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526856:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184e:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:0.0:1787826091.526859:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526859:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.526864:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526867:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f6b72f/0x878a5eea00cece26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526872:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526876:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.526878:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.526879:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.526880:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526887:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526903:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826091.526941:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x184d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.526947:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526954:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184d:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.526957:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.526961:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526969:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.526970:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526974:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526978:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526981:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.526985:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.526986:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.526993:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527001:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.527004:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527015:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db7965b7/0x878a5eea00cece2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527027:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.527030:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527035:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fe00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.527038:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527045:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.527049:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x184c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826091.527054:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527054:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527062:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184c:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527064:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.527068:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527076:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527083:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527090:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527099:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.527131:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008815ebec/0x878a5eea00cece34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.527134:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x184b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.527139:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527143:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.527146:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527146:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184b:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527149:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826091.527153:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ec00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.527154:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527157:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527163:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527175:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527182:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527186:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527190:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527193:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003af69368/0x878a5eea00cece3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527198:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.527208:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.527211:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.527230:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x184a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.527235:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527241:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184a:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527244:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x184a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.527247:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527255:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527263:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527276:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527285:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826091.527288:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fc00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.527291:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527299:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527309:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527316:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005abf2577/0x878a5eea00cece42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826091.527317:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1849:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.527321:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527347:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1849:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:0.0:1787826091.527350:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826091.527350:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826091.527354:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527354:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527361:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ea00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826091.527364:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527365:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527373:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527380:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527390:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826091.527411:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826091.527419:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527427:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e400 already unused, calling callback (ffffffffc0e34230) 00002000:00010000:3.0:1787826091.527429:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1848:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826091.527432:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527436:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527445:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527448:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1848:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527456:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.527462:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.527464:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.527466:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826091.527470:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.527473:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527479:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00cece50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527489:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527499:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527499:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527513:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.527514:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527519:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527521:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826091.527528:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b49da297/0x878a5eea00cece49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527535:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fe00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.527541:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.527551:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.527554:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826091.527557:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1847:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826091.527558:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.527559:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527562:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527577:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527578:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1847:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527585:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826091.527594:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00cece57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527595:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527613:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527620:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.527623:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527624:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.527627:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826091.527634:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527657:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826091.527692:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1846:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.527697:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527704:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1846:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527707:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.527712:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527719:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527726:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527733:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527755:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787826091.527793:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1845:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.527798:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527806:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1845:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527809:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.527812:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527820:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527828:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527835:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527847:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787826091.527882:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1844:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.527886:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527893:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1844:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527896:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.527899:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527907:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527913:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527919:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527929:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787826091.527959:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1843:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826091.527963:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527970:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1843:0x0].0x0 since=8158s v=(0 0) 00010000:00010000:3.0:1787826091.527973:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1843:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826091.527977:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.527986:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527991:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826091.527994:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.527998:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528007:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826091.528011:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528014:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528020:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fa00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.528027:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.528028:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826091.528029:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787826091.528033:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528045:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528048:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787826091.528053:0:151857:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6210 00010000:00010000:1.0:1787826091.528066:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528079:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000b3828e/0x878a5eea00cece5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528094:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826091.528098:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528105:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.528108:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528115:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528126:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528140:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036b91170/0x878a5eea00cece6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528144:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826091.528146:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:190364:x1874663049260800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 38150us (38569us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826091.528158:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000dacb76/0x878a5eea00cece65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826091.528159:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22537 00010000:00010000:1.0:1787826091.528186:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826091.528191:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528192:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826091.528199:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528200:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826091.528206:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528286:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528298:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528304:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bd7665/0x878a5eea00cece73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826091.528316:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.528317:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.528319:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826091.528351:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826091.528368:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.528696:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826091.528702:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528710:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528721:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528728:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aa262b0/0x878a5eea00cece7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826091.528743:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.528745:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826091.528746:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826091.529423:0:190364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190364:1874663049260800:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787826091.529442:0:190364:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1861:0x0] from OST, last_created [0x280000401:0x1861:0x0]last_used is [0x280000401:0x1842:0x0] 00000100:00100000:0.0:1787826091.529517:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049261312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826091.529533:0:190364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190364:1874663049261440:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787826091.533944:0:190364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826091.534103:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049261440 00000100:00100000:3.0:1787826091.534112:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049261440 00000100:00100000:3.0:1787826091.534191:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22540 00000100:00100000:3.0:1787826091.534202:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:190364:x1874663049261440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787826091.534247:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6242 00000100:00100000:2.0:1787826091.537450:0:190364:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f630600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826091.539293:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826091.540043:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049261312 00000100:00100000:2.0:1787826091.540053:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049261312 00000100:00100000:2.0:1787826091.540114:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5728 00000100:00100000:2.0:1787826091.540124:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049261312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826091.540614:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826091.540684:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1874663049261312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 561us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826091.540692:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5728 00000100:00100000:3.0:1787826091.540720:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:190364:x1874663049261440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6518us (6780us total) trans 34359738461 rc 0/0 00000100:00100000:3.0:1787826091.540729:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22540 00000100:00100000:1.0:1787826091.540781:0:190364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190364:1874663049261440:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787826091.540798:0:190364:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1861:0x0]-[0x280000401:0x1881:0x0] 00000100:00100000:3.0:1787826091.540799:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049261312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787826091.860703:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826092.888654:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826093.909494:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826094.933387:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826094.933661:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049261568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826094.933746:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826094.934170:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049261568 00000100:00100000:2.0:1787826094.934181:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049261568 00000100:00100000:2.0:1787826094.934261:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5729 00000100:00100000:2.0:1787826094.934276:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049261568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826094.934312:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826094.934528:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049261568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 254us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826094.934538:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5729 00000100:00080000:2.0:1787826094.934569:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826094.934621:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049261568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826094.937647:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826094.937670:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049261696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826094.937736:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826094.938272:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049261696 00000100:00100000:3.0:1787826094.938289:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049261696 00000100:00100000:3.0:1787826094.938410:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5730 00000100:00100000:3.0:1787826094.938424:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049261696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826094.938466:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826094.938563:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049261696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826094.938571:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5730 00000100:00100000:1.0:1787826094.938728:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049261696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787826094.939117:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826095.364506:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826095.364557:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826095.364596:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826095.364621:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826095.364649:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826095.364684:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042961792 00000100:00100000:3.0:1787826095.364697:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042961792 00000100:00100000:3.0:1787826095.364777:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:3.0:1787826095.364791:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042961792:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826095.364892:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042961792:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.364900:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:3.0:1787826095.364956:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042961920 00000100:00100000:3.0:1787826095.364970:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042961920 00000100:00100000:3.0:1787826095.365016:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042962048 00000100:00100000:3.0:1787826095.365020:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042962048 00000100:00100000:3.0:1787826095.365041:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 115 00000100:00100000:3.0:1787826095.365048:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2389:x1874663042961920:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826095.365090:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2389:x1874663042961920:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.365097:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 115 00000100:00100000:3.0:1787826095.365111:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 116 00000100:00100000:3.0:1787826095.365118:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042962048:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826095.365160:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042962048:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 42us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.365165:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 116 00000100:00100000:3.0:1787826095.365191:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042962176 00000100:00100000:3.0:1787826095.365195:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042962176 00000100:00100000:3.0:1787826095.365224:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042962304 00000100:00100000:3.0:1787826095.365227:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042962304 00000100:00100000:3.0:1787826095.365250:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6950 00000100:00100000:3.0:1787826095.365257:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042962176:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826095.365286:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042962176:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.365293:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6950 00000100:00100000:3.0:1787826095.365308:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6951 00000100:00100000:3.0:1787826095.365314:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042962304:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826095.365371:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042962304:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 57us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.365377:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6951 00000100:00080000:3.0:1787826095.365538:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826095.365543:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826095.365546:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826095.365548:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826095.444622:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049262208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826095.444622:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049261824:0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.449417:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049261952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.449883:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049262080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.452475:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826095.452577:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049262464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826095.452634:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826095.452658:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049263104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.452680:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826095.452753:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826095.453008:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049262080 00000100:00100000:1.0:1787826095.453018:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049262080 00000100:00100000:1.0:1787826095.453084:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049262208 00000100:00100000:1.0:1787826095.453088:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049262208 00000100:00100000:1.0:1787826095.453112:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787826095.453121:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049262080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826095.453423:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049262464 00000100:00100000:2.0:1787826095.453430:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049262464 00000100:00100000:2.0:1787826095.453469:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049263104 00000100:00100000:2.0:1787826095.453473:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049263104 00000100:00100000:2.0:1787826095.453498:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12626 00000100:00100000:2.0:1787826095.453507:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049262464:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826095.453889:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049262080:12345-0@lo:400:kworker.0 Request processed in 765us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826095.453900:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787826095.454043:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787826095.454054:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049262208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.454102:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049262208:12345-0@lo:400:kworker.0 Request processed in 51us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826095.454109:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787826095.454130:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826095.454146:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826095.454882:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049262080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.455302:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049262208:0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.455316:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049262720:0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.455574:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12627 00000100:00100000:3.0:1787826095.455593:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049263104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.455673:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049263104:12345-0@lo:400:kworker.0 Request processed in 87us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.455681:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12627 00000100:00100000:3.0:1787826095.455730:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049263104:0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.455774:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826095.455806:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049261824 00000100:00100000:3.0:1787826095.455815:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049261824 00000100:00100000:3.0:1787826095.455858:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000004:00000024:2.0:1787826095.455866:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:3.0:1787826095.455867:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049261824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.455916:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049261824:12345-0@lo:400:kworker.0 Request processed in 51us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.455924:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787826095.455954:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049262464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2447us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826095.455964:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12626 00000100:00100000:3.0:1787826095.455985:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049262464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826095.456108:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049261824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.456121:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049262336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.456255:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826095.456319:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049262720 00000100:00100000:2.0:1787826095.456341:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049262720 00000100:00100000:2.0:1787826095.456384:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6952 00000100:00100000:3.0:1787826095.456386:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826095.456396:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049262720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826095.456439:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049262720:12345-0@lo:400:kworker.0 Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826095.456446:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6952 00000100:00100000:3.0:1787826095.456468:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049262848:0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.456573:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049262336 00000100:00100000:0.0:1787826095.456579:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049262336 00000100:00100000:0.0:1787826095.456633:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787826095.456642:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049262336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.456704:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049262336:12345-0@lo:400:kworker.0 Request processed in 63us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826095.456711:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787826095.456759:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826095.456785:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049262592:0@lo:400:kworker.0 00000100:00100000:2.0:1787826095.456789:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049261952 00000100:00100000:2.0:1787826095.456796:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049261952 00000100:00100000:0.0:1787826095.456819:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826095.456837:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787826095.456847:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049261952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.456849:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049262592 00000100:00100000:0.0:1787826095.456856:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049262592 00000100:00100000:0.0:1787826095.456890:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12628 00000100:00100000:2.0:1787826095.456896:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049261952:12345-0@lo:400:kworker.0 Request processed in 50us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826095.456901:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049262592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826095.456908:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787826095.456944:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049262592:12345-0@lo:400:kworker.0 Request processed in 46us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826095.456952:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12628 00000100:00100000:0.0:1787826095.456992:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049262592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.457000:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049262976:0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.457025:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826095.457318:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826095.457346:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826095.457606:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049263488:0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.457653:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826095.457844:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049262976 00000100:00100000:2.0:1787826095.457852:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049262976 00000100:00100000:0.0:1787826095.457887:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049261952:0@lo:400:kworker.0 00000100:00100000:2.0:1787826095.457890:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049263488 00000100:00100000:2.0:1787826095.457895:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049263488 00000100:00100000:3.0:1787826095.457947:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787826095.457958:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049262976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.458056:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049262976:12345-0@lo:400:kworker.0 Request processed in 101us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826095.458159:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049262976:0@lo:400:kworker.0 00000100:00100000:2.0:1787826095.458193:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787826095.458207:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049263488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826095.458402:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049263488:12345-0@lo:400:kworker.0 Request processed in 197us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826095.458456:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049263488:0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.458503:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787826095.458511:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787826095.459097:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049262720:0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.459111:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049263232:0@lo:400:kworker.0 00000100:00100000:1.0:1787826095.459163:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826095.459590:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049263232 00000100:00100000:3.0:1787826095.459599:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049263232 00000100:00100000:3.0:1787826095.459666:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6953 00000100:00100000:3.0:1787826095.459675:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049263232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.459742:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049263232:12345-0@lo:400:kworker.0 Request processed in 68us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.459750:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6953 00000100:00100000:3.0:1787826095.459795:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049263232:0@lo:400:kworker.0 00000100:00080000:0.0:1787826095.459845:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826095.460645:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826095.460705:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049263360:0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.460708:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049262848 00000100:00100000:0.0:1787826095.460716:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049262848 00000100:00100000:0.0:1787826095.460763:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6954 00000100:00100000:0.0:1787826095.460772:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049262848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826095.460831:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049262848:12345-0@lo:400:kworker.0 Request processed in 59us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826095.460842:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6954 00000100:00100000:2.0:1787826095.461010:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826095.461050:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049263360 00000100:00100000:3.0:1787826095.461056:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049263360 00000100:00100000:2.0:1787826095.461090:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049262336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.461103:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6955 00000100:00100000:2.0:1787826095.461109:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049262848:0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.461114:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049263360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826095.461186:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049263360:12345-0@lo:400:kworker.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826095.461193:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6955 00000100:00080000:0.0:1787826095.461258:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826095.461835:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049263360:0@lo:400:kworker.0 00010000:00010000:1.0:1787826095.957045:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826096.469756:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049263616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826096.470165:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826096.470991:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049263616 00000100:00100000:3.0:1787826096.471004:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049263616 00000100:00100000:3.0:1787826096.471104:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12629 00000100:00100000:3.0:1787826096.471118:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049263616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826096.471187:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:3.0:1787826096.471275:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049263616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826096.471284:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12629 00000100:00100000:1.0:1787826096.471586:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049263616:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787826096.981685:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826096.982114:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049263744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826096.982234:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826096.982307:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826096.982314:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049263744 00000100:00100000:2.0:1787826096.982317:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049263872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826096.982358:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049263744 00000100:00100000:2.0:1787826096.982407:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1787826096.986192:0:184693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738461 is committed 00000100:00100000:2.0:1787826096.989977:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049263872 00000100:00100000:2.0:1787826096.989999:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049263872 00000100:00100000:2.0:1787826096.990078:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5731 00000100:00100000:2.0:1787826096.990099:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049263744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826096.990157:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826096.990286:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049263744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (8051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826096.990294:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5731 00000100:00100000:2.0:1787826096.990321:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5732 00000100:00100000:2.0:1787826096.990355:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049263872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826096.990375:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826096.990408:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049263872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (8003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826096.990414:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5732 00000100:00100000:3.0:1787826096.991258:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738461 gen 2 00000100:00100000:3.0:1787826096.991296:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049263872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826096.991319:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049263744:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787826096.994363:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975534 is committed 00000001:00100000:3.0:1787826096.994420:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000001:02000400:1.0:1787826097.997892:0:190950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1787826098.005836:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826099.029921:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826099.624449:0:190998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1787826100.053384:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049264000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826100.053458:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826100.053958:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049264000 00000100:00100000:3.0:1787826100.053968:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049264000 00000100:00100000:3.0:1787826100.054040:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5733 00000100:00100000:3.0:1787826100.054050:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049264000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826100.054082:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826100.054148:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049264000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826100.054156:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5733 00000100:00100000:3.0:1787826100.054202:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049264000:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787826100.054269:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826100.054542:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049264128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826100.054587:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826100.054888:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049264128 00000100:00100000:0.0:1787826100.054895:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049264128 00000100:00100000:0.0:1787826100.054949:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5734 00000100:00100000:0.0:1787826100.054959:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049264128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826100.054981:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826100.055019:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049264128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826100.055026:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5734 00000100:00080000:1.0:1787826100.055205:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826100.055237:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049264128:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787826100.055365:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826100.482490:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826100.482534:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826100.482626:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042962560 00000100:00100000:2.0:1787826100.482637:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042962560 00000100:00100000:2.0:1787826100.482720:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 123 00000100:00100000:2.0:1787826100.482731:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2389:x1874663042962560:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826100.482838:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2389:x1874663042962560:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 108us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826100.482845:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 123 00000100:00080000:1.0:1787826100.483025:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826100.483349:0:190353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042962432 00000100:00100000:3.0:1787826100.483355:0:190353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042962432 00000100:00100000:3.0:1787826100.483427:0:190353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:3.0:1787826100.483436:0:190353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042962432:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826100.483472:0:190353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042962432:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826100.483478:0:190353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:2.0:1787826100.483603:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826100.484423:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042962688 00000100:00100000:1.0:1787826100.484431:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042962688 00000100:00100000:1.0:1787826100.484492:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 124 00000100:00100000:1.0:1787826100.484501:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042962688:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826100.484565:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042962688:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 65us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.484572:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 124 00000100:00080000:2.0:1787826100.485187:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826100.492063:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826100.492187:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826100.492658:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042962816 00000100:00100000:0.0:1787826100.492669:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042962816 00000100:00080000:2.0:1787826100.492788:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826100.493173:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042962944 00000100:00100000:0.0:1787826100.493178:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042962944 00000100:00080000:2.0:1787826100.493236:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826100.493372:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6956 00000100:00100000:1.0:1787826100.493385:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042962816:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826100.493460:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042962816:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 78us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.493468:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6956 00000100:00100000:1.0:1787826100.493487:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6957 00000100:00100000:1.0:1787826100.493495:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2390:x1874663042962944:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826100.493518:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2390:x1874663042962944:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.493525:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6957 00000100:00100000:0.0:1787826100.564892:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049264256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826100.564969:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826100.566897:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049264256 00000100:00100000:3.0:1787826100.566912:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049264256 00000100:00100000:3.0:1787826100.566974:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12630 00000100:00100000:3.0:1787826100.566984:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049264256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826100.567033:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:3.0:1787826100.567118:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049264256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826100.567125:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12630 00000100:00100000:0.0:1787826100.567442:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049264256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826100.567829:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049264640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.567873:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.567908:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049265152:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.567931:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.567953:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049265664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.567977:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568000:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787826100.568005:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049264512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568027:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568044:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049265024:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568064:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568086:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049265536:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568118:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568147:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049265152 00000100:00100000:1.0:1787826100.568151:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049265152 00000100:00100000:1.0:1787826100.568180:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049265664 00000100:00100000:1.0:1787826100.568183:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049265664 00000100:00100000:1.0:1787826100.568208:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049265536 00000100:00100000:1.0:1787826100.568211:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049265536 00000100:00100000:1.0:1787826100.568251:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6958 00000100:00100000:1.0:1787826100.568258:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049265152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568303:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049265152:12345-0@lo:400:kworker.0 Request processed in 46us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.568310:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6958 00000100:00100000:1.0:1787826100.568351:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6959 00000100:00100000:1.0:1787826100.568359:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049265664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568389:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049265664:12345-0@lo:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.568395:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6959 00000100:00100000:1.0:1787826100.568407:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6960 00000100:00100000:1.0:1787826100.568414:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049265536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568439:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049265536:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.568445:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6960 00000100:00100000:1.0:1787826100.568466:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049265024 00000100:00100000:1.0:1787826100.568469:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049265024 00000100:00100000:1.0:1787826100.568493:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12631 00000100:00100000:1.0:1787826100.568500:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049265024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568530:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049265024:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.568536:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12631 00000100:00080000:1.0:1787826100.568565:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826100.568569:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826100.568582:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049264768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568610:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568630:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049265280:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568650:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568663:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049265792:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568682:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568700:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826100.568706:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049264384:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568732:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568754:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049264896:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568774:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568791:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049265408:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568811:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826100.568831:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049264384 00000100:00100000:1.0:1787826100.568835:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049264384 00000100:00100000:1.0:1787826100.568864:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787826100.568871:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049264384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.568905:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049264384:12345-0@lo:400:kworker.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.568911:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787826100.568940:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049264640 00000100:00100000:1.0:1787826100.568944:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049264640 00000100:00100000:1.0:1787826100.568969:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049264512 00000100:00100000:1.0:1787826100.568972:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049264512 00000100:00100000:1.0:1787826100.568983:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049264768 00000100:00100000:1.0:1787826100.568985:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049264768 00000100:00100000:1.0:1787826100.568995:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049265792 00000100:00100000:1.0:1787826100.568998:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049265792 00000100:00100000:1.0:1787826100.569007:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049264896 00000100:00100000:1.0:1787826100.569009:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049264896 00000100:00100000:1.0:1787826100.569019:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049265408 00000100:00100000:1.0:1787826100.569022:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049265408 00000100:00100000:1.0:1787826100.569033:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787826100.569039:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049264640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569069:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049264640:12345-0@lo:400:kworker.0 Request processed in 31us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.569076:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787826100.569088:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787826100.569094:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049264512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569135:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049264512:12345-0@lo:400:kworker.0 Request processed in 41us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.569141:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787826100.569154:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787826100.569161:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049264768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569188:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049264768:12345-0@lo:400:kworker.0 Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.569194:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787826100.569206:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787826100.569212:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049265792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569237:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049265792:12345-0@lo:400:kworker.0 Request processed in 26us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.569243:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787826100.569254:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787826100.569260:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049264896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569288:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049264896:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.569294:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787826100.569306:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787826100.569312:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049265408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569377:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049265408:12345-0@lo:400:kworker.0 Request processed in 64us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826100.569383:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1787826100.569401:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826100.569403:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826100.569433:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049264384:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569447:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049264896:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569456:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049265408:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569463:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049264768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569471:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049265792:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569510:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049264512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569521:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049265024:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569530:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049265536:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569539:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049264640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569547:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049265152:0@lo:400:kworker.0 00000100:00100000:1.0:1787826100.569554:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975534 gen 2 00000100:00100000:1.0:1787826100.569565:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049265664:0@lo:400:kworker.0 00000100:00100000:0.0:1787826100.569822:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049265280 00000100:00100000:0.0:1787826100.569827:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049265280 00000100:00100000:0.0:1787826100.569865:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6961 00000100:00100000:0.0:1787826100.569872:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049265280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826100.569913:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049265280:12345-0@lo:400:kworker.0 Request processed in 42us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826100.569919:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6961 00000100:00100000:2.0:1787826100.569931:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049265280:0@lo:400:kworker.0 00010000:00010000:2.0:1787826101.076819:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826101.393676:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826101.393810:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042963072 00000100:00100000:0.0:1787826101.393826:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042963072 00000100:00100000:0.0:1787826101.393913:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 922 00000100:00100000:0.0:1787826101.393927:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:157293:x1874663042963072:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826101.393969:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:0.0:1787826101.394067:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:157293:x1874663042963072:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 133us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826101.394074:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 922 00000100:00100000:2.0:1787826101.400045:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826101.400661:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042963200 00000100:00100000:1.0:1787826101.400676:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042963200 00000100:00100000:1.0:1787826101.400865:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 923 00000100:00100000:1.0:1787826101.400881:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:157293:x1874663042963200:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:1.0:1787826101.400936:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:1.0:1787826101.401119:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:157293:x1874663042963200:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 241us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826101.401128:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 923 00000100:00100000:2.0:1787826101.409998:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826101.410525:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042963328 00000100:00100000:3.0:1787826101.410539:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042963328 00000100:00100000:3.0:1787826101.410623:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5735 00000100:00100000:3.0:1787826101.410635:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:157293:x1874663042963328:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826101.410679:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826101.410773:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:157293:x1874663042963328:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 139us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826101.410781:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5735 00000100:00100000:0.0:1787826101.425084:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826101.425313:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042963456 00000100:00100000:2.0:1787826101.425378:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042963456 00000100:00100000:2.0:1787826101.425466:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5736 00000100:00100000:2.0:1787826101.425479:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:157293:x1874663042963456:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:2.0:1787826101.425523:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826101.425613:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:157293:x1874663042963456:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 136us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826101.425621:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5736 00000100:00100000:2.0:1787826101.454515:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826101.454813:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042963712 00000100:00100000:1.0:1787826101.454827:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042963712 00000100:00100000:1.0:1787826101.454909:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 924 00000100:00100000:1.0:1787826101.454923:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:156396:x1874663042963712:12345-192.168.203.47@tcp:36:multiop.0 00010000:00010000:1.0:1787826101.455047:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.455068:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.455085:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826101.455449:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a847189c reply state 000000007d4db359 transno 339302416385 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.455492:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.455501:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd0:0x0].0x0 (ffff8eb47f8fd200) 00010000:00010000:1.0:1787826101.455503:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787826101.455508:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826101.455649:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:156396:x1874663042963712:12345-192.168.203.47@tcp:36:multiop.0 Request processed in 727us (1147us total) trans 339302416385 rc 0/0 00000100:00100000:1.0:1787826101.455661:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 924 00000100:00100000:3.0:1787826101.464609:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826101.465517:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042963840 00000100:00100000:1.0:1787826101.465534:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042963840 00000100:00100000:1.0:1787826101.465623:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 925 00000100:00100000:1.0:1787826101.465635:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:156396:x1874663042963840:12345-192.168.203.47@tcp:101:multiop.0 00010000:00010000:1.0:1787826101.465729:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826101.465761:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00cece88 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0c2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.465832:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00cece88 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0c2 expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.465848:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00cece88 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0c2 expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.465871:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd0:0x0].0x0 (ffff8eb47f8fd200) 00010000:00010000:1.0:1787826101.465874:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826101.465879:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3200, rc 0) 00000100:00100000:1.0:1787826101.465962:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:156396:x1874663042963840:12345-192.168.203.47@tcp:101:multiop.0 Request processed in 329us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826101.465969:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 925 00000100:00100000:2.0:1787826101.481365:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826101.484016:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042963968 00000100:00100000:3.0:1787826101.484041:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042963968 00000100:00100000:3.0:1787826101.484175:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22541 00000100:00100000:3.0:1787826101.484188:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042963968:12345-192.168.203.47@tcp:2:multiop.0 00002000:00010000:3.0:1787826101.484922:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1842:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826101.484928:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x1842:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787826101.484930:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x1842:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826101.484933:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x1842:0x0] updating lvb ctime from disk: 0 -> 1787826101 00002000:00010000:3.0:1787826101.484935:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1842:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826101.486116:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2391:x1874663042963968:12345-192.168.203.47@tcp:2:multiop.0 Request processed in 1912us (4783us total) trans 34359738462 rc 0/0 00000100:00100000:3.0:1787826101.486132:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22541 00000100:00100000:3.0:1787826101.495982:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826101.496193:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042964096 00000100:00100000:1.0:1787826101.496208:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042964096 00000100:00100000:1.0:1787826101.496290:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 926 00000100:00100000:1.0:1787826101.496303:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:156396:x1874663042964096:12345-192.168.203.47@tcp:101:multiop.0 00010000:00010000:1.0:1787826101.496384:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826101.496415:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cece8f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0c9 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.496515:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00cece96 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.496532:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00cece96 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.496545:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00cece96 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826101.496607:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826101.496633:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00cece96 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.496666:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cece8f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0c9 expref: 14 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.496691:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00cece96 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0c9 expref: 13 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.496700:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd0:0x0].0x0 (ffff8eb47f8fd200) 00010000:00010000:1.0:1787826101.496704:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826101.496708:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2200, rc 0) 00000100:00100000:1.0:1787826101.496810:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:156396:x1874663042964096:12345-192.168.203.47@tcp:101:multiop.0 Request processed in 508us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826101.496819:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 926 00000100:00100000:2.0:1787826101.503366:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826101.504059:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042964352 00000100:00100000:0.0:1787826101.504081:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042964352 00000100:00100000:0.0:1787826101.504185:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:0.0:1787826101.504198:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:156396:x1874663042964352:12345-192.168.203.47@tcp:35:multiop.0 00000004:00080000:0.0:1787826101.505061:0:187907:0:(mdd_object.c:4014:mdd_close()) Object [0x20001a9e3:0x1bd0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826101.505181:0:187907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13c:0x0].2, 64 off8320 00000004:00080000:0.0:1787826101.505203:0:187907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8168331877078ns, next at 8169331872793ns, rc = 0 00010000:00010000:0.0:1787826101.505282:0:187907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826101.505312:0:187907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826101.505656:0:187907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826101.505668:0:187907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826101.505682:0:187907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826101.505690:0:187907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826101.505854:0:187907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826101.506039:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:156396:x1874663042964352:12345-192.168.203.47@tcp:35:multiop.0 Request processed in 1836us (2716us total) trans 339302416386 rc 0/0 00000100:00100000:0.0:1787826101.506057:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00010000:00010000:2.0:1787826101.512761:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826101.512782:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826101.512798:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826101.512805:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826101.512817:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826101.512844:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd0:0x0].0x0 (ffff8eb47f8fd200) 00010000:00010000:2.0:1787826101.512848:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826101.512853:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826101.512860:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65a00/0x878a5eea00cece9d lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826101.512900:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826101.512902:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826101.512905:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826101.519756:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826101.519975:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042964480 00000100:00100000:1.0:1787826101.519991:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042964480 00000100:00100000:1.0:1787826101.520078:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 927 00000100:00100000:1.0:1787826101.520090:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:156251:x1874663042964480:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:1.0:1787826101.520137:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826101.520176:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0d0 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520268:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520285:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520297:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520315:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520322:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520479:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520560:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520569:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520576:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520588:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826101.520594:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520603:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520619:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb448d12500) 00010000:00010000:1.0:1787826101.520624:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826101.520629:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520636:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ceceab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520653:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520659:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520664:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520668:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826101.520671:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520677:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520689:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff8eb47f8fd400) 00010000:00010000:1.0:1787826101.520691:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826101.520694:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520699:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00ceceb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520923:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecea4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0d0 expref: 15 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520937:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb448d12500) 00010000:00010000:1.0:1787826101.520939:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826101.520943:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0d0 expref: 15 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826101.520953:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3800, rc 0) 00000100:00100000:1.0:1787826101.521043:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:156251:x1874663042964480:12345-192.168.203.47@tcp:101:bash.0 Request processed in 954us (1319us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826101.521052:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 927 00000100:00100000:2.0:1787826101.588731:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049265920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826101.588844:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826101.589090:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049265920 00000100:00100000:3.0:1787826101.589113:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049265920 00000100:00100000:3.0:1787826101.589186:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12632 00000100:00100000:3.0:1787826101.589199:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049265920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826101.589237:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:3.0:1787826101.589308:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049265920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826101.589316:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12632 00000100:00100000:2.0:1787826101.596716:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049265920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826102.102023:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826102.102053:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049266176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826102.102160:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826102.102214:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049266048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826102.102240:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826102.102299:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826102.102551:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049266176 00000100:00100000:3.0:1787826102.102562:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049266176 00000100:00100000:3.0:1787826102.102637:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049266048 00000100:00100000:3.0:1787826102.102641:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049266048 00000100:00100000:3.0:1787826102.102667:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5737 00000100:00100000:0.0:1787826102.102676:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5738 00000100:00100000:3.0:1787826102.102679:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049266176:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826102.102684:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049266048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826102.102709:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00002000:00000024:3.0:1787826102.102709:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826102.102763:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049266048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826102.102770:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5738 00000100:00080000:0.0:1787826102.102794:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826102.102798:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826102.111580:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049266176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8886us (9403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826102.111609:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5737 00000100:00100000:1.0:1787826102.112876:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049266176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826102.112910:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049266048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787826103.124597:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826104.148601:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826105.173240:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049266304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826105.173309:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826105.173694:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049266304 00000100:00100000:0.0:1787826105.173702:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049266304 00000100:00100000:0.0:1787826105.173768:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5739 00000100:00100000:0.0:1787826105.173779:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049266304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826105.173807:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826105.173855:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049266304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826105.173862:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5739 00000100:00080000:1.0:1787826105.173937:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826105.174090:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049266304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826105.175353:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826105.175371:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049266432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826105.175435:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826105.175699:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049266432 00000100:00100000:2.0:1787826105.175705:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049266432 00000100:00100000:2.0:1787826105.175765:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5740 00000100:00100000:2.0:1787826105.175774:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049266432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826105.175799:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826105.175845:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049266432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.175852:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5740 00000100:00080000:1.0:1787826105.176098:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826105.176145:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049266432:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826105.176439:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826105.594515:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826105.594643:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826105.594676:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826105.594711:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826105.595018:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042964992 00000100:00100000:0.0:1787826105.595033:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042964992 00000100:00100000:0.0:1787826105.595123:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6962 00000100:00100000:0.0:1787826105.595134:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042964992:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826105.595216:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042964992:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 84us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826105.595223:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6962 00000100:00080000:0.0:1787826105.595393:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826105.595415:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042964608 00000100:00100000:0.0:1787826105.595420:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042964608 00000100:00100000:0.0:1787826105.595461:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:0.0:1787826105.595469:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042964608:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826105.595503:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042964608:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826105.595510:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:3.0:1787826105.602253:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826105.602381:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042965120 00000100:00100000:0.0:1787826105.602394:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042965120 00000100:00100000:0.0:1787826105.602479:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6963 00000100:00100000:0.0:1787826105.602491:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042965120:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826105.602586:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042965120:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 97us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826105.602595:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6963 00000100:00080000:0.0:1787826105.602622:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826105.604347:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042964736 00000100:00100000:1.0:1787826105.604363:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042964736 00000100:00100000:1.0:1787826105.604583:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042964864 00000100:00100000:1.0:1787826105.604588:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042964864 00000100:00100000:1.0:1787826105.604618:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 131 00000100:00100000:1.0:1787826105.604630:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:2389:x1874663042964736:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826105.604711:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:2389:x1874663042964736:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 85us (10213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826105.604719:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 131 00000100:00100000:1.0:1787826105.604739:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00100000:1.0:1787826105.604745:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042964864:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826105.604766:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042964864:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 21us (10055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826105.604772:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00080000:3.0:1787826105.606100:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826105.606112:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826105.684636:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049266688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.684709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826105.684781:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049267200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.684816:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826105.684856:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049267712:0@lo:400:kworker.0 00000100:00100000:0.0:1787826105.684886:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049266816:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.684892:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826105.684930:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787826105.684939:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049266560:0@lo:400:kworker.0 00000100:00100000:0.0:1787826105.684977:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826105.684993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826105.685023:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049267328:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.685040:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049267072:0@lo:400:kworker.0 00000100:00100000:0.0:1787826105.685079:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826105.685097:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826105.685112:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049267840:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.685133:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049267584:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.685168:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826105.685203:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049267200 00000100:00100000:2.0:1787826105.685211:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049267200 00000100:00100000:2.0:1787826105.685254:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049267584 00000100:00100000:2.0:1787826105.685257:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049267584 00000100:00100000:2.0:1787826105.685278:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12633 00000100:00100000:2.0:1787826105.685286:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049267200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.685367:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049267200:12345-0@lo:400:kworker.0 Request processed in 80us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.685374:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12633 00000100:00100000:2.0:1787826105.685391:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12634 00000100:00100000:2.0:1787826105.685397:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049267584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.685425:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049267584:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.685431:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12634 00000100:00100000:2.0:1787826105.685450:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049267712 00000100:00100000:2.0:1787826105.685453:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049267712 00000100:00100000:2.0:1787826105.685482:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049267328 00000100:00100000:2.0:1787826105.685485:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049267328 00000100:00100000:2.0:1787826105.685792:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6964 00000100:00100000:2.0:1787826105.685802:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049267712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.685837:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049267712:12345-0@lo:400:kworker.0 Request processed in 38us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.685843:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6964 00000100:00100000:0.0:1787826105.685971:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826105.686023:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826105.686035:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049267840 00000100:00100000:0.0:1787826105.686037:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049266944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.686043:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049267840 00000100:00100000:2.0:1787826105.686097:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6965 00000100:00100000:0.0:1787826105.686106:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826105.686117:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049267328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.686160:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049267328:12345-0@lo:400:kworker.0 Request processed in 49us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.686166:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6965 00000100:00100000:2.0:1787826105.686177:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6966 00000100:00100000:2.0:1787826105.686183:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049267840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.686212:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049267840:12345-0@lo:400:kworker.0 Request processed in 30us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.686219:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6966 00000100:00100000:2.0:1787826105.686241:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049266560 00000100:00100000:2.0:1787826105.686245:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049266560 00000100:00100000:2.0:1787826105.686270:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787826105.686276:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049266560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826105.686437:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049266688 00000100:00100000:3.0:1787826105.686446:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049266688 00000100:00100000:3.0:1787826105.686501:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049266816 00000100:00100000:3.0:1787826105.686505:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049266816 00000100:00100000:3.0:1787826105.686523:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049267072 00000100:00100000:3.0:1787826105.686526:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049267072 00000100:00100000:3.0:1787826105.686540:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049266944 00000100:00100000:3.0:1787826105.686542:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049266944 00000100:00100000:3.0:1787826105.686558:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787826105.686567:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049266688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.686757:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049266560:12345-0@lo:400:kworker.0 Request processed in 477us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.686767:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787826105.686807:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787826105.686816:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049266816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.686855:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049266816:12345-0@lo:400:kworker.0 Request processed in 41us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.686861:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787826105.686877:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787826105.686884:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049267072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.686925:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049267072:12345-0@lo:400:kworker.0 Request processed in 27us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.686931:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787826105.686943:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787826105.686950:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049266944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.686980:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049266944:12345-0@lo:400:kworker.0 Request processed in 32us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826105.686986:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787826105.687043:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049266560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.687057:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049267072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.687079:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049267584:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.687090:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049267200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826105.687100:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049267712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826105.687287:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826105.687299:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049268096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826105.687362:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826105.687395:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049268096 00000100:00100000:1.0:1787826105.687399:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049268096 00000100:00100000:1.0:1787826105.687425:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12635 00000100:00100000:1.0:1787826105.687431:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049268096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826105.687457:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:1.0:1787826105.687493:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049268096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826105.687511:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12635 00000100:00100000:1.0:1787826105.687543:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049268096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826105.690867:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049266944:0@lo:400:kworker.0 00000100:00100000:0.0:1787826105.690888:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049267456:0@lo:400:kworker.0 00000100:00100000:0.0:1787826105.690975:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826105.691016:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049267968:0@lo:400:kworker.0 00000100:00100000:0.0:1787826105.691040:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826105.691079:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049266816:0@lo:400:kworker.0 00000100:00100000:0.0:1787826105.691096:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049267328:0@lo:400:kworker.0 00000100:00100000:0.0:1787826105.691111:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049267840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826105.691775:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049267456 00000100:00100000:1.0:1787826105.691790:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049267456 00000100:00100000:1.0:1787826105.691856:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049267968 00000100:00100000:1.0:1787826105.691860:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049267968 00000100:00100000:1.0:1787826105.691879:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787826105.691889:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049267456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826105.691988:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049267456:12345-0@lo:400:kworker.0 Request processed in 100us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826105.691995:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787826105.692014:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787826105.692020:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049267968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826105.692051:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049267968:12345-0@lo:400:kworker.0 Request processed in 31us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826105.692057:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787826105.692112:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049267456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826105.692125:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049267968:0@lo:400:kworker.0 00000100:00100000:3.0:1787826105.692374:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049266688:12345-0@lo:400:kworker.0 Request processed in 5802us (7659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826105.692388:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1787826105.692444:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826105.692451:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826105.692456:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826105.692459:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826105.692857:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049266688:0@lo:400:kworker.0 00010000:00010000:3.0:1787826106.196848:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826106.724080:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049268224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826106.724176:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826106.724295:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049268224 00000100:00100000:1.0:1787826106.724307:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049268224 00000100:00100000:1.0:1787826106.724397:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12636 00000100:00100000:1.0:1787826106.724409:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049268224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826106.724455:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:1.0:1787826106.724510:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049268224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826106.724518:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12636 00000100:00100000:3.0:1787826106.726346:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049268224:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787826107.221635:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826107.223256:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049268352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826107.223357:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826107.223654:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049268352 00000100:00100000:0.0:1787826107.223672:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049268352 00000100:00100000:0.0:1787826107.223768:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5741 00000100:00100000:0.0:1787826107.223783:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049268352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826107.223823:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00080000:2.0:1787826107.226150:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826107.226210:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049268480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826107.226273:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826107.226321:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049268480 00000100:00100000:2.0:1787826107.226354:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049268480 00000100:00100000:2.0:1787826107.226405:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5742 00000100:00100000:2.0:1787826107.226425:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049268480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826107.226458:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826107.226502:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049268480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826107.226508:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5742 00000100:00080000:2.0:1787826107.226526:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826107.226559:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049268480:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787826107.228196:0:190345:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416386 is committed 00000004:00080000:2.0:1787826107.228217:0:190345:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787826107.228434:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049268608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826107.228525:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826107.228615:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049268608 00000100:00100000:2.0:1787826107.228623:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049268608 00000100:00100000:2.0:1787826107.228791:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22542 00000100:00100000:2.0:1787826107.228807:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049268608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826107.228843:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6210 count 1 00010000:00010000:2.0:1787826107.228878:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.228906:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.228917:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1842:0x0].0x0 since=74s v=(0 0) 00010000:00010000:2.0:1787826107.228923:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826107.228930:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.228967:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.228983:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 8274 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826107.229529:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049268352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5746us (6166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826107.229543:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5741 00010000:00010000:0.0:1787826107.229770:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826107.229782:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826107.229790:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826107.229798:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826107.229804:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826107.229811:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826107.229832:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd0:0x0].0x0 (ffff8eb47f8fd200) 00010000:00010000:0.0:1787826107.229847:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826107.229853:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826107.229860:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00cece81 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826107.231237:0:184693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738462 is committed 00000100:00100000:2.0:1787826107.231857:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1874663049268736:192.168.203.47@tcp:104: 00000100:00100000:2.0:1787826107.232160:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826107.237276:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049268352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826107.243517:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1874663049268736:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826107.243569:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826107.251868:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826107.252457:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042965248 00000100:00100000:2.0:1787826107.252473:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042965248 00010000:00010000:2.0:1787826107.252835:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 8274 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826107.252895:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12220 00000100:00100000:2.0:1787826107.252908:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042965248:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826107.252929:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826107.252935:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 8274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.252953:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 8274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.252991:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00cec9aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f083 expref: 6 pid: 179226 timeout: 8274 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.253028:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826107.253034:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826107.253041:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.253052:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.253102:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826107.253192:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042965248:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 285us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826107.253201:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12220 00010000:00010000:3.0:1787826107.253554:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826107.253567:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826107.253577:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826107.253586:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826107.253606:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826107.253843:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049268608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25038us (25316us total) trans 34359738463 rc 0/0 00000100:00100000:3.0:1787826107.253852:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22542 00000004:00080000:3.0:1787826107.253913:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb472584e00/2, rc 0, transno 34359738463 00000100:00100000:3.0:1787826107.253922:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049268608:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1787826107.254234:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787826107.254393:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826107.254402:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.254418:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826107.254423:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.254434:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.254459:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.254466:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89d3282/0x878a5eea00ceceb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826107.254491:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826107.254493:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826107.254495:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826108.244870:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826108.519812:0:191194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 73b: open(O_CREAT), unlink, replay, reconnect at open_replay reply, close ========================================================== 06:21:47 (1787826107) 00000100:00100000:0.0:1787826108.686473:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826108.687370:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042965504 00000100:00100000:2.0:1787826108.687387:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042965504 00000100:00100000:2.0:1787826108.687494:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 928 00000100:00080000:0.0:1787826108.687534:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826108.687571:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:157888:x1874663042965504:12345-192.168.203.47@tcp:101:multiop.0 00010000:00010000:2.0:1787826108.687602:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826108.687606:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787826108.687642:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ceccba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0bb expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826108.687672:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb448d12500) 00010000:00010000:2.0:1787826108.687685:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826108.687706:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00cecec0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0d7 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.693442:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.693473:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.693487:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.693509:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.693517:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.693524:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826108.693985:0:187906:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x1843:0x0], count =31 00000004:00080000:3.0:1787826108.693996:0:187906:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x1843:0x0]+31 in llog 00000004:00080000:3.0:1787826108.694014:0:187906:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1862:0x0], index 0: 0 00010000:00010000:3.0:1787826108.694487:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceced5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694500:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceced5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694510:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceced5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694549:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694561:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694568:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694574:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826108.694579:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694588:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694602:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb448d12900) 00010000:00010000:3.0:1787826108.694606:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826108.694611:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694617:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecec7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826108.694637:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb549175 reply state 000000001a12cb65 transno 339302416387 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694650:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694657:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8eb34d1bd300) 00010000:00010000:3.0:1787826108.694660:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826108.694663:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826108.694710:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00cecec0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0d7 expref: 13 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694733:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceced5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0d7 expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.694742:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb34d1bd400) 00010000:00010000:3.0:1787826108.694744:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826108.694747:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8f600, rc 0) 00000100:00100000:3.0:1787826108.694855:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:157888:x1874663042965504:12345-192.168.203.47@tcp:101:multiop.0 Request processed in 7350us (8396us total) trans 339302416387 rc 0/0 00000100:00100000:3.0:1787826108.694867:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 928 00000100:00100000:1.0:1787826108.740161:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826108.740288:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042965632 00000100:00100000:3.0:1787826108.740301:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042965632 00000100:00100000:3.0:1787826108.740402:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 929 00000100:00100000:3.0:1787826108.740416:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:157893:x1874663042965632:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826108.740447:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826108.740478:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0de expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.740555:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceceea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.740571:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceceea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.740586:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceceea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826108.740643:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787826108.740647:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826108.740752:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceceea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.740783:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cecee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0de expref: 15 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.740809:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceceea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0de expref: 14 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.740819:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb34d1bd000) 00010000:00010000:3.0:1787826108.740823:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826108.740827:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8f200, rc 0) 00000100:00100000:3.0:1787826108.741011:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157893:x1874663042965632:12345-192.168.203.47@tcp:101:rm.0 Request processed in 597us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826108.741018:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 929 00000100:00100000:1.0:1787826108.766179:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826108.766301:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042965760 00000100:00100000:3.0:1787826108.766318:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042965760 00000100:00100000:3.0:1787826108.766442:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22543 00000100:00100000:3.0:1787826108.766454:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042965760:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826108.766478:0:16985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826108.766508:0:16985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0e5 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826108.766967:0:16985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1862:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826108.766998:0:16985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1862:0x0].0x0 since=8175s v=(0 0) 00010000:00010000:3.0:1787826108.767005:0:16985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826108.767018:0:16985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.767064:0:16985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.767083:0:16985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8ee00, rc 0) 00000100:00100000:3.0:1787826108.767602:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042965760:12345-192.168.203.47@tcp:101:rm.0 Request processed in 1148us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826108.767612:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22543 00000100:00100000:2.0:1787826108.809469:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826108.809610:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042966016 00000100:00100000:3.0:1787826108.809621:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042966016 00000100:00100000:3.0:1787826108.809680:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 930 00000100:00100000:3.0:1787826108.809690:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157893:x1874663042966016:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826108.809739:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826108.809910:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceced5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0d7 expref: 14 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.809928:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb34d1bd400) 00010000:00010000:3.0:1787826108.809945:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceceea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0de expref: 13 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.809953:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb34d1bd000) 00010000:00010000:3.0:1787826108.809959:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826108.809981:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.809994:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.810003:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.810013:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.810020:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.810026:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.810121:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.810129:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811004:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826108.811220:0:188682:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x20001a9e3:0x1bd2:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1787826108.811288:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811408:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811416:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811423:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826108.811428:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811435:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811446:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb34d1bd100) 00010000:00010000:3.0:1787826108.811449:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826108.811453:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811459:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf06 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811482:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811487:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811493:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811498:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826108.811501:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811507:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811517:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb34d1bdb00) 00010000:00010000:3.0:1787826108.811519:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826108.811522:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811527:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecef8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826108.811537:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f9a8ae9 reply state 0000000023fd80a0 transno 339302416388 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811547:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826108.811553:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8eb34d1bd300) 00010000:00010000:3.0:1787826108.811555:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826108.811558:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826108.811687:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157893:x1874663042966016:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1997us (2234us total) trans 339302416388 rc 0/0 00000100:00100000:3.0:1787826108.811696:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 930 00010000:00010000:3.0:1787826109.268438:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787826110.052098:0:184693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738463 is committed 00000001:00080000:3.0:1787826110.053489:0:190345:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416388 is committed 00010000:00010000:0.0:1787826110.054829:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054843:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054852:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054862:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826110.054869:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054876:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054892:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8eb34d1bd300) 00010000:00010000:0.0:1787826110.054895:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826110.054900:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054907:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00cecece lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054933:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054939:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054944:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054948:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826110.054951:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054957:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054969:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8eb34d1bd300) 00010000:00010000:0.0:1787826110.054972:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826110.054975:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.054981:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceceff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826110.121943:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826110.122276:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042966144 00000100:00100000:3.0:1787826110.122287:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042966144 00000100:00100000:3.0:1787826110.126341:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 931 00000100:00100000:3.0:1787826110.126358:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:157908:x1874663042966144:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826110.126385:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826110.126407:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecf0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0ec expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826110.126472:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826110.126485:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826110.126497:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826110.126539:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787826110.126543:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826110.126565:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826110.126587:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f400/0x878a5eea00cecf0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0ec expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826110.126602:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0ec expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826110.126610:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb472721b00) 00010000:00010000:3.0:1787826110.126613:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826110.126616:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8e600, rc 0) 00000100:00100000:3.0:1787826110.126930:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:157908:x1874663042966144:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 576us (4995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826110.126938:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 931 00000100:00100000:3.0:1787826110.132756:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826110.132903:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042966272 00000100:00100000:0.0:1787826110.132913:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042966272 00000100:00100000:0.0:1787826110.132975:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 932 00000100:00100000:0.0:1787826110.132986:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:157908:x1874663042966272:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826110.133024:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:0.0:1787826110.133107:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:157908:x1874663042966272:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 124us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826110.133115:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 932 00000100:00080000:1.0:1787826110.133432:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826110.136452:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826110.136528:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042966400 00000100:00100000:3.0:1787826110.136538:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042966400 00000100:00100000:3.0:1787826110.136606:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 933 00000100:00100000:3.0:1787826110.136616:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:157908:x1874663042966400:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:3.0:1787826110.136651:0:188682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:3.0:1787826110.136724:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:157908:x1874663042966400:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 110us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826110.136731:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 933 00000100:00080000:0.0:1787826110.137290:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826110.151178:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826110.151298:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042966528 00000100:00100000:3.0:1787826110.151308:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042966528 00000100:00100000:3.0:1787826110.151399:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5743 00000100:00100000:3.0:1787826110.151410:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:157908:x1874663042966528:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826110.151440:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826110.151499:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:157908:x1874663042966528:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 91us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826110.151507:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5743 00000100:00080000:0.0:1787826110.151902:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826110.154903:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826110.154969:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042966656 00000100:00100000:3.0:1787826110.154978:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042966656 00000100:00100000:3.0:1787826110.155048:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5744 00000100:00100000:3.0:1787826110.155058:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:157908:x1874663042966656:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826110.155099:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826110.155162:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:157908:x1874663042966656:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 106us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826110.155169:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5744 00000100:00080000:0.0:1787826110.156280:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826110.298829:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826110.299256:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049268864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826110.299321:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826110.299555:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826110.299568:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049268992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826110.299598:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826110.299654:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826110.299689:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042966912 00000100:00100000:2.0:1787826110.299697:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042966912 00000100:00100000:2.0:1787826110.299754:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 934 00000100:00100000:2.0:1787826110.299765:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:157915:x1874663042966912:12345-192.168.203.47@tcp:36:mcreate.0 00000100:00100000:1.0:1787826110.299780:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049268864 00000100:00100000:1.0:1787826110.299786:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049268864 00010000:00010000:2.0:1787826110.299816:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826110.299826:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049268992 00000100:00100000:1.0:1787826110.299831:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049268992 00010000:00010000:2.0:1787826110.299850:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00cecf14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0ec expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826110.299855:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5745 00000100:00100000:1.0:1787826110.299867:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049268864:12345-0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826110.299874:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb472721b00) 00002000:00000024:1.0:1787826110.299883:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00010000:00010000:2.0:1787826110.299887:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826110.299926:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049268864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826110.299937:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5745 00000100:00100000:1.0:1787826110.299956:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5746 00010000:00010000:2.0:1787826110.299960:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826110.299965:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049268992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826110.299981:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00010000:00010000:2.0:1787826110.299982:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.299997:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.300011:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826110.300021:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049268992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (421us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826110.300022:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826110.300043:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5746 00010000:00010000:2.0:1787826110.300053:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826110.300291:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049268864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826110.300996:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049268992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787826110.301124:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.301136:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.301143:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.301149:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826110.301153:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.301161:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.301174:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481697d00) 00010000:00010000:2.0:1787826110.301178:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826110.301183:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.301189:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf1b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826110.301205:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9776480 reply state 00000000e44369a3 transno 339302416389 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.301217:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.301224:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb481697a00) 00010000:00010000:2.0:1787826110.301227:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826110.301229:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1787826110.301267:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826110.301273:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826110.301389:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:157915:x1874663042966912:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 1533us (1644us total) trans 339302416389 rc 0/0 00000100:00100000:2.0:1787826110.301459:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 934 00000100:00100000:1.0:1787826110.348469:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826110.352252:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042967040 00000100:00100000:2.0:1787826110.352268:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042967040 00000100:00100000:2.0:1787826110.352364:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 935 00000100:00100000:2.0:1787826110.352375:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:157918:x1874663042967040:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:2.0:1787826110.352405:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826110.352431:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0f3 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.352505:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cecf30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.352519:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cecf30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.352530:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cecf30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826110.352575:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787826110.352579:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826110.352602:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cecf30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.352627:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00cecf29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0f3 expref: 14 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.352643:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cecf30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0f3 expref: 13 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.352653:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481697d00) 00010000:00010000:2.0:1787826110.353744:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826110.353750:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39a00, rc 0) 00000100:00100000:2.0:1787826110.353861:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:157918:x1874663042967040:12345-192.168.203.47@tcp:101:rm.0 Request processed in 1486us (5401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826110.353869:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 935 00000100:00100000:0.0:1787826110.357422:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826110.357500:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042967168 00000100:00100000:1.0:1787826110.357509:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042967168 00000100:00100000:1.0:1787826110.357565:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 936 00000100:00100000:1.0:1787826110.357574:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:157918:x1874663042967168:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:1.0:1787826110.357594:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826110.357615:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00cecf37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0fa expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357676:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357691:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357700:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357710:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357719:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357725:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357815:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00cecf4c lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357824:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00cecf4c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357844:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00cecf4c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826110.357884:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1bd3:0x0]: returning size 0 00000004:00200000:1.0:1787826110.357888:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826110.357908:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00cecf4c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357919:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00cecf4c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357926:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357932:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357939:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357949:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826110.357954:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357961:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357973:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481697d00) 00010000:00010000:1.0:1787826110.357976:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826110.357980:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357986:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00cecf3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.357998:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358003:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358008:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358013:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826110.358015:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358020:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358030:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb481697a00) 00010000:00010000:1.0:1787826110.358042:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826110.358045:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358051:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3000/0x878a5eea00cecf45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358078:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2e00/0x878a5eea00cecf37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0fa expref: 15 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358091:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00cecf4c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0fa expref: 14 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826110.358098:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd3:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:1.0:1787826110.358100:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826110.358103:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2400, rc 0) 00000100:00100000:1.0:1787826110.358164:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157918:x1874663042967168:12345-192.168.203.47@tcp:101:rm.0 Request processed in 591us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826110.358172:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 936 00000100:00100000:2.0:1787826110.365565:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826110.365636:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042967424 00000100:00100000:0.0:1787826110.365651:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042967424 00000100:00100000:0.0:1787826110.365736:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 937 00000100:00100000:0.0:1787826110.365747:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157918:x1874663042967424:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826110.365812:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787826110.365838:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00cecf4c lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0fa expref: 14 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.365858:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd3:0x0].0x0 (ffff8eb47f8fd400) 00010000:00010000:0.0:1787826110.365875:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cecf30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0f3 expref: 13 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.365884:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481697d00) 00010000:00010000:0.0:1787826110.365889:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826110.365914:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.365926:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.365935:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.365947:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.366601:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.366613:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.366712:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.366721:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.366728:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.367215:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.367226:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.367233:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.367240:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.367246:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.367251:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.368533:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826110.368543:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 4/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.368555:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826110.368559:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 4/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.368567:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 5/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.368583:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd3:0x0].0x0 (ffff8eb472727800) 00010000:00010000:2.0:1787826110.368586:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826110.368591:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 3/0,0 mode: --/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826110.368602:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826110.368603:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826110.368605:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826110.368723:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826110.368730:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00cecf68 lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368823:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368832:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368838:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368844:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826110.368848:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368854:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368863:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd3:0x0].0x0 (ffff8eb472727800) 00010000:00010000:0.0:1787826110.368866:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826110.368869:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368875:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cecf61 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368897:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368903:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368909:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368914:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826110.368918:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368924:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368931:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb472727b00) 00010000:00010000:0.0:1787826110.368933:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826110.368936:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368941:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64000/0x878a5eea00cecf53 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826110.368962:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b705f404 reply state 000000006ba4905a transno 339302416390 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368974:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826110.368981:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb481697a00) 00010000:00010000:0.0:1787826110.368984:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826110.368987:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826110.369381:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157918:x1874663042967424:12345-192.168.203.47@tcp:36:rm.0 Request processed in 3631us (3826us total) trans 339302416390 rc 0/0 00000100:00100000:0.0:1787826110.369391:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 937 00000100:00100000:0.0:1787826110.718797:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826110.718867:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042967552 00000100:00100000:2.0:1787826110.718878:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042967552 00000100:00100000:2.0:1787826110.718931:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 83 00000100:00100000:2.0:1787826110.718942:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2391:x1874663042967552:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826110.719017:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2391:x1874663042967552:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826110.719025:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 83 00000100:00100000:1.0:1787826110.805352:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049269120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826110.805422:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826110.805555:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049269120 00000100:00100000:0.0:1787826110.805563:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049269120 00000100:00100000:0.0:1787826110.805615:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12637 00000100:00100000:0.0:1787826110.805625:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049269120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826110.805659:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826110.805704:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049269120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826110.805712:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12637 00000100:00100000:1.0:1787826110.805917:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049269120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826110.806202:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049269376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806239:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826110.806267:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049269888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806288:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826110.806306:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049270400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806345:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826110.806361:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787826110.806366:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049269248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806389:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826110.806405:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049269760:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806422:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826110.806433:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049270272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806449:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826110.806470:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049269376 00000100:00100000:2.0:1787826110.806474:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049269376 00000100:00100000:2.0:1787826110.806506:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049270400 00000100:00100000:2.0:1787826110.806508:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049270400 00000100:00100000:2.0:1787826110.806521:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049269760 00000100:00100000:2.0:1787826110.806523:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049269760 00000100:00100000:2.0:1787826110.806534:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787826110.806540:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049269376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806574:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049269376:12345-0@lo:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826110.806580:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787826110.806592:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787826110.806596:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049270400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806616:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049270400:12345-0@lo:400:kworker.0 Request processed in 20us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826110.806622:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787826110.806630:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787826110.806635:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049269760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806653:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049269760:12345-0@lo:400:kworker.0 Request processed in 18us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826110.806658:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787826110.806674:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049269248 00000100:00100000:2.0:1787826110.806677:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049269248 00000100:00100000:2.0:1787826110.806698:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787826110.806705:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049269248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806737:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049269248:12345-0@lo:400:kworker.0 Request processed in 33us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826110.806759:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787826110.806791:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049270272 00000100:00100000:2.0:1787826110.806795:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049270272 00000100:00100000:2.0:1787826110.806823:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6967 00000100:00100000:2.0:1787826110.806830:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049270272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806858:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049270272:12345-0@lo:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826110.806863:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6967 00000100:00100000:2.0:1787826110.806897:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049269248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806908:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049269760:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806915:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049270272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806922:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049269376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826110.806929:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049270400:0@lo:400:kworker.0 00000100:00080000:0.0:1787826110.807041:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826110.807046:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826110.807048:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826110.809189:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049269888 00000100:00100000:0.0:1787826110.809206:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049269888 00000100:00100000:0.0:1787826110.809274:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12638 00000100:00100000:0.0:1787826110.809285:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049269888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809393:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049269888:12345-0@lo:400:kworker.0 Request processed in 111us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826110.809400:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12638 00000100:00100000:0.0:1787826110.809429:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049269504:0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809465:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826110.809491:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049270016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809511:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826110.809530:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787826110.809536:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049269632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809557:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826110.809573:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049270144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809596:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826110.809623:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049269504 00000100:00100000:0.0:1787826110.809627:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049269504 00000100:00100000:0.0:1787826110.809660:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049270016 00000100:00100000:0.0:1787826110.809664:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049270016 00000100:00100000:0.0:1787826110.809676:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049269632 00000100:00100000:0.0:1787826110.809679:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049269632 00000100:00100000:0.0:1787826110.809692:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787826110.809698:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049269504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809732:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049269504:12345-0@lo:400:kworker.0 Request processed in 35us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826110.809738:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787826110.809772:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787826110.809778:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049270016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809805:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049270016:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826110.809812:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787826110.809824:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787826110.809830:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049269632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809856:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049269632:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826110.809861:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1787826110.809876:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826110.809879:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826110.809904:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049269632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809914:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049269504:0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809923:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049270016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826110.809962:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049269888:0@lo:400:kworker.0 00000100:00100000:1.0:1787826110.810269:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049270144 00000100:00100000:1.0:1787826110.810274:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049270144 00000100:00080000:0.0:1787826110.810376:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826110.810436:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6968 00000100:00100000:1.0:1787826110.810444:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049270144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826110.810486:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049270144:12345-0@lo:400:kworker.0 Request processed in 44us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826110.810492:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6968 00000100:00100000:0.0:1787826110.810546:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738463 gen 2 00000004:00080000:0.0:1787826110.810552:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb472584e00, transno 34359738463 00000100:00100000:0.0:1787826110.810564:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049270144:0@lo:400:kworker.0 00010000:00010000:3.0:1787826111.317453:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826111.845187:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826111.845212:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049270528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826111.845293:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826111.845455:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049270528 00000100:00100000:3.0:1787826111.845463:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049270528 00000100:00100000:3.0:1787826111.845514:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12639 00000100:00100000:3.0:1787826111.845523:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049270528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826111.845555:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00010000:00000080:3.0:1787826111.845570:0:8414:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481233b80 x1874663049270528/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:467/0 lens 224/368 e 0 to 0 dl 1787826122 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826111.845613:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049270528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826111.845621:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12639 00000100:00100000:2.0:1787826111.845924:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049270528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826112.345220:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049270656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826112.345846:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826112.345903:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049270656 00000100:00100000:1.0:1787826112.345910:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049270656 00000100:00100000:1.0:1787826112.345960:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5747 00000100:00100000:1.0:1787826112.345970:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049270656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826112.345997:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826112.348050:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049270784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787826112.352114:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826112.352487:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826112.352998:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049270656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7026us (7150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826112.353010:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5747 00000100:00100000:1.0:1787826112.353059:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049270784 00000100:00100000:1.0:1787826112.353067:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049270784 00000100:00100000:1.0:1787826112.353107:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5748 00000100:00100000:1.0:1787826112.353116:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049270784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826112.353150:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826112.353197:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049270784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826112.353203:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5748 00000100:00080000:1.0:1787826112.353221:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826112.353225:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826112.353484:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049270656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826112.356392:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049270784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787826113.366236:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826114.396446:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826115.412453:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826115.415244:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826115.415261:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049270912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826115.415262:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049271040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826115.421222:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826115.425740:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049270912 00000100:00100000:2.0:1787826115.425754:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049270912 00000100:00100000:3.0:1787826115.425812:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826115.427728:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826115.430024:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049271040 00000100:00100000:2.0:1787826115.430037:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049271040 00000100:00100000:2.0:1787826115.430123:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5749 00000100:00100000:2.0:1787826115.430136:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049270912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826115.430168:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826115.430251:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049270912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (9035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826115.430259:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5749 00000100:00100000:2.0:1787826115.430277:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5750 00000100:00100000:2.0:1787826115.430284:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049271040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826115.430299:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826115.430349:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049271040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826115.430355:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5750 00000100:00080000:2.0:1787826115.430379:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826115.430419:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049271040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826115.430460:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049270912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826115.861594:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826115.861647:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826115.861675:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042967936 00000100:00100000:0.0:1787826115.861684:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042967936 00000100:00100000:0.0:1787826115.861746:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 145 00000100:00100000:0.0:1787826115.861756:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042967936:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826115.861827:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042967936:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 73us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826115.861835:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 145 00000100:00100000:0.0:1787826115.861880:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826115.861994:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826115.862032:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826115.862062:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042967808 00000100:00100000:0.0:1787826115.862066:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042967808 00000100:00100000:0.0:1787826115.862094:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 146 00000100:00100000:0.0:1787826115.862102:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:2389:x1874663042967808:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826115.862121:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cd9180 x1874663042967808/t0(0) o400->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:471/0 lens 224/224 e 0 to 0 dl 1787826126 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826115.862152:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:2389:x1874663042967808:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826115.862163:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 146 00000100:00100000:3.0:1787826115.863496:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042967680 00000100:00100000:3.0:1787826115.863506:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042967680 00000100:00100000:3.0:1787826115.863552:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 85 00000100:00100000:3.0:1787826115.863561:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042967680:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826115.863615:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042967680:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 55us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826115.863631:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 85 00000100:00080000:2.0:1787826115.864259:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826115.864265:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826115.866727:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042968192 00000100:00100000:0.0:1787826115.866739:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042968192 00000100:00100000:0.0:1787826115.866861:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042968064 00000100:00100000:0.0:1787826115.866866:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042968064 00000100:00100000:3.0:1787826115.867022:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6969 00000100:00100000:3.0:1787826115.867036:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042968192:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826115.867124:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042968192:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 91us (5242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826115.867132:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6969 00000100:00080000:2.0:1787826115.881434:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826115.882183:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826115.898751:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6970 00000100:00100000:1.0:1787826115.898767:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042968064:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826115.898844:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042968064:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 82us (36811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826115.898865:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6970 00000100:00100000:0.0:1787826115.924769:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826115.924792:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049271168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826115.924872:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826115.924937:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049271168 00000100:00100000:0.0:1787826115.924946:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049271168 00000100:00100000:0.0:1787826115.924992:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12640 00000100:00100000:0.0:1787826115.925013:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049271168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826115.925044:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826115.925087:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049271168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826115.925094:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12640 00000100:00100000:0.0:1787826115.925139:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049271168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826115.930592:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049271424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.930664:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826115.930705:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049271936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.930732:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826115.930755:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049272448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.930776:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826115.930800:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826115.930805:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049271296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.930833:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826115.930868:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049271808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.931227:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826115.932037:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049272320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.932069:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826115.937477:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049272320 00000100:00100000:1.0:1787826115.937493:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049272320 00000100:00100000:1.0:1787826115.937573:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6971 00000100:00100000:1.0:1787826115.937584:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049272320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826115.937881:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049272320:12345-0@lo:400:kworker.0 Request processed in 298us (5810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826115.937888:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6971 00000100:00100000:1.0:1787826115.937919:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049271296 00000100:00100000:1.0:1787826115.937923:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049271296 00000100:00100000:1.0:1787826115.937952:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787826115.937959:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049271296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826115.938012:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049271296:12345-0@lo:400:kworker.0 Request processed in 53us (7178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826115.938019:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787826115.939200:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049271424 00000100:00100000:3.0:1787826115.939209:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049271424 00000100:00100000:3.0:1787826115.939285:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049272448 00000100:00100000:3.0:1787826115.939289:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049272448 00000100:00100000:3.0:1787826115.939316:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049271808 00000100:00100000:3.0:1787826115.939319:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049271808 00000100:00100000:3.0:1787826115.939358:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787826115.939366:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049271424:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826115.940286:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde3100 x1874663049271424/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:471/0 lens 224/224 e 0 to 0 dl 1787826126 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826115.940386:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049271424:12345-0@lo:400:kworker.0 Request processed in 1021us (9722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826115.940407:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787826115.940430:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787826115.940440:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049272448:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826115.940453:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb45eb73800 x1874663049272448/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:471/0 lens 224/224 e 0 to 0 dl 1787826126 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826115.940482:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049272448:12345-0@lo:400:kworker.0 Request processed in 45us (9705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826115.940489:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787826115.940501:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787826115.940508:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049271808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826115.940536:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049271808:12345-0@lo:400:kworker.0 Request processed in 30us (9310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826115.940542:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1787826115.940563:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826115.940568:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826115.940571:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826115.941442:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049271296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.941460:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049271808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.941473:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049272320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.941484:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049271424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.941496:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049272448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.944247:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049271936 00000100:00100000:0.0:1787826115.944263:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049271936 00000100:00100000:0.0:1787826115.944352:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12641 00000100:00100000:0.0:1787826115.944362:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049271936:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826115.944512:0:8414:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde0a80 x1874663049271936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:471/0 lens 224/224 e 0 to 0 dl 1787826126 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826115.944589:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049271936:12345-0@lo:400:kworker.0 Request processed in 228us (13855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826115.944596:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12641 00000100:00100000:0.0:1787826115.944627:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049271680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.944665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826115.944693:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049272192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.944721:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826115.944752:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787826115.944759:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049271552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.944782:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826115.944796:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049272192 00000100:00100000:0.0:1787826115.944798:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049272064:0@lo:400:kworker.0 00000100:00100000:1.0:1787826115.944801:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049272192 00000100:00100000:0.0:1787826115.944820:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826115.944839:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6972 00000100:00100000:0.0:1787826115.944842:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049271680 00000100:00100000:0.0:1787826115.944845:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049271680 00000100:00100000:1.0:1787826115.944846:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049272192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826115.944884:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049272192:12345-0@lo:400:kworker.0 Request processed in 39us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826115.944890:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6972 00000100:00080000:1.0:1787826115.944911:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826115.944915:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826115.945375:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049271552 00000100:00100000:1.0:1787826115.945381:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049271552 00000100:00100000:1.0:1787826115.945406:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049272064 00000100:00100000:1.0:1787826115.945409:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049272064 00000100:00100000:1.0:1787826115.945422:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787826115.945428:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049271680:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826115.945444:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb45eb72d80 x1874663049271680/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:471/0 lens 224/224 e 0 to 0 dl 1787826126 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826115.945474:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049271680:12345-0@lo:400:kworker.0 Request processed in 47us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826115.945480:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787826115.945494:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787826115.945500:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049271552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826115.945526:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049271552:12345-0@lo:400:kworker.0 Request processed in 27us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826115.945531:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787826115.945543:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787826115.945549:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049272064:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826115.945559:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4815e2300 x1874663049272064/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:471/0 lens 224/224 e 0 to 0 dl 1787826126 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826115.945585:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049272064:12345-0@lo:400:kworker.0 Request processed in 37us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826115.945590:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1787826115.945618:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826115.945649:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049271936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.946006:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049271552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.946019:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049272064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.946028:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049271680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826115.946038:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049272192:0@lo:400:kworker.0 00010000:00010000:3.0:1787826116.437529:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787826116.919524:0:190345:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416390 is committed 00010000:00010000:0.0:1787826116.919710:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919734:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919743:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919758:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826116.919764:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919772:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919795:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb481697a00) 00010000:00010000:0.0:1787826116.919798:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826116.919804:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919811:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38800/0x878a5eea00cecf22 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919827:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919832:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919838:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919843:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826116.919846:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919852:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919860:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb481697a00) 00010000:00010000:0.0:1787826116.919862:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826116.919866:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826116.919872:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64200/0x878a5eea00cecf5a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826116.949449:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049272576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826116.949517:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826116.956767:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049272576 00000100:00100000:0.0:1787826116.956783:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049272576 00000100:00100000:0.0:1787826116.956850:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12642 00000100:00100000:0.0:1787826116.956862:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049272576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826116.956898:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00010000:00000080:0.0:1787826116.956913:0:177390:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481109c00 x1874663049272576/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:472/0 lens 224/368 e 0 to 0 dl 1787826127 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826116.957009:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049272576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (7491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826116.957016:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12642 00000100:00100000:0.0:1787826116.957090:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049272576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826117.460662:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049272704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826117.460734:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826117.460804:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049272704 00000100:00100000:1.0:1787826117.460811:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049272704 00000100:00100000:1.0:1787826117.460866:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5751 00000100:00100000:1.0:1787826117.460876:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049272704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826117.460908:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826117.460952:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049272704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826117.460959:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5751 00000100:00080000:1.0:1787826117.460993:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826117.461029:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049272704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787826117.468561:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826117.481702:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826117.481726:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049272832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826117.481806:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826117.483087:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049272832 00000100:00100000:0.0:1787826117.483098:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049272832 00000100:00100000:0.0:1787826117.483170:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5752 00000100:00100000:0.0:1787826117.483181:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049272832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826117.483211:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826117.483274:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049272832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826117.483281:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5752 00000100:00080000:1.0:1787826117.483446:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826117.483564:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049272832:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787826118.311700:0:191589:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:2.0:1787826118.491201:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826119.509242:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826120.532503:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826120.532527:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049272960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826120.532603:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826120.532665:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049272960 00000100:00100000:2.0:1787826120.532673:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049272960 00000100:00100000:2.0:1787826120.532727:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5753 00000100:00100000:2.0:1787826120.532737:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049272960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826120.532765:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826120.532808:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049272960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826120.532816:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5753 00000100:00080000:2.0:1787826120.532836:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826120.532902:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049272960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826120.533170:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826120.533180:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049273088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826120.533213:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826120.533414:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049273088 00000100:00100000:0.0:1787826120.533418:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049273088 00000100:00100000:0.0:1787826120.533453:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5754 00000100:00100000:0.0:1787826120.533463:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049273088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826120.533479:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826120.533516:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049273088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826120.533523:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5754 00000100:00100000:0.0:1787826120.533554:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049273088:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787826120.533616:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826120.534804:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826120.962762:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826120.962806:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826120.962828:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826120.962859:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826120.962881:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826120.963021:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042968832 00000100:00100000:0.0:1787826120.963031:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042968832 00000100:00100000:0.0:1787826120.963094:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042968704 00000100:00100000:0.0:1787826120.963098:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042968704 00000100:00080000:2.0:1787826120.963111:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826120.963117:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826120.963130:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6973 00000100:00100000:0.0:1787826120.963140:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042968832:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826120.963219:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042968832:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 80us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826120.963226:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6973 00000100:00100000:0.0:1787826120.963244:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6974 00000100:00100000:0.0:1787826120.963252:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042968704:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826120.963277:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042968704:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826120.963283:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6974 00000100:00100000:3.0:1787826120.963298:0:190355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042968320 00000100:00100000:3.0:1787826120.963302:0:190355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042968320 00000100:00100000:3.0:1787826120.963357:0:190355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 87 00000100:00100000:3.0:1787826120.963366:0:190355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042968320:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826120.963406:0:190355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042968320:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 40us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826120.963414:0:190355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 87 00000100:00100000:1.0:1787826120.967321:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042968576 00000100:00100000:1.0:1787826120.967360:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042968576 00000100:00100000:0.0:1787826120.967549:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042968448 00000100:00100000:0.0:1787826120.967554:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042968448 00000100:00100000:0.0:1787826120.967617:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 153 00000100:00100000:0.0:1787826120.967628:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:2392:x1874663042968448:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826120.967657:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb44f6f8380 x1874663042968448/t0(0) o400->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:476/0 lens 224/224 e 0 to 0 dl 1787826131 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826120.967722:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:2392:x1874663042968448:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 97us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826120.967734:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 153 00000100:00080000:2.0:1787826120.969694:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826120.969702:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826120.971055:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 154 00000100:00100000:1.0:1787826120.971076:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042968576:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826120.971155:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042968576:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 87us (8348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826120.971163:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 154 00000100:00100000:0.0:1787826121.049721:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049273216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826121.049787:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826121.049866:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049273216 00000100:00100000:0.0:1787826121.049873:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049273216 00000100:00100000:0.0:1787826121.049920:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12643 00000100:00100000:0.0:1787826121.049931:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049273216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826121.049974:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826121.050018:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049273216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826121.050025:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12643 00000100:00100000:0.0:1787826121.050071:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049273216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826121.050433:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049273472:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.050466:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.050492:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049273984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.050515:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.050535:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049274496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.050557:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.050577:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787826121.050596:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049273344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.050624:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.050645:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049273856:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.050664:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.050678:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049274368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.050698:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.050726:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049273472 00000100:00100000:3.0:1787826121.050730:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049273472 00000100:00100000:3.0:1787826121.050769:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049274496 00000100:00100000:3.0:1787826121.050771:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049274496 00000100:00100000:3.0:1787826121.050786:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049273856 00000100:00100000:3.0:1787826121.050789:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049273856 00000100:00100000:3.0:1787826121.050802:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787826121.050809:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049273472:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826121.050838:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1fed80 x1874663049273472/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:477/0 lens 224/224 e 0 to 0 dl 1787826132 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826121.050871:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049273472:12345-0@lo:400:kworker.0 Request processed in 63us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.050878:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787826121.050892:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787826121.050899:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049274496:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826121.050910:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1ff800 x1874663049274496/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:477/0 lens 224/224 e 0 to 0 dl 1787826132 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826121.050935:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049274496:12345-0@lo:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.050940:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787826121.050952:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787826121.050967:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049273856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.050998:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049273856:12345-0@lo:400:kworker.0 Request processed in 41us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.051003:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787826121.051020:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049273984 00000100:00100000:3.0:1787826121.051023:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049273984 00000100:00100000:3.0:1787826121.051045:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12644 00000100:00100000:3.0:1787826121.051051:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049273984:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826121.051062:0:177390:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1ffb80 x1874663049273984/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:477/0 lens 224/224 e 0 to 0 dl 1787826132 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826121.051088:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049273984:12345-0@lo:400:kworker.0 Request processed in 37us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.051093:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12644 00000100:00100000:3.0:1787826121.051113:0:190352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049273344 00000100:00100000:3.0:1787826121.051116:0:190352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049273344 00000100:00100000:3.0:1787826121.051139:0:190352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787826121.051145:0:190352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049273344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051173:0:190352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049273344:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.051178:0:190352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787826121.051205:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049274368 00000100:00100000:3.0:1787826121.051208:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049274368 00000100:00100000:3.0:1787826121.051232:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6975 00000100:00100000:3.0:1787826121.051238:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049274368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051267:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049274368:12345-0@lo:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.051273:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6975 00000100:00080000:3.0:1787826121.051287:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826121.051292:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826121.051293:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826121.051317:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049273344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051353:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049273856:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051362:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049274368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051372:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049273472:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051380:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049273984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051388:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049274496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051430:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34bdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049273728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051454:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.051471:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049274240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051490:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.051506:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787826121.051511:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049273600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051529:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.051543:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049274112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051562:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.051581:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049273728 00000100:00100000:3.0:1787826121.051585:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049273728 00000100:00100000:3.0:1787826121.051607:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049273600 00000100:00100000:3.0:1787826121.051610:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049273600 00000100:00100000:3.0:1787826121.051625:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049274112 00000100:00100000:3.0:1787826121.051628:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049274112 00000100:00100000:3.0:1787826121.051637:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787826121.051643:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049273728:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826121.051655:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348e5c000 x1874663049273728/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:477/0 lens 224/224 e 0 to 0 dl 1787826132 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826121.051686:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049273728:12345-0@lo:400:kworker.0 Request processed in 43us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.051691:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787826121.051702:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787826121.051708:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049273600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051734:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049273600:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.051740:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787826121.051750:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787826121.051756:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049274112:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826121.051768:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348e5d880 x1874663049274112/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:477/0 lens 224/224 e 0 to 0 dl 1787826132 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826121.051792:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049274112:12345-0@lo:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.051797:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787826121.051814:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049274240 00000100:00100000:3.0:1787826121.051818:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049274240 00000100:00100000:3.0:1787826121.051842:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6976 00000100:00100000:3.0:1787826121.051848:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049274240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051876:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049274240:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.051883:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6976 00000100:00080000:3.0:1787826121.051900:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826121.051903:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826121.051906:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826121.051927:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049273600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051937:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049274112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051945:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34bdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049273728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826121.051953:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049274240:0@lo:400:kworker.0 00000020:01000004:0.0:1787826121.373493:0:191734:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787826121.373598:0:191734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.373613:0:191734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.373621:0:191734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.373629:0:191734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.373686:0:191734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787826121.373692:0:191734:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787826121.373719:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826121.373723:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787826121.373729:0:191734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787826121.373761:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787826121.373893:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049274624:0@lo:39:umount.0 00000100:00100000:1.0:1787826121.373968:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826121.374494:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049274624 00000100:00100000:0.0:1787826121.374501:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049274624 00000100:00100000:0.0:1787826121.374561:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1787826121.374570:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049274624:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787826121.374595:0:187905:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecc5f 00000100:00080000:0.0:1787826121.374609:0:187905:0:(import.c:65:import_set_state_nolock()) ffff8eb44908e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787826121.374722:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826121.374731:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.374740:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826121.374805:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.374817:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826121.374829:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826121.374835:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787826121.374837:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787826121.374839:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787826121.374909:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.374917:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826121.374943:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.374950:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed200/0x878a5eea00cecb40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb47 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.374969:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826121.374971:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826121.374973:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826121.375013:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826121.375024:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049274752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826121.375062:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.375143:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049274752 00000100:00100000:3.0:1787826121.375148:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049274752 00000100:00100000:3.0:1787826121.375185:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4213 00000100:00100000:3.0:1787826121.375193:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049274752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826121.375204:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826121.375219:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb479b3f200/0x878a5eea00cecb47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecb40 expref: 24 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.375231:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826121.375267:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3620:x1874663049274752:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.375274:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4213 00000100:00100000:1.0:1787826121.375377:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049274752:0@lo:103:ldlm_bl.0 00010000:00000080:0.0:1787826121.375768:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e84ed80 x1874663049274624/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:477/0 lens 224/224 e 0 to 0 dl 1787826132 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826121.375855:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1874663049274624:12345-0@lo:39:umount.0 Request processed in 1285us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826121.375863:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000020:00000080:0.0:1787826121.375872:0:187905:0:(genops.c:885:class_export_put()) final put ffff8eb449088800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787826121.376003:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb449088800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787826121.376047:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb44908e000 for lustre-MDT0000 00000100:00080000:1.0:1787826121.376119:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826121.376135:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049274624:0@lo:39:umount.0 00000100:00080000:0.0:1787826121.376183:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826121.376187:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787826121.376191:0:191734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787826121.377216:0:191734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.377228:0:191734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.377235:0:191734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.377242:0:191734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.377303:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826121.377310:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.377316:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826121.377320:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.377348:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826121.377355:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826121.377361:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787826121.377364:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787826121.377444:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.377451:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826121.377473:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.377481:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826121.377483:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826121.377485:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826121.377521:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826121.377546:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049274880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826121.377596:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826121.377706:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049274880 00000100:00100000:3.0:1787826121.377713:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049274880 00000100:00100000:3.0:1787826121.377764:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4214 00000100:00100000:3.0:1787826121.377774:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3619:x1874663049274880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826121.377787:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826121.377801:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724edc00/0x878a5eea00ceca75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceca67 expref: 23 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.377815:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826121.377854:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3619:x1874663049274880:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826121.377864:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4214 00000100:00100000:3.0:1787826121.377895:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049274880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826121.378121:0:191734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826121.378127:0:191734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18c00/0x878a5eea00ceca67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceca75 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378140:0:191734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378147:0:191734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378154:0:191734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378160:0:191734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.378187:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826121.378192:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.378199:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eca00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826121.378202:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.378209:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826121.378216:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826121.378221:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826121.378223:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1787826121.378237:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.378243:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787826121.378290:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1787826121.378353:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.378362:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826121.378363:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826121.378365:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826121.378433:0:191734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826121.378438:0:191734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb4724eca00/0x878a5eea00cecb78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb86 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826121.378447:0:191734:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787826121.378458:0:191734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378465:0:191734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378471:0:191734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378477:0:191734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378495:0:191734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826121.378501:0:191734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378507:0:191734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378513:0:191734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826121.378519:0:191734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.378591:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826121.378597:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.378607:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826121.378610:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.378617:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826121.378624:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826121.378630:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787826121.378632:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787826121.378634:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787826121.378662:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.378668:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826121.378694:0:191734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787826121.378698:0:191734:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787826121.378701:0:191734:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787826121.378731:0:191734:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787826121.378735:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1787826121.378739:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1787826121.378754:0:191734:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1787826121.379917:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826121.379925:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.379933:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826121.379937:0:9495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.379945:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826121.379952:0:9495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826121.379966:0:9495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826121.379968:0:9495:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787826121.379971:0:9495:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787826121.379995:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.380001:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826121.380018:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.380025:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19c00/0x878a5eea00ceca59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceca60 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.380036:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826121.380038:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826121.380039:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826121.380054:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049275264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826121.380105:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826121.380148:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:0.0:1787826121.388157:0:191734:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1787826121.388402:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1787826121.388410:0:191734:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb44908c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826121.388417:0:191734:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb46e35f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826121.388421:0:191734:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb46e35e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826121.388426:0:191734:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb34df97000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 330712483740 stale:0 00000020:00080000:0.0:1787826121.388432:0:191734:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb34df92000 a9ce6693-0634-46c5-bf21-5ca7d026d44e 192.168.203.47@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 339302416390 stale:0 00000020:00080000:0.0:1787826121.388436:0:191734:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8eb343ea3370) has exports, disconnecting them 00000020:00080000:0.0:1787826121.388441:0:191734:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb44908c000), last request at 1787826080 00000020:00000080:0.0:1787826121.388449:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecc58 00000100:00080000:0.0:1787826121.388457:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb44908d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826121.388481:0:191734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb44908c000): rc 0 00000020:00000080:0.0:1787826121.388484:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb44908c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787826121.388493:0:191734:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb46e35f000), last request at 1787826121 00000020:00000080:0.0:1787826121.388496:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecc51 00000100:00080000:0.0:1787826121.388500:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb46e35a000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787826121.388513:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb44908c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826121.388555:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb44908d800 for lustre-MDT0000 00000020:00080000:0.0:1787826121.388565:0:191734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb46e35f000): rc 0 00000020:00000080:0.0:1787826121.388567:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb46e35f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787826121.388573:0:191734:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb46e35e000), last request at 1787826121 00000100:00100000:1.0:1787826121.389075:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275264 00000100:00100000:1.0:1787826121.389083:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275264 00000100:00100000:1.0:1787826121.389129:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4215 00000100:00100000:1.0:1787826121.389138:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb450a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3619:x1874663049275264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826121.389151:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826121.389168:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ed400/0x878a5eea00ceca60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceca59 expref: 22 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826121.389184:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826121.389252:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb450a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3619:x1874663049275264:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (9146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826121.389259:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4215 00000100:00100000:1.0:1787826121.389319:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049275136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826121.389370:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826121.389400:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049275008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826121.389421:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826121.389440:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275136 00000100:00100000:1.0:1787826121.389444:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275136 00000100:00100000:1.0:1787826121.389465:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275008 00000100:00100000:1.0:1787826121.389468:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275008 00000100:00100000:1.0:1787826121.389488:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4216 00000100:00100000:1.0:1787826121.389494:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3618:x1874663049275136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826121.389501:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826121.389511:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ede00/0x878a5eea00cecb39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecb32 expref: 22 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826121.389521:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826121.389542:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3618:x1874663049275136:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826121.389548:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4216 00000100:00100000:1.0:1787826121.389559:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4217 00000100:00100000:1.0:1787826121.389564:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:3618:x1874663049275008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826121.389571:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1787826121.389662:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecc4a 00000100:00080000:0.0:1787826121.389672:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb46e35d000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787826121.389689:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e35f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826121.389718:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46e35a000 for lustre-MDT0000 00000020:00080000:0.0:1787826121.389730:0:191734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb46e35e000): rc 0 00000020:00000080:0.0:1787826121.389732:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb46e35e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787826121.389740:0:191734:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb34df97000), last request at 1787826074 00010000:00010000:1.0:1787826121.389809:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ed600/0x878a5eea00cecb86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecb78 expref: 20 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826121.389822:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826121.389847:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3618:x1874663049275008:12345-0@lo:103:ldlm_bl.0 Request processed in 282us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826121.389853:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4217 00000100:00100000:1.0:1787826121.389888:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049275008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826121.389907:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049275136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826121.389995:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.390004:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18800/0x878a5eea00cecb32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecb39 expref: -99 pid: 190344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787826121.390062:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecab4 00000100:00080000:0.0:1787826121.390072:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e5800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787826121.390082:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e35e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826121.390102:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46e35d000 for lustre-MDT0000 00000020:00080000:0.0:1787826121.390132:0:191734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb34df97000): rc 0 00000020:00000080:0.0:1787826121.390135:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb34df97000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1787826121.390208:0:191734:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.47@tcp (ffff8eb34df92000), last request at 1787826120 00000020:00000080:0.0:1787826121.390212:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecaad 00000020:00010000:0.0:1787826121.390219:0:191734:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb34df92000: total 1 00000100:00080000:0.0:1787826121.390222:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb343644800 : changing import state from FULL to CLOSED 00000004:00080000:0.0:1787826121.390279:0:191734:0:(mdd_object.c:3895:mdd_close()) Object [0x20001a9e3:0x1bd2:0x0] is retained in orphan list 00000020:00080000:0.0:1787826121.390288:0:191734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb34df92000): rc 0 00000004:00000080:0.0:1787826121.390294:0:191734:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb65b82077ae0 00000100:00080000:0.0:1787826121.390309:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826121.390312:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869980 gen 3 00000020:00010000:3.0:1787826121.391785:0:6479:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb34df92000: total 1 00010000:00010000:3.0:1787826121.391844:0:6479:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb34df92000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1787826121.391881:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2200/0x878a5eea00cece96 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0c9 expref: 5 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.391908:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cecca5 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 4 pid: 190378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.391922:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38c00/0x878a5eea00ceccac lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64b3f expref: 3 pid: 190378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.391939:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3200/0x878a5eea00cece88 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1bd0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0c2 expref: 2 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826121.391952:0:6479:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb34df92000, canceled 4 locks, left on hash table 0. 00000100:00080000:0.0:1787826121.394493:0:191734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787826121.394524:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb47f75d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787826121.398873:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826121.398885:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826121.398944:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34df97000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787826121.399018:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f7e5800 for lustre-MDT0000 00000100:00080000:0.0:1787826121.399195:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787826121.399200:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738463 gen 3 00000004:00080000:0.0:1787826121.399221:0:191734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787826121.399280:0:191734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787826121.399306:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb476e68800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787826121.399315:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787826121.399317:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975534 gen 3 00000004:00080000:0.0:1787826121.399343:0:191734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787826121.399399:0:191734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787826121.399409:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb47bfd3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787826121.399450:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb343ea3370) has no exports 00000020:00080000:0.0:1787826121.399911:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb343ea3370) has no exports 00000100:00100000:2.0:1787826121.401743:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049275264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826121.401909:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049275392:0@lo:39:umount.0 00000100:00100000:1.0:1787826121.401985:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826121.402025:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049275520:0@lo:9:umount.0 00000100:00100000:1.0:1787826121.402049:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826121.402068:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049275648:0@lo:9:umount.0 00000100:00100000:1.0:1787826121.402090:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826121.402123:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275520 00000100:00100000:1.0:1787826121.402129:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275520 00000100:00100000:1.0:1787826121.402166:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275648 00000100:00100000:1.0:1787826121.402169:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275648 00000100:00100000:1.0:1787826121.402187:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22544 00000100:00100000:1.0:1787826121.402195:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049275520:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787826121.402220:0:179224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecb0f 00000100:00080000:1.0:1787826121.402229:0:179224:0:(import.c:65:import_set_state_nolock()) ffff8eb47bfd2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787826121.402269:0:179224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738463 00000100:00100000:1.0:1787826121.402418:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049275520:12345-0@lo:9:umount.0 Request processed in 222us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826121.402426:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22544 00000100:00100000:1.0:1787826121.402442:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22545 00000100:00100000:1.0:1787826121.402449:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049275648:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787826121.402459:0:179224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecb24 00000100:00080000:1.0:1787826121.402465:0:179224:0:(import.c:65:import_set_state_nolock()) ffff8eb34b9e1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787826121.402486:0:179224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975534 00000100:00100000:1.0:1787826121.402551:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049275648:12345-0@lo:9:umount.0 Request processed in 102us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826121.402557:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22545 00010000:00010000:1.0:1787826121.402646:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826121.402666:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb476e68800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787826121.402678:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787826121.402680:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826121.402683:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049275520:0@lo:9:umount.0 00000100:00080000:1.0:1787826121.402692:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47bfd3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787826121.402699:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787826121.402700:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826121.402703:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049275648:0@lo:9:umount.0 00010000:00010000:1.0:1787826121.402717:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826121.405704:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275392 00000100:00100000:2.0:1787826121.405717:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275392 00000100:00100000:2.0:1787826121.405792:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12645 00000100:00100000:2.0:1787826121.405802:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049275392:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787826121.405833:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecae5 00000100:00080000:2.0:1787826121.405842:0:8414:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826121.405861:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 4, last_transno is 17179869980 00000100:00100000:2.0:1787826121.406034:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1874663049275392:12345-0@lo:39:umount.0 Request processed in 233us (4049us total) trans 17179869981 rc 0/0 00000100:00100000:2.0:1787826121.406042:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12645 00010000:00010000:1.0:1787826121.406181:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826121.406216:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f75d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826121.406224:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049275392:0@lo:39:umount.0 00010000:00010000:2.0:1787826121.407412:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826121.407417:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826121.407420:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826121.436868:0:6479:0:(genops.c:885:class_export_put()) final put ffff8eb34df92000/a9ce6693-0634-46c5-bf21-5ca7d026d44e 00010000:00010000:2.0:1787826121.439729:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826121.439736:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826121.439739:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787826121.441678:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34df92000/a9ce6693-0634-46c5-bf21-5ca7d026d44e for lustre-MDT0000 00000020:00000080:1.0:1787826121.441763:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb343644800 for lustre-MDT0000 00000020:00000080:0.0:1787826121.462464:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecac9 00000020:00000080:0.0:1787826121.462480:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb4607e7800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787826121.462646:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787826121.462713:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4607e7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787826121.462838:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826121.462850:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787826121.462855:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8eb3449f3370) has no exports 00000020:00000080:1.0:1787826121.464075:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecac2 00000020:00000080:1.0:1787826121.464085:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb47bfd4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787826121.464146:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47bfd4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787826121.464311:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826121.464321:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787826121.464471:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb47bfd1800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787826121.464474:0:191734:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47bfd1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787826121.464483:0:191734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1787826121.464719:0:191734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb344451960 - data ffff8eb4722b2af8/ffff8eb4771a3400 00000020:01000000:1.0:1787826121.464923:0:191734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb344d13d20 - data ffff8eb4722b0bd0/ffff8eb34dfe5400 00000100:00080000:2.0:1787826121.506302:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787826121.506321:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869980 gen 4 00000100:00100000:2.0:1787826121.506355:0:191734:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb4815e2680 x1874663049275392/t17179869981(17179869981) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826131 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826121.506377:0:191734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787826121.519811:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787826121.519818:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738463 gen 4 00000004:00080000:0.0:1787826121.519830:0:191734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826121.519833:0:191734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787826121.520928:0:190363:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787826121.520934:0:190363:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13c:0x0] index 2 count 1 00000040:00080000:2.0:1787826121.520947:0:190363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 79 count 2 00000100:00080000:0.0:1787826121.523294:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787826121.523302:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975534 gen 4 00000004:00080000:0.0:1787826121.523319:0:191734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826121.523322:0:191734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787826121.527418:0:190365:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787826121.527896:0:190365:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13e:0x0] index 1 count 1 00000040:00080000:2.0:1787826121.527908:0:190365:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 79 count 2 00000020:00000080:0.0:1787826121.532555:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceca83 00000020:00000080:0.0:1787826121.532569:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826121.533183:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceca98 00000020:00000080:0.0:1787826121.533190:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787826121.533208:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787826121.533213:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826121.533635:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826121.533642:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8eb343ea19b8) has no exports 00000004:01000000:0.0:1787826121.533800:0:191734:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787826121.533808:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecb16 00000020:00000080:0.0:1787826121.533813:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb348a3a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787826121.533818:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787826121.533822:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826121.533826:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787826121.533829:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8eb341a6b370) has no exports 00000020:00000080:0.0:1787826121.533835:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecb08 00000020:00000080:0.0:1787826121.533838:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb4727d8800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787826121.534185:0:191734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000020:00000080:2.0:1787826121.534274:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826121.534295:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787826121.534301:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a3a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787826121.534312:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4727d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:0.0:1787826121.534315:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787826121.534320:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975534 gen 5 00000004:00080000:0.0:1787826121.534538:0:191734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826121.534541:0:191734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826121.534625:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826121.534634:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826121.534640:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecafa 00000020:00000080:0.0:1787826121.534645:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826121.534702:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47bfd3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787826121.534710:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb448c98000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826121.534713:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c98000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787826121.534718:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787826121.535123:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787826121.535128:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826121.535133:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787826121.535137:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8eb46a870000) has no exports 00000020:00000080:0.0:1787826121.535142:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecaf3 00000020:00000080:0.0:1787826121.535146:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb476e6a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787826121.535164:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1787826121.535587:0:191734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787826121.535591:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787826121.535594:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738463 gen 5 00000004:00080000:0.0:1787826121.535598:0:191734:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826121.535599:0:191734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826121.536037:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb476e6a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826121.536205:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826121.536212:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787826121.536235:0:191734:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787826121.536241:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecade 00000020:00000080:0.0:1787826121.536247:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb4727de800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826121.536298:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb476e68800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787826121.536305:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb4727d9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826121.536308:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4727d9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787826121.536313:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787826121.536595:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787826121.536601:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826121.536607:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787826121.536611:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8eb481d599b8) has no exports 00000020:00000080:0.0:1787826121.536616:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecad7 00000020:00000080:0.0:1787826121.536621:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb47f75f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787826121.537883:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4727de800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787826121.537898:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f75f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787826121.557317:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1787826121.572113:0:191734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787826121.572121:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826121.572125:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 17179869980 gen 5 00000100:00100000:0.0:1787826121.572134:0:191734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826121.572234:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826121.572246:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826121.572293:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826121.572297:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826121.572302:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb46abef800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826121.572306:0:191734:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46abef800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787826121.572314:0:191734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826121.572444:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceca9f 00000020:00000080:0.0:1787826121.572450:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e0800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787826121.574188:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f75d800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787826121.574203:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb4727dc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826121.574206:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4727dc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787826121.574218:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787826121.574812:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787826121.574819:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826121.574828:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826121.574832:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8eb343ea4d28) has no exports 00000020:00000080:0.0:1787826121.574862:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826121.574867:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787826121.574872:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecaa6 00000020:00000080:0.0:1787826121.574878:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787826121.574904:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787826121.574909:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e7800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787826121.574911:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787826121.574915:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787826121.575000:0:191734:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb3422b3000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787826121.575004:0:191734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb3422b3000 3 00000020:01000004:0.0:1787826121.575007:0:191734:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb3422b3000 from lustre-MDT0000 00000020:00000080:0.0:1787826121.575032:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826121.575036:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787826121.575039:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e5000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787826121.575041:0:191734:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e5000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787826121.575047:0:191734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787826121.575102:0:191734:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787826121.575105:0:191734:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787826121.575108:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787826121.575111:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826121.575114:0:191734:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787826121.575121:0:191734:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb349793800 7528148b-9bee-4d31-b597-8aae3b0b4982 192.168.203.47@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826121.575128:0:191734:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb4727dd000 205ad83e-e455-4070-92a2-f1e25b8f3f40 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826121.575133:0:191734:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8eb3449f0000) has exports, disconnecting them 00000020:00080000:0.0:1787826121.575137:0:191734:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.47@tcp (ffff8eb349793800), last request at 1787826074 00000020:00000080:0.0:1787826121.575151:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecb63 00000020:00010000:0.0:1787826121.575155:0:191734:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb349793800: total 1 00000100:00080000:0.0:1787826121.575159:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb349797800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826121.575181:0:191734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb349793800): rc 0 00000020:00080000:0.0:1787826121.575184:0:191734:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8eb4727dd000), last request at 1787826074 00000020:00000080:0.0:1787826121.575190:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceca44 00000020:00010000:0.0:1787826121.575192:0:191734:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb4727dd000: total 1 00000100:00080000:0.0:1787826121.575195:0:191734:0:(import.c:65:import_set_state_nolock()) ffff8eb4727dc000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826121.575201:0:191734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb4727dd000): rc 0 00000020:00080000:0.0:1787826121.575204:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8eb3449f0000) has no exports 00000020:00010000:2.0:1787826121.575248:0:9495:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb349793800: total 1 00000100:00100000:0.0:1787826121.575251:0:190353:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8eb442d63000:190353] 2 exiting: rc = 0 00010000:00010000:2.0:1787826121.575290:0:9495:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb349793800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1787826121.575321:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb479b3f800/0x878a5eea00cecb6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f09f expref: 5 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575359:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ec000/0x878a5eea00cecb7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0ad expref: 4 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575373:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ed000/0x878a5eea00cecb71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0a6 expref: 3 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575388:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65600/0x878a5eea00cecbe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0b4 expref: 2 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575402:0:9495:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb349793800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1787826121.575421:0:9495:0:(genops.c:885:class_export_put()) final put ffff8eb349793800/7528148b-9bee-4d31-b597-8aae3b0b4982 00000020:00010000:2.0:1787826121.575427:0:9495:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb4727dd000: total 2 00010000:00010000:2.0:1787826121.575431:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826121.575449:0:9495:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb4727dd000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787826121.575467:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cecc43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecc3c expref: 14 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826121.575471:0:190355:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8eb48148f200:190355] 3 exiting: rc = 0 00010000:00010000:2.0:1787826121.575481:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ec400/0x878a5eea00cecb94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecb8d expref: 13 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575494:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ec200/0x878a5eea00cecba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecb9b expref: 12 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575508:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf39400/0x878a5eea00cecbef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecbe8 expref: 11 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575518:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34ab19200/0x878a5eea00cecbbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecbb7 expref: 10 pid: 190355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575529:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb479b3e600/0x878a5eea00cecbfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecbf6 expref: 9 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575539:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724ecc00/0x878a5eea00cecbb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecba9 expref: 8 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575548:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb479b3fc00/0x878a5eea00cecc19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecc12 expref: 7 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575558:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb479b3ea00/0x878a5eea00cecbcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecbc5 expref: 6 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575572:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34ab19600/0x878a5eea00cecc0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecc04 expref: 5 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575582:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb4724eda00/0x878a5eea00cecbda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecbd3 expref: 4 pid: 190352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575593:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb479b3f000/0x878a5eea00cecc27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecc20 expref: 3 pid: 190353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575604:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34ab18000/0x878a5eea00cecc35 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecc2e expref: 2 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826121.575614:0:9495:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb4727dd000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1787826121.575625:0:9495:0:(genops.c:885:class_export_put()) final put ffff8eb4727dd000/205ad83e-e455-4070-92a2-f1e25b8f3f40 00010000:00010000:2.0:1787826121.575630:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826121.575631:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826121.575633:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826121.575639:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826121.575711:0:190352:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8eb34bb2bc00:190352] 1 exiting: rc = 0 00000100:00100000:3.0:1787826121.575755:0:190351:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8eb451015000:190351] 0 exiting: rc = 1 00000020:00000080:3.0:1787826121.575794:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787826121.575799:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb349793800/7528148b-9bee-4d31-b597-8aae3b0b4982 for MGS 00000020:00000080:3.0:1787826121.575836:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4727dd000/205ad83e-e455-4070-92a2-f1e25b8f3f40 for MGS 00000020:00000080:3.0:1787826121.575846:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb349797800 for MGS 00000020:00000080:3.0:1787826121.575850:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb4727dc000 for MGS 00000100:00100000:0.0:1787826121.579455:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579465:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579486:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579492:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579498:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579503:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579509:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579517:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579522:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579529:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579534:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579540:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579546:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579552:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579558:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579563:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579569:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579574:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579580:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579587:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579592:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579597:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579603:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579863:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579872:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579877:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579883:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579889:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579895:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579901:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579907:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579914:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579919:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579927:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579932:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579938:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579944:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579951:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579967:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579974:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579979:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579985:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579991:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.579997:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580003:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580009:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580015:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580021:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580027:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580033:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580039:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580044:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580051:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580056:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580062:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580068:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580073:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580079:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580085:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580090:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580096:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580100:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580106:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826121.580112:0:191734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787826121.581722:0:191734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb344d13240 - data ffff8eb447a59ca8/ffff8eb34dfe6800 00000020:01000000:2.0:1787826121.581853:0:191734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb348af4660 - data ffff8eb4720270d8/ffff8eb47f868400 00000020:00000080:2.0:1787826121.582247:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceca3d 00000020:00000080:2.0:1787826121.582254:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb469f64000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787826121.582272:0:191734:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb3422b3000 from MGS, refs=2 00000020:01000004:2.0:1787826121.582275:0:191734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb3422b3000 2 00000020:01000004:2.0:1787826121.582278:0:191734:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb3422b3000 from MGS 00000020:00000080:2.0:1787826121.582295:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826121.582300:0:191734:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787826121.582302:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb469f60000/MGS 00000020:00000080:2.0:1787826121.582305:0:191734:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb469f60000/MGS for MGS 00000020:01000000:2.0:1787826121.582310:0:191734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787826121.582391:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787826121.582394:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826121.582400:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787826121.582406:0:191734:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8eb348a3b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826121.582411:0:191734:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8eb344e64d28) has exports, disconnecting them 00000020:00080000:2.0:1787826121.582415:0:191734:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8eb348a3b800), last request at 1787826074 00000020:00000080:2.0:1787826121.582419:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecb55 00000020:00080000:2.0:1787826121.582425:0:191734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb348a3b800): rc 0 00000020:00000080:2.0:1787826121.582430:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb348a3b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787826121.583032:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb469f64000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787826121.583040:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a3b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787826121.583358:0:191734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787826121.583363:0:191734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826121.583367:0:191734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787826121.583372:0:191734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826121.583517:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787826121.583523:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787826121.583527:0:191734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb3422b3000 1 00000020:00000080:3.0:1787826121.583531:0:191734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceca2f 00000020:00000080:3.0:1787826121.583536:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb469f65000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787826121.583539:0:191734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787826121.583542:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826121.583545:0:191734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787826121.583547:0:191734:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8eb3449f19b8) has no exports 00000020:00000080:0.0:1787826121.586089:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb348a3d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787826121.586103:0:179516:0:(genops.c:885:class_export_put()) final put ffff8eb348a38800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787826121.586106:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a38800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787826121.586117:0:179516:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787826121.586207:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb469f65000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826121.693920:0:191734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826121.693933:0:191734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787826121.693938:0:191734:0:(genops.c:885:class_export_put()) final put ffff8eb3422b2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826121.693942:0:191734:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3422b2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787826121.693951:0:191734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787826121.694628:0:191734:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8eb3422b5000 00000020:02000400:0.0:1787826121.694694:0:191734:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1787826122.069858:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826122.069882:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049275776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826122.069964:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826122.070061:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275776 00000100:00100000:0.0:1787826122.070069:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275776 00000100:00100000:0.0:1787826122.070115:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12646 00000100:00100000:0.0:1787826122.070124:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3619:x1874663049275776:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787826122.070132:0:177390:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787826122.070186:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3619:x1874663049275776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (232us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826122.070193:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12646 00000100:02020000:2.0:1787826122.070566:0:3619:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787826122.070573:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826122.070578:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826122.070582:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787826122.070589:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826122.070593:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8146 00000100:00080000:2.0:1787826122.070601:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826122.070627:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46ea68a80 x1874663049275904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826122.070701:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049275904:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787826122.070736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826122.070980:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275904 00000100:00100000:2.0:1787826122.070986:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275904 00000100:00100000:2.0:1787826122.071021:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12647 00000100:00100000:2.0:1787826122.071027:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049275904:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787826122.071050:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826122.071101:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049275904:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 72us (363us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826122.071107:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12647 00000100:00080000:3.0:1787826122.071250:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826122.071255:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826122.071259:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049275904:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1787826122.581531:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826123.617248:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826124.630514:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826125.652673:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049276032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826125.652758:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826125.652870:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049276032 00000100:00100000:1.0:1787826125.652878:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049276032 00000100:00100000:1.0:1787826125.652973:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5755 00000100:00100000:1.0:1787826125.652985:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049276032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826125.653015:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826125.653072:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049276032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826125.653080:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5755 00010000:00010000:2.0:1787826125.653648:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826125.653901:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049276160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826125.653953:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826125.654047:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049276160 00000100:00100000:1.0:1787826125.654052:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049276160 00000100:00100000:1.0:1787826125.654101:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5756 00000100:00100000:1.0:1787826125.654110:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049276160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826125.654133:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826125.654180:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049276160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826125.654186:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5756 00000100:00100000:0.0:1787826125.654618:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049276160:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787826125.654687:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826125.654691:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826125.654718:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049276032:0@lo:13:osp-pre-1-1.0 00000400:00000100:2.0:1787826126.074867:0:3612:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042968960 offset 0 length 224: 4 00000100:00100000:2.0:1787826126.074911:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826126.074959:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826126.075648:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042969216 00000100:00100000:3.0:1787826126.075658:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042969216 00000100:00100000:3.0:1787826126.075731:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 161 00000100:00100000:3.0:1787826126.075742:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042969216:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826126.075812:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042969216:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 72us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826126.075819:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 161 00000100:00100000:1.0:1787826126.075979:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:2.0:1787826126.076101:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826126.076309:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042969088 00000100:00100000:3.0:1787826126.076314:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042969088 00000100:00100000:0.0:1787826126.076445:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042969472 00000100:00100000:0.0:1787826126.076450:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042969472 00000100:00100000:0.0:1787826126.076505:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6977 00000100:00100000:0.0:1787826126.076516:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042969472:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826126.076566:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042969472:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 54us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826126.076573:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6977 00000100:00100000:3.0:1787826126.076734:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 939 00000100:00100000:3.0:1787826126.076740:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1874663042969088:12345-192.168.203.47@tcp:400:kworker.0 00000020:00080000:3.0:1787826126.076746:0:187904:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.47@tcp 00000100:00100000:3.0:1787826126.076785:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1874663042969088:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (806us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826126.076791:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 939 00000100:00080000:1.0:1787826126.076992:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826126.084900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826126.087686:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042969344 00000100:00100000:2.0:1787826126.087701:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042969344 00000100:00100000:2.0:1787826126.087791:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6978 00000100:00100000:2.0:1787826126.087802:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042969344:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826126.087886:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042969344:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 86us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826126.087894:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6978 00000100:00080000:0.0:1787826126.088037:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826126.111110:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826126.111241:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042969600 00000100:00100000:3.0:1787826126.111252:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042969600 00000100:00100000:3.0:1787826126.111315:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 940 00000100:00100000:3.0:1787826126.111354:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042969600:12345-192.168.203.47@tcp:38:ptlrpcd_01_01.0 00010000:00020000:3.0:1787826126.111377:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826126.111432:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042969600:12345-192.168.203.47@tcp:38:ptlrpcd_01_01.0 Request processed in 107us (331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826126.111439:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 940 00000100:00080000:1.0:1787826126.164815:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826126.164822:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826126.164825:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826126.164833:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8188 00000100:00080000:1.0:1787826126.164840:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826126.164848:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826126.164876:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34df17800 x1874663049276928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826126.164878:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049276288:0@lo:400:kworker.0 00000400:00000100:3.0:1787826126.164988:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049276288 offset 0 length 224: 4 00000100:00100000:2.0:1787826126.165041:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049276416:0@lo:400:kworker.0 00000100:00100000:3.0:1787826126.165062:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049276800:0@lo:400:kworker.0 00000100:00100000:0.0:1787826126.165143:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049276672:0@lo:400:kworker.0 00000100:00100000:1.0:1787826126.165213:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049276928:0@lo:38:kworker.0 00000100:00100000:3.0:1787826126.165490:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826126.165530:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826126.165539:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049277056:0@lo:400:kworker.0 00000100:00100000:3.0:1787826126.165573:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826126.166046:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049276800 00000100:00100000:3.0:1787826126.166058:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049276800 00000100:00100000:3.0:1787826126.166133:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049277056 00000100:00100000:3.0:1787826126.166138:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049277056 00000100:00100000:3.0:1787826126.166160:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787826126.166173:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049276800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826126.166246:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049276800:12345-0@lo:400:kworker.0 Request processed in 76us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826126.166253:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787826126.166273:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:3.0:1787826126.166277:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1874663049277056:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787826126.166282:0:188682:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826126.166312:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1874663049277056:12345-0@lo:400:kworker.0 Request processed in 33us (739us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826126.166318:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00080000:3.0:1787826126.166394:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787826126.166400:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787826126.166404:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787826126.166410:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826126.166414:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8146 00000100:00080000:3.0:1787826126.166420:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826126.166448:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb472584e00 x1874663049277184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826126.166466:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049277056:0@lo:400:kworker.0 00000100:00100000:3.0:1787826126.166485:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049276800:0@lo:400:kworker.0 00000100:00100000:3.0:1787826126.166563:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049276544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826126.166598:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826126.166642:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826126.166662:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049276544 00000100:00100000:3.0:1787826126.166667:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049276544 00000100:00100000:3.0:1787826126.166698:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787826126.166706:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049276544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826126.166749:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049276544:12345-0@lo:400:kworker.0 Request processed in 44us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826126.166755:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1787826126.166769:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826126.166786:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049276544:0@lo:400:kworker.0 00000100:00100000:0.0:1787826126.172142:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826126.172454:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049276672 00000100:00100000:3.0:1787826126.172464:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049276672 00000100:00100000:3.0:1787826126.172523:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:3.0:1787826126.172543:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1874663049276672:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787826126.172552:0:187905:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826126.172604:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1874663049276672:12345-0@lo:400:kworker.0 Request processed in 62us (468us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826126.172610:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00080000:0.0:1787826126.175605:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826126.175613:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826126.175618:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826126.175623:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826126.175627:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8146 00000100:00080000:0.0:1787826126.175636:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826126.175674:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4815e3b80 x1874663049277312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826126.175693:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049276672:0@lo:400:kworker.0 00000100:00100000:1.0:1787826126.176630:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826126.176677:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049277184:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787826126.176720:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826126.176749:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049277312:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787826126.176772:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826126.176816:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049277184 00000100:00100000:1.0:1787826126.176823:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049277184 00000100:00100000:1.0:1787826126.176855:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049277312 00000100:00100000:1.0:1787826126.176858:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049277312 00000100:00100000:1.0:1787826126.176876:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:1.0:1787826126.176883:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049277184:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787826126.176903:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826126.176965:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049277184:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 81us (243us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826126.176972:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:1.0:1787826126.176990:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1787826126.176994:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049277312:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1787826126.177005:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826126.177030:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049277312:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 34us (257us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826126.177036:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00080000:1.0:1787826126.177070:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826126.177074:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826126.177078:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049277184:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787826126.177086:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826126.177089:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826126.177092:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049277312:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787826126.178362:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049276928 00000100:00100000:0.0:1787826126.178372:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049276928 00000100:00100000:0.0:1787826126.178419:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12648 00000100:00100000:0.0:1787826126.178426:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049276928:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826126.178443:0:177390:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826126.178516:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049276928:12345-0@lo:38:kworker.0 Request processed in 89us (1888us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826126.178522:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12648 00000100:00080000:0.0:1787826126.178572:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826126.178577:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826126.178581:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049276928:0@lo:38:kworker.0 00000100:00100000:2.0:1787826126.182443:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826126.186035:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049276416 00000100:00100000:0.0:1787826126.186051:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049276416 00000100:00100000:0.0:1787826126.186125:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1787826126.186133:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1874663049276416:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787826126.186143:0:187904:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787826126.186231:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1874663049276416:12345-0@lo:400:kworker.0 Request processed in 97us (3796us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826126.186238:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00080000:2.0:1787826126.190644:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826126.190652:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826126.190656:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787826126.190661:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826126.190666:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8146 00000100:00080000:2.0:1787826126.190673:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826126.190708:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34ddd4a80 x1874663049277440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826126.190741:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049276416:0@lo:400:kworker.0 00000100:00100000:0.0:1787826126.191132:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049277440:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787826126.191197:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826126.191364:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049277440 00000100:00100000:1.0:1787826126.191372:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049277440 00000100:00100000:1.0:1787826126.191419:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:1.0:1787826126.191427:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049277440:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1787826126.191446:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826126.191488:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049277440:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 59us (290us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826126.191495:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00080000:0.0:1787826126.192082:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826126.192089:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826126.192093:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049277440:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787826126.677560:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787826127.192989:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826127.192997:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb343211000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787826127.193144:0:184693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826127.193148:0:184693:0:(genops.c:885:class_export_put()) final put ffff8eb47bfd0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826127.193179:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343211000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787826127.193276:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47bfd0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787826127.193294:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb34b9e1800 for lustre-OST0001 00000020:00000080:1.0:1787826127.193298:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47bfd2800 for lustre-OST0000 00000001:00100000:1.0:1787826127.193385:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787826127.193394:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869981 is committed 00000020:00000080:1.0:1787826127.193397:0:187942:0:(genops.c:885:class_export_put()) final put ffff8eb449082800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826127.193467:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb449082800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787826127.193533:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb348a3e000 for lustre-MDT0001 00010000:00010000:3.0:1787826127.700481:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826128.724828:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826129.748731:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826130.772687:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826130.772761:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049277568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826130.772831:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826130.773024:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049277568 00000100:00100000:3.0:1787826130.773033:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049277568 00000100:00100000:3.0:1787826130.773097:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5757 00000100:00100000:3.0:1787826130.773107:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049277568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826130.773139:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826130.773199:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049277568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826130.773206:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5757 00000100:00100000:3.0:1787826130.773251:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049277568:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787826130.773415:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826130.773564:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049277696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826130.773597:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826130.773681:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049277696 00000100:00100000:1.0:1787826130.773686:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049277696 00000100:00100000:1.0:1787826130.773740:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5758 00000100:00100000:1.0:1787826130.773748:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049277696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826130.773765:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826130.773804:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049277696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826130.773810:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5758 00000100:00080000:0.0:1787826130.773867:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826130.773938:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049277696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826131.196169:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000400:00000100:1.0:1787826131.196216:0:3611:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042969728 offset 0 length 224: 4 00000100:00100000:1.0:1787826131.196235:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826131.196274:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826131.196381:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042970240 00000100:00100000:2.0:1787826131.196390:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042970240 00000100:00100000:2.0:1787826131.196463:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22546 00000100:00100000:2.0:1787826131.196474:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2388:x1874663042970240:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:2.0:1787826131.196504:0:179225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceccc1 00000100:00080000:2.0:1787826131.196512:0:179225:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826131.196573:0:179225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975534 00000100:00100000:3.0:1787826131.196643:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042969984 00000100:00100000:3.0:1787826131.196648:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042969984 00000100:00100000:3.0:1787826131.196681:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042969856 00000100:00100000:3.0:1787826131.196684:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042969856 00000100:00100000:3.0:1787826131.196701:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 164 00000100:00100000:3.0:1787826131.196711:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042969984:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826131.196739:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+2:2388:x1874663042970240:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 265us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826131.196751:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22546 00000100:00100000:3.0:1787826131.196751:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042969984:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826131.196762:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 164 00010000:00010000:2.0:1787826131.196776:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826131.196781:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 947 00000100:00100000:3.0:1787826131.196787:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663042969856:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:3.0:1787826131.196807:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826131.196835:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663042969856:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 46us (598us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826131.196842:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 947 00000100:00080000:1.0:1787826131.197489:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826131.197494:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826131.197821:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826131.197900:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042970112 00000100:00100000:1.0:1787826131.197906:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042970112 00000100:00100000:1.0:1787826131.197967:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6979 00000100:00100000:1.0:1787826131.197978:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042970112:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826131.198032:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042970112:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826131.198039:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6979 00000100:00080000:0.0:1787826131.199391:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826131.285072:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826131.285079:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826131.285083:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826131.285091:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8193 00000100:00080000:2.0:1787826131.285097:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1787826131.285191:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049277824:0@lo:400:kworker.0 00000400:00000100:3.0:1787826131.285245:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049277824 offset 0 length 224: 4 00000100:00080000:2.0:1787826131.285397:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826131.285582:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342774700 x1874663049277952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826131.285628:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049277952:0@lo:38:kworker.0 00000100:00100000:0.0:1787826131.285664:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826131.285918:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049277952 00000100:00100000:3.0:1787826131.285926:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049277952 00000100:00100000:3.0:1787826131.285965:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1787826131.285973:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049277952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826131.285994:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1787826131.286089:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826131.286093:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826131.286095:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826131.286110:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8193 00000100:00080000:2.0:1787826131.286112:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826131.286117:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826131.286128:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342775500 x1874663049278208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826131.286163:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049278080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826131.286189:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826131.286227:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049278080 00000100:00100000:1.0:1787826131.286230:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049278080 00000100:00100000:1.0:1787826131.286265:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787826131.286270:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049278080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826131.286306:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049278080:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826131.286312:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787826131.286351:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826131.286376:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049278080:0@lo:400:kworker.0 00000100:00100000:0.0:1787826131.291472:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049278208:0@lo:38:kworker.0 00000100:00100000:0.0:1787826131.291650:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826131.291762:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049278208 00000100:00100000:1.0:1787826131.291772:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049278208 00000100:00100000:1.0:1787826131.291816:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1787826131.291823:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049278208:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826131.291847:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826131.291900:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049278208:12345-0@lo:38:kworker.0 Request processed in 66us (240us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826131.291908:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:3.0:1787826131.292016:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049277952:12345-0@lo:38:kworker.0 Request processed in 6041us (6350us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826131.292024:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00080000:2.0:1787826131.292164:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826131.292169:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826131.292172:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826131.292177:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8192 00000100:00080000:2.0:1787826131.292182:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826131.292188:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826131.292216:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342775f80 x1874663049278464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826131.292250:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826131.292253:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826131.292255:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826131.292258:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8192 00000100:00080000:2.0:1787826131.292261:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826131.292264:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826131.292276:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342775180 x1874663049278848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826131.292299:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826131.292308:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049278720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826131.292359:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826131.292598:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049278592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826131.292628:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826131.292677:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049278336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826131.292704:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826131.292733:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049278336 00000100:00100000:3.0:1787826131.292738:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049278336 00000100:00100000:3.0:1787826131.292775:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787826131.292783:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049278336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826131.292826:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049278336:12345-0@lo:400:kworker.0 Request processed in 44us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826131.292832:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787826131.292866:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049278336:0@lo:400:kworker.0 00000100:00080000:3.0:1787826131.292902:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826131.295399:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826131.295419:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826131.295424:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049277952:0@lo:38:kworker.0 00000100:00100000:0.0:1787826131.295452:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049278464:0@lo:38:kworker.0 00000100:00100000:0.0:1787826131.295509:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826131.295658:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049278848:0@lo:38:kworker.0 00000100:00100000:0.0:1787826131.295685:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826131.295710:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826131.295715:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826131.295718:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049278208:0@lo:38:kworker.0 00000100:00100000:2.0:1787826131.295811:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049278720 00000100:00100000:2.0:1787826131.295818:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049278720 00000100:00100000:1.0:1787826131.296633:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049278464 00000100:00100000:1.0:1787826131.296639:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049278464 00000100:00100000:1.0:1787826131.296676:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12649 00000100:00100000:1.0:1787826131.296683:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049278464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826131.296704:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826131.296756:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049278464:12345-0@lo:38:kworker.0 Request processed in 72us (1247us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826131.296763:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12649 00000100:00100000:1.0:1787826131.296791:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049278848 00000100:00100000:1.0:1787826131.296795:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049278848 00000100:00100000:1.0:1787826131.296816:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1787826131.296821:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049278848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826131.296832:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826131.296858:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049278848:12345-0@lo:38:kworker.0 Request processed in 35us (1171us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826131.296864:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00080000:0.0:1787826131.296959:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826131.296965:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826131.296969:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049278464:0@lo:38:kworker.0 00000100:00080000:0.0:1787826131.296979:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826131.296982:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826131.296985:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049278848:0@lo:38:kworker.0 00000100:00100000:3.0:1787826131.297070:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049278592 00000100:00100000:3.0:1787826131.297075:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049278592 00000100:00100000:3.0:1787826131.297188:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6980 00000100:00100000:3.0:1787826131.297206:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049278720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826131.297259:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049278720:12345-0@lo:400:kworker.0 Request processed in 64us (4899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826131.297265:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6980 00000100:00100000:3.0:1787826131.297278:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6981 00000100:00100000:3.0:1787826131.297284:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049278592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826131.297317:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049278592:12345-0@lo:400:kworker.0 Request processed in 33us (4688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826131.297336:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6981 00000100:00100000:3.0:1787826131.297369:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049278592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826131.297612:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049278720:0@lo:400:kworker.0 00010000:00010000:2.0:1787826131.798505:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826132.821178:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826133.847250:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826134.868519:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826135.894598:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826135.895651:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826135.895672:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049278976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826135.895740:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826135.895809:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049278976 00000100:00100000:0.0:1787826135.895816:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049278976 00000100:00100000:0.0:1787826135.895883:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5759 00000100:00100000:0.0:1787826135.895896:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049278976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826135.895924:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826135.895967:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049278976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826135.895974:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5759 00000100:00080000:0.0:1787826135.895997:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826135.896029:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049278976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826135.899026:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826135.899051:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049279104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826135.899121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826135.899179:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049279104 00000100:00100000:1.0:1787826135.899187:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049279104 00000100:00100000:1.0:1787826135.899245:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5760 00000100:00100000:1.0:1787826135.899254:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049279104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826135.899283:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826135.899345:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049279104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826135.899352:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5760 00000100:00080000:1.0:1787826135.899377:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826135.899423:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049279104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826136.322243:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000400:00000100:2.0:1787826136.322280:0:3612:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042970368 offset 0 length 224: 4 00000100:00100000:2.0:1787826136.322301:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826136.322397:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826136.322738:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042970752 00000100:00100000:0.0:1787826136.322748:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042970752 00000100:00100000:0.0:1787826136.322802:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6982 00000100:00100000:0.0:1787826136.322813:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042970752:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826136.322891:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042970752:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 80us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826136.322899:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6982 00000100:00100000:3.0:1787826136.323239:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042970624 00000100:00100000:3.0:1787826136.323244:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042970624 00000100:00100000:3.0:1787826136.323283:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042970496 00000100:00100000:3.0:1787826136.323287:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042970496 00000100:00100000:3.0:1787826136.323302:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 167 00000100:00100000:3.0:1787826136.323310:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042970624:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826136.323367:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042970624:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 58us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826136.323386:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 167 00000100:00100000:3.0:1787826136.323401:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 951 00000100:00100000:3.0:1787826136.323406:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042970496:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:3.0:1787826136.323426:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826136.323452:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042970496:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 44us (1055us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826136.323469:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 951 00000100:00080000:2.0:1787826136.324490:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826136.324497:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826136.404608:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049279232:0@lo:400:kworker.0 00000400:00000100:1.0:1787826136.404661:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049279232 offset 0 length 224: 4 00000100:00080000:2.0:1787826136.404728:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826136.404733:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826136.404735:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826136.404740:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8198 00000100:00080000:2.0:1787826136.404745:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826136.404751:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826136.404772:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342775500 x1874663049279360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826136.404804:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826136.404807:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826136.404809:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826136.404812:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8198 00000100:00080000:2.0:1787826136.404814:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826136.404818:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826136.404827:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342774380 x1874663049279616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826136.404839:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826136.404842:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826136.404843:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826136.404846:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8198 00000100:00080000:2.0:1787826136.404847:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826136.404850:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826136.404873:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47f997b80 x1874663049279872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826136.405603:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049280000:0@lo:400:kworker.0 00000100:00100000:0.0:1787826136.405650:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826136.405755:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049280000 00000100:00100000:0.0:1787826136.405763:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049280000 00000100:00100000:0.0:1787826136.405805:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6983 00000100:00100000:0.0:1787826136.405814:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049280000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826136.405881:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049280000:12345-0@lo:400:kworker.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826136.405888:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6983 00000100:00100000:0.0:1787826136.405930:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049280000:0@lo:400:kworker.0 00000100:00080000:2.0:1787826136.409208:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826136.409215:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826136.409218:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826136.409225:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8198 00000100:00080000:2.0:1787826136.409231:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826136.409237:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826136.409257:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47f995500 x1874663049280256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826136.409296:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049279360:0@lo:38:kworker.0 00000100:00100000:1.0:1787826136.409520:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049280128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826136.409556:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826136.409606:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049280128 00000100:00100000:1.0:1787826136.409613:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049280128 00000100:00100000:1.0:1787826136.409655:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6984 00000100:00100000:1.0:1787826136.409664:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049280128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826136.409716:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049280128:12345-0@lo:400:kworker.0 Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826136.409723:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6984 00000100:00100000:1.0:1787826136.409767:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049280128:0@lo:400:kworker.0 00000100:00100000:2.0:1787826136.409872:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826136.409902:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049279616:0@lo:38:kworker.0 00000100:00100000:2.0:1787826136.409929:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826136.409947:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049279872:0@lo:38:kworker.0 00000100:00100000:2.0:1787826136.409970:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826136.409987:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049280256:0@lo:38:kworker.0 00000100:00100000:2.0:1787826136.410008:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826136.410036:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049279488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826136.410061:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826136.410081:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826136.410087:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049279744:0@lo:400:kworker.0 00000100:00100000:2.0:1787826136.410108:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826136.410157:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049279360 00000100:00100000:2.0:1787826136.410161:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049279360 00000100:00100000:2.0:1787826136.410177:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049279616 00000100:00100000:2.0:1787826136.410180:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049279616 00000100:00100000:2.0:1787826136.410187:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049280256 00000100:00100000:2.0:1787826136.410190:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049280256 00000100:00100000:2.0:1787826136.410197:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049279488 00000100:00100000:2.0:1787826136.410199:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049279488 00000100:00100000:2.0:1787826136.410224:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049279744 00000100:00100000:2.0:1787826136.410227:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049279744 00000100:00100000:2.0:1787826136.410241:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787826136.410247:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049279488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826136.410283:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049279488:12345-0@lo:400:kworker.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826136.410289:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787826136.410302:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787826136.410308:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049279744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826136.410371:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049279744:12345-0@lo:400:kworker.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826136.410378:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787826136.410391:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1787826136.410396:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049279360:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826136.410412:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826136.410443:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049279360:12345-0@lo:38:kworker.0 Request processed in 46us (571us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826136.410449:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1787826136.410460:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1787826136.410464:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049279616:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787826136.410763:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1787826136.410769:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049280256:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826136.410779:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826136.410810:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049280256:12345-0@lo:38:kworker.0 Request processed in 40us (801us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826136.410815:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1787826136.410833:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049279872 00000100:00100000:1.0:1787826136.410837:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049279872 00010000:00020000:2.0:1787826136.410942:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826136.410972:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049279616:12345-0@lo:38:kworker.0 Request processed in 506us (1042us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826136.410979:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00080000:2.0:1787826136.411000:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826136.411025:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049279744:0@lo:400:kworker.0 00000100:00100000:2.0:1787826136.411037:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049279488:0@lo:400:kworker.0 00000100:00080000:2.0:1787826136.411067:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826136.411073:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826136.411076:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049279360:0@lo:38:kworker.0 00000100:00080000:2.0:1787826136.411083:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826136.411086:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826136.411089:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049279616:0@lo:38:kworker.0 00000100:00080000:2.0:1787826136.411097:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826136.411100:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826136.411103:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049280256:0@lo:38:kworker.0 00000100:00100000:1.0:1787826136.411162:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12650 00000100:00100000:1.0:1787826136.411167:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049279872:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826136.411178:0:8415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826136.411220:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049279872:12345-0@lo:38:kworker.0 Request processed in 51us (1248us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826136.411226:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12650 00000100:00080000:2.0:1787826136.411283:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826136.411287:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826136.411290:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049279872:0@lo:38:kworker.0 00010000:00010000:2.0:1787826136.918296:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787826136.919111:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:0.0:1787826136.919117:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb47f9a1800/a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:3.0:1787826136.919176:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f9a1800/a9ce6693-0634-46c5-bf21-5ca7d026d44e for lustre-OST0001 00000020:00000080:3.0:1787826136.919218:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f9a3000 for lustre-OST0001 00010000:00010000:2.0:1787826137.951466:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826138.969860:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826139.988538:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826141.013664:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049280384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826141.013732:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826141.013918:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049280384 00000100:00100000:0.0:1787826141.013936:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049280384 00000100:00100000:0.0:1787826141.013999:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5761 00000100:00100000:0.0:1787826141.014010:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049280384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826141.014039:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826141.015513:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049280512:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787826141.016886:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826141.016905:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826141.017964:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049280384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3948us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826141.017978:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5761 00000100:00100000:1.0:1787826141.018063:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049280384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826141.025486:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826141.025913:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049280512 00000100:00100000:1.0:1787826141.025924:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049280512 00000100:00100000:1.0:1787826141.025995:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5762 00000100:00100000:1.0:1787826141.026005:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049280512:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787826141.026024:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787826141.026039:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826141.026099:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049280512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826141.026106:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5762 00000100:00100000:3.0:1787826141.026322:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049280512:0@lo:13:osp-pre-0-1.0 00000400:00000100:0.0:1787826141.437864:0:3612:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042970880 offset 0 length 224: 4 00000100:00100000:0.0:1787826141.437915:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826141.437941:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826141.438012:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826141.438042:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042971008 00000100:00100000:0.0:1787826141.438051:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042971008 00000100:00100000:0.0:1787826141.438087:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042971136 00000100:00100000:0.0:1787826141.438089:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042971136 00000100:00100000:0.0:1787826141.438127:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 170 00000100:00100000:0.0:1787826141.438137:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042971136:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826141.438209:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042971136:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826141.438219:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 170 00000100:00100000:0.0:1787826141.438238:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 955 00000100:00100000:0.0:1787826141.438243:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042971008:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:0.0:1787826141.438262:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826141.438285:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042971008:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 41us (371us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826141.438292:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 955 00000100:00100000:0.0:1787826141.438309:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042971264 00000100:00100000:0.0:1787826141.438312:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042971264 00000100:00100000:0.0:1787826141.438356:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6985 00000100:00100000:0.0:1787826141.438363:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042971264:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826141.438389:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042971264:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826141.438395:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6985 00000100:00080000:0.0:1787826141.438414:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826141.438418:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826141.532789:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826141.532796:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826141.532800:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826141.532808:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8203 00000100:00080000:1.0:1787826141.532814:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787826141.532830:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826141.532852:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348ffe680 x1874663049280768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826141.532873:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826141.532876:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826141.532877:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826141.532880:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8203 00000100:00080000:1.0:1787826141.532883:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787826141.532886:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826141.532896:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348ffe300 x1874663049281024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826141.532934:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826141.532938:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826141.532939:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826141.532942:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8203 00000100:00080000:1.0:1787826141.532945:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826141.532948:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826141.532961:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348fff480 x1874663049281280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826141.532982:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826141.532985:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826141.532987:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826141.532991:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8203 00000100:00080000:1.0:1787826141.532993:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787826141.532997:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826141.533006:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348ffce00 x1874663049281664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826141.533146:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049280896:0@lo:400:kworker.0 00000100:00100000:1.0:1787826141.533211:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826141.533265:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787826141.533272:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049280640:0@lo:400:kworker.0 00000400:00000100:1.0:1787826141.533293:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049280640 offset 0 length 224: 4 00000100:00100000:1.0:1787826141.533312:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049281536:0@lo:400:kworker.0 00000100:00100000:1.0:1787826141.533360:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826141.533390:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049281152:0@lo:400:kworker.0 00000100:00100000:1.0:1787826141.533413:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826141.533435:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826141.533574:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049280768:0@lo:38:kworker.0 00000100:00100000:2.0:1787826141.533604:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826141.533624:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049281024:0@lo:38:kworker.0 00000100:00100000:2.0:1787826141.533643:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826141.533660:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049281280:0@lo:38:kworker.0 00000100:00100000:2.0:1787826141.533680:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826141.533697:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049281664:0@lo:38:kworker.0 00000100:00100000:2.0:1787826141.533719:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826141.533750:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049280896 00000100:00100000:2.0:1787826141.533757:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049280896 00000100:00100000:2.0:1787826141.533801:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049281152 00000100:00100000:2.0:1787826141.533804:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049281152 00000100:00100000:2.0:1787826141.533827:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049280768 00000100:00100000:2.0:1787826141.533830:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049280768 00000100:00100000:2.0:1787826141.533840:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049281024 00000100:00100000:2.0:1787826141.533842:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049281024 00000100:00100000:2.0:1787826141.533847:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049281664 00000100:00100000:2.0:1787826141.533849:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049281664 00000100:00100000:2.0:1787826141.533859:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787826141.533867:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049280896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826141.533918:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049280896:12345-0@lo:400:kworker.0 Request processed in 52us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826141.533924:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787826141.533940:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787826141.533946:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049281152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826141.533972:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049281152:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826141.533978:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787826141.533989:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1787826141.533992:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049280768:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826141.534009:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826141.534043:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049280768:12345-0@lo:38:kworker.0 Request processed in 49us (438us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826141.534050:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1787826141.534063:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1787826141.534066:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049281024:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826141.534074:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826141.534097:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049281024:12345-0@lo:38:kworker.0 Request processed in 28us (452us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826141.534102:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1787826141.534112:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1787826141.534116:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049281664:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826141.534125:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826141.534147:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049281664:12345-0@lo:38:kworker.0 Request processed in 29us (428us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826141.534153:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1787826141.534181:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049281280 00000100:00100000:2.0:1787826141.534186:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049281280 00000100:00100000:2.0:1787826141.534208:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12651 00000100:00100000:2.0:1787826141.534212:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049281280:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826141.534221:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826141.534245:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049281280:12345-0@lo:38:kworker.0 Request processed in 31us (564us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826141.534251:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12651 00000100:00080000:2.0:1787826141.534270:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826141.534299:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049280896:0@lo:400:kworker.0 00000100:00080000:2.0:1787826141.534348:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826141.534353:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826141.534356:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049280768:0@lo:38:kworker.0 00000100:00080000:2.0:1787826141.534366:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826141.534370:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826141.534373:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049281024:0@lo:38:kworker.0 00000100:00080000:2.0:1787826141.534380:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826141.534383:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826141.534386:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049281280:0@lo:38:kworker.0 00000100:00080000:2.0:1787826141.534393:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826141.534396:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826141.534399:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049281664:0@lo:38:kworker.0 00000100:00100000:3.0:1787826141.534675:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049281536 00000100:00100000:3.0:1787826141.534679:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049281536 00000100:00100000:3.0:1787826141.534716:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6986 00000100:00100000:3.0:1787826141.534723:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049281536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826141.534764:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049281536:12345-0@lo:400:kworker.0 Request processed in 42us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826141.534770:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6986 00000100:00100000:1.0:1787826141.534919:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049281408:0@lo:400:kworker.0 00000100:00100000:1.0:1787826141.534952:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826141.534982:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049281152:0@lo:400:kworker.0 00000100:00100000:3.0:1787826141.535675:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049281408 00000100:00100000:3.0:1787826141.535681:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049281408 00000100:00100000:3.0:1787826141.535714:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6987 00000100:00100000:3.0:1787826141.535721:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049281408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826141.535769:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049281408:12345-0@lo:400:kworker.0 Request processed in 49us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826141.535775:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6987 00000100:00100000:3.0:1787826141.535805:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049281408:0@lo:400:kworker.0 00000100:00100000:2.0:1787826141.536133:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049281536:0@lo:400:kworker.0 00010000:00010000:2.0:1787826142.037198:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1787826142.409068:0:3611:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042971392 offset 0 length 520: 4 00000100:00100000:3.0:1787826142.409110:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826142.409149:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826142.409446:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042971648 00000100:00100000:2.0:1787826142.409457:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042971648 00000100:00100000:2.0:1787826142.409516:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 173 00000100:00100000:2.0:1787826142.409526:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042971648:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826142.409597:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042971648:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 73us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826142.409605:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 173 00000100:00100000:0.0:1787826142.409717:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042971776 00000100:00100000:0.0:1787826142.409722:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042971776 00000100:00100000:0.0:1787826142.409762:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6988 00000100:00100000:0.0:1787826142.409769:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042971776:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826142.409798:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042971776:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826142.409805:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6988 00000100:00100000:0.0:1787826142.410571:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826142.411067:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042971520 00000100:00100000:2.0:1787826142.411074:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042971520 00000100:00100000:2.0:1787826142.411184:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 959 00000100:00100000:2.0:1787826142.411192:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042971520:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:2.0:1787826142.411217:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826142.411285:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042971520:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 92us (717us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826142.411292:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 959 00000100:00000400:3.0:1787826142.550185:0:3619:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826126/real 1787826126] req@ffff8eb34df15c00 x1874663049276288/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826142 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826142.550215:0:3619:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8eb34df15c00 x1874663049276288/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826142.550224:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787826142.550228:0:3619:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787826142.550231:0:3619:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.147@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787826142.550232:0:3619:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787826142.550235:0:3619:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb34df15c00 x1874663049276288/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826142.550241:0:3619:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb342776680 x1874663049277824/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826147 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826142.550245:0:3619:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb342775f80 x1874663049279232/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826152 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826142.550256:0:3619:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb348ffc000 x1874663049280640/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826157 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787826142.550261:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787826142.550263:0:3619:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787826142.550264:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787826142.550265:0:3619:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1787826142.550284:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049277824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.550288:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049276288:0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.550318:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049280640:0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.550336:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049279232:0@lo:400:kworker.0 00000100:00080000:3.0:1787826142.550369:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826142.550373:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787826142.550374:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826142.550378:0:172937:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8141 00000100:00080000:3.0:1787826142.550383:0:172937:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826142.550403:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34df15c00 x1874663049281792/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826142.550416:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826142.550418:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826142.550419:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826142.550421:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8208 00000100:00080000:3.0:1787826142.550423:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826142.550425:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826142.550444:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448cd5f80 x1874663049281920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826142.550460:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826142.550462:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826142.550463:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826142.550465:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8208 00000100:00080000:3.0:1787826142.550466:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826142.550468:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826142.550473:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448cd6a00 x1874663049282176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826142.550490:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826142.550492:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826142.550493:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826142.550496:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8208 00000100:00080000:3.0:1787826142.550497:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826142.550499:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826142.550505:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46e80ed80 x1874663049282432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826142.550517:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826142.550519:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826142.550520:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826142.550522:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8208 00000100:00080000:3.0:1787826142.550524:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826142.550527:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826142.550535:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46e80d500 x1874663049282816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826142.550561:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049281792:0@lo:250:kworker.0 00000400:00000100:3.0:1787826142.550602:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049281792 offset 0 length 520: 4 00000100:00100000:3.0:1787826142.550638:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049281920:0@lo:38:kworker.0 00000100:00100000:3.0:1787826142.550668:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826142.550687:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049282176:0@lo:38:kworker.0 00000100:00100000:3.0:1787826142.550706:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826142.550723:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049282432:0@lo:38:kworker.0 00000100:00100000:3.0:1787826142.550745:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826142.550763:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049282816:0@lo:38:kworker.0 00000100:00100000:3.0:1787826142.550787:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826142.550824:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049282688:0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.550852:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826142.551034:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049281920 00000100:00100000:1.0:1787826142.551042:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049281920 00000100:00100000:1.0:1787826142.551084:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049282176 00000100:00100000:1.0:1787826142.551087:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049282176 00000100:00100000:1.0:1787826142.551101:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049282816 00000100:00100000:1.0:1787826142.551103:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049282816 00000100:00100000:1.0:1787826142.551114:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1787826142.551121:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049281920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826142.551141:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826142.551204:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1787826142.551209:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049282176:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826142.551217:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826142.551759:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049281920:12345-0@lo:38:kworker.0 Request processed in 635us (1088us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826142.551768:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1787826142.551788:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1787826142.551792:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049282816:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826142.551802:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826142.551841:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049282816:12345-0@lo:38:kworker.0 Request processed in 47us (1053us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826142.551847:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00080000:1.0:1787826142.551893:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826142.551898:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826142.551901:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049281920:0@lo:38:kworker.0 00000100:00080000:1.0:1787826142.551911:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826142.551914:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826142.551916:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049282816:0@lo:38:kworker.0 00000100:00100000:1.0:1787826142.552234:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049282176:12345-0@lo:38:kworker.0 Request processed in 1022us (1525us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826142.552242:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00080000:0.0:1787826142.552513:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826142.552518:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826142.552521:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049282176:0@lo:38:kworker.0 00000100:00100000:3.0:1787826142.552923:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826142.552936:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049282048:0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.552977:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826142.553015:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049282560:0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.553043:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826142.553069:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826142.553072:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049282048 00000100:00100000:3.0:1787826142.553074:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049282304:0@lo:400:kworker.0 00000100:00100000:1.0:1787826142.553078:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049282048 00000100:00100000:3.0:1787826142.553096:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826142.553143:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049282688 00000100:00100000:2.0:1787826142.553147:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049282688 00000100:00100000:1.0:1787826142.553194:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049282304 00000100:00100000:1.0:1787826142.553197:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049282304 00000100:00100000:1.0:1787826142.553211:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787826142.553211:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049282560 00000100:00100000:2.0:1787826142.553214:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049282560 00000100:00100000:1.0:1787826142.553218:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049282048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826142.553229:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6989 00000100:00100000:2.0:1787826142.553234:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049282688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826142.553268:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049282048:12345-0@lo:400:kworker.0 Request processed in 50us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826142.553275:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787826142.553290:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787826142.553295:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049282304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.553304:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049282432 00000100:00100000:3.0:1787826142.553308:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049282432 00000100:00100000:1.0:1787826142.553345:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049282304:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826142.553345:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12652 00000100:00100000:3.0:1787826142.553349:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049282432:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787826142.553351:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00020000:3.0:1787826142.553365:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826142.553400:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049282432:12345-0@lo:38:kworker.0 Request processed in 49us (2654us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826142.553405:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12652 00000100:00100000:3.0:1787826142.553427:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6990 00000100:00100000:3.0:1787826142.553443:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049282560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.553469:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049282560:12345-0@lo:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826142.553476:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6990 00000100:00100000:3.0:1787826142.553687:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049282304:0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.553698:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049282560:0@lo:400:kworker.0 00000100:00080000:3.0:1787826142.553770:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826142.553775:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826142.553778:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049282432:0@lo:38:kworker.0 00000100:00100000:1.0:1787826142.554106:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049282048:0@lo:400:kworker.0 00000100:00100000:3.0:1787826142.554265:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049282688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826142.557515:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049282688:12345-0@lo:400:kworker.0 Request processed in 4269us (6650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826142.557529:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6989 00010000:00010000:1.0:1787826143.064518:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826143.874600:0:192353:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787826143.874606:0:192353:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787826143.874607:0:192353:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787826143.874788:0:192353:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8eb4727dc000 00000020:01000004:2.0:1787826143.874816:0:192353:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787826143.874831:0:192353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787826143.874846:0:192353:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8eb341a6b370) 00000020:00000080:2.0:1787826143.874864:0:192353:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787826143.996512:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787826143.998133:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787826143.999217:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787826144.000086:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787826144.000292:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787826144.000529:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787826144.000771:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787826144.001190:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787826144.001541:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787826144.002054:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787826144.002298:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787826144.002678:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787826144.002951:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787826144.003136:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787826144.009764:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787826144.013692:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787826144.013998:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787826144.014236:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787826144.014505:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787826144.014768:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787826144.015037:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787826144.015230:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787826144.015481:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787826144.015795:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787826144.016854:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787826144.018006:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787826144.018871:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787826144.019169:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787826144.019379:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787826144.020511:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787826144.020984:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787826144.021244:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787826144.021549:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787826144.021832:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787826144.022123:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787826144.022559:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787826144.029014:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787826144.029887:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787826144.030514:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787826144.030756:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787826144.032932:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787826144.033469:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787826144.033748:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787826144.034052:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787826144.034415:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787826144.034661:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787826144.034924:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787826144.038747:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787826144.039776:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1787826144.040103:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787826144.041285:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1787826144.041824:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787826144.042134:0:192353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1787826144.050052:0:192353:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787826144.052988:0:192353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787826144.052999:0:192353:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787826144.053013:0:192353:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecf76 00000020:01000004:0.0:1787826144.053020:0:192353:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787826144.053032:0:192353:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787826144.053037:0:192353:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb4727dc000 from MGS 00000020:01000004:0.0:1787826144.053041:0:192353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787826144.053054:0:192353:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8eb46a8719b8) 00000020:00000080:0.0:1787826144.053066:0:192353:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787826144.053302:0:192353:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb4727dc000 from MGS, refs=2 00080000:01000000:0.0:1787826144.053308:0:192353:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787826144.053314:0:192353:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecf84 00010000:00010000:0.0:1787826144.053700:0:192353:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1787826144.066306:0:192353:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787826144.067493:0:192357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787826144.070622:0:192353:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787826144.070699:0:192353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787826144.071621:0:192353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787826144.071886:0:192353:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787826144.072052:0:192353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787826144.072059:0:192353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787826144.081955:0:192353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787826144.081969:0:192353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:2.0:1787826144.085557:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826144.088002:0:192353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787826144.088022:0:192353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787826144.088782:0:192353:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787826144.088820:0:192353:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1787826144.088822:0:192353:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1787826144.088825:0:192353:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1787826144.088832:0:192353:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 363, was 0): CONNECTING 00000100:00100000:2.0:1787826144.088838:0:192353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:2.0:1787826145.112085:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826146.132855:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826146.133606:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049283072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826146.133671:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826146.133805:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049283072 00000100:00100000:0.0:1787826146.133814:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049283072 00000100:00100000:0.0:1787826146.134099:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5763 00000100:00100000:0.0:1787826146.134110:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049283072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826146.134139:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826146.134185:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049283072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826146.134192:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5763 00000100:00100000:0.0:1787826146.134385:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049283072:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787826146.134558:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826146.134938:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049282944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826146.134977:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826146.135063:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049282944 00000100:00100000:0.0:1787826146.135070:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049282944 00000100:00100000:0.0:1787826146.135118:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5764 00000100:00100000:0.0:1787826146.135129:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049282944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826146.135149:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826146.135196:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049282944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826146.135203:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5764 00000100:00080000:2.0:1787826146.135404:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826146.135479:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049282944:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826147.158482:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826147.581264:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826147.581516:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826147.581554:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826147.581607:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042972160 00000100:00100000:2.0:1787826147.581617:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042972160 00000100:00100000:2.0:1787826147.581693:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6991 00000100:00100000:2.0:1787826147.581703:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042972160:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826147.581786:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042972160:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826147.581794:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6991 00000100:00080000:1.0:1787826147.582609:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826147.589388:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042972032 00000100:00100000:3.0:1787826147.589403:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042972032 00000100:00100000:2.0:1787826147.589770:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042971904 00000100:00100000:2.0:1787826147.589784:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042971904 00000100:00100000:2.0:1787826147.589811:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 176 00000100:00100000:2.0:1787826147.589825:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042972032:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826147.589910:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042972032:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 89us (8656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826147.589918:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 176 00000100:00100000:2.0:1787826147.589938:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 963 00000100:00100000:2.0:1787826147.589943:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042971904:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:2.0:1787826147.589964:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826147.589988:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042971904:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 44us (8434us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826147.589993:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 963 00000100:00080000:0.0:1787826147.594722:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826147.669284:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826147.669294:0:172937:0:(pinger.c:247:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787826147.669297:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826147.669301:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826147.669305:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826147.669314:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8209 00000100:00080000:0.0:1787826147.669319:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826147.669355:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826147.669399:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69c700 x1874663049283200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826147.669444:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826147.669457:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826147.669459:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826147.669462:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8209 00000100:00080000:0.0:1787826147.669466:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826147.669470:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826147.669487:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448d17b80 x1874663049283456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826147.669509:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826147.669513:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826147.669514:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826147.669518:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8209 00000100:00080000:0.0:1787826147.669520:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826147.669524:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826147.669536:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f747800 x1874663049283712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826147.669556:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826147.669559:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826147.669561:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826147.669564:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8209 00000100:00080000:0.0:1787826147.669566:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826147.669569:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826147.669579:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f745500 x1874663049284096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826147.669639:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049283968:0@lo:400:kworker.0 00000100:00100000:0.0:1787826147.669705:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826147.669772:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826147.669789:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049283328:0@lo:400:kworker.0 00000100:00100000:0.0:1787826147.669821:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826147.669856:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049283968 00000100:00100000:0.0:1787826147.669863:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049283968 00000100:00100000:0.0:1787826147.669905:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6992 00000100:00100000:0.0:1787826147.669915:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049283968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826147.669979:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049283968:12345-0@lo:400:kworker.0 Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826147.669987:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6992 00000100:00100000:0.0:1787826147.670014:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049283328 00000100:00100000:0.0:1787826147.670018:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049283328 00000100:00100000:0.0:1787826147.670053:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787826147.670060:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049283328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826147.670091:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049283328:12345-0@lo:400:kworker.0 Request processed in 32us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826147.670098:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1787826147.670114:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826147.670142:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049283328:0@lo:400:kworker.0 00000100:00100000:0.0:1787826147.670154:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049283968:0@lo:400:kworker.0 00000100:00100000:3.0:1787826147.671160:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049283584:0@lo:400:kworker.0 00000100:00100000:3.0:1787826147.671210:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826147.671259:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826147.671266:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049283840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826147.671293:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826147.671352:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049283840 00000100:00100000:3.0:1787826147.671358:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049283840 00000100:00100000:3.0:1787826147.671394:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6993 00000100:00100000:3.0:1787826147.671402:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049283840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826147.671444:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049283840:12345-0@lo:400:kworker.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826147.671463:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6993 00000100:00100000:3.0:1787826147.671504:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049283840:0@lo:400:kworker.0 00000100:00100000:0.0:1787826147.671621:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049283584 00000100:00100000:0.0:1787826147.671625:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049283584 00000100:00100000:0.0:1787826147.671671:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787826147.671678:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049283584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826147.671714:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049283584:12345-0@lo:400:kworker.0 Request processed in 37us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826147.671721:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787826147.672442:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049283200:0@lo:38:kworker.0 00000100:00100000:1.0:1787826147.672495:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826147.672540:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049283456:0@lo:38:kworker.0 00000100:00100000:1.0:1787826147.672562:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826147.672591:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049283712:0@lo:38:kworker.0 00000100:00100000:1.0:1787826147.672616:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826147.672654:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049284096:0@lo:38:kworker.0 00000100:00100000:1.0:1787826147.672677:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826147.672713:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049283712 00000100:00100000:1.0:1787826147.672718:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049283712 00000100:00100000:1.0:1787826147.672741:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12653 00000100:00100000:1.0:1787826147.672747:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049283712:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826147.672768:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826147.672818:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049283712:12345-0@lo:38:kworker.0 Request processed in 70us (200us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826147.672826:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12653 00000100:00100000:1.0:1787826147.672846:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049283200 00000100:00100000:1.0:1787826147.672849:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049283200 00000100:00100000:1.0:1787826147.672864:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049283456 00000100:00100000:1.0:1787826147.672867:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049283456 00000100:00100000:1.0:1787826147.672874:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049284096 00000100:00100000:1.0:1787826147.672877:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049284096 00000100:00100000:1.0:1787826147.672886:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1787826147.672891:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049283200:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826147.672901:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826147.672926:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049283200:12345-0@lo:38:kworker.0 Request processed in 33us (430us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826147.672932:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1787826147.672942:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1787826147.672946:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049283456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826147.672955:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826147.672978:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049283456:12345-0@lo:38:kworker.0 Request processed in 31us (415us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826147.672983:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1787826147.672994:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1787826147.672998:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049284096:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826147.673007:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826147.673029:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049284096:12345-0@lo:38:kworker.0 Request processed in 30us (352us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826147.673034:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00080000:1.0:1787826147.673062:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826147.673067:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826147.673070:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049283200:0@lo:38:kworker.0 00000100:00080000:1.0:1787826147.673082:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826147.673085:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826147.673088:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049283456:0@lo:38:kworker.0 00000100:00080000:1.0:1787826147.673095:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826147.673098:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826147.673100:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049283712:0@lo:38:kworker.0 00000100:00080000:1.0:1787826147.673107:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826147.673109:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826147.673112:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049284096:0@lo:38:kworker.0 00000100:00080000:3.0:1787826147.674510:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826147.674565:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049283584:0@lo:400:kworker.0 00010000:00010000:2.0:1787826148.181399:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826149.204719:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826150.228812:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826151.252490:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826151.253266:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826151.253287:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049284352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826151.253341:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049284224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826151.253379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826151.253415:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049284352 00000100:00100000:3.0:1787826151.253424:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049284352 00000100:00100000:3.0:1787826151.253492:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5765 00000100:00100000:3.0:1787826151.253502:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049284352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826151.253535:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 3923492864 avail 3691970560 00000100:00080000:1.0:1787826151.253589:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826151.255665:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049284352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2155us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826151.255680:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5765 00000100:00100000:0.0:1787826151.258921:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826151.259897:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049284352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826151.261141:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049284224 00000100:00100000:3.0:1787826151.261150:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049284224 00000100:00080000:1.0:1787826151.261267:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826151.261305:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5766 00000100:00100000:3.0:1787826151.261315:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049284224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826151.261417:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826151.261547:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049284224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 234us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826151.261554:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5766 00000100:00100000:1.0:1787826151.261761:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049284224:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787826152.277515:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826152.698554:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826152.698621:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826152.698730:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042972544 00000100:00100000:3.0:1787826152.698758:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042972544 00000100:00100000:0.0:1787826152.698830:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042972416 00000100:00100000:0.0:1787826152.698842:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042972416 00000100:00100000:3.0:1787826152.698897:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6994 00000100:00100000:3.0:1787826152.698922:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042972544:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826152.698935:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 179 00000100:00100000:0.0:1787826152.698953:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042972416:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826152.699052:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042972544:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 139us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826152.699063:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6994 00000100:00080000:2.0:1787826152.699716:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826152.699724:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826152.701283:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042972416:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 2326us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.701298:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 179 00000100:00100000:3.0:1787826152.705482:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826152.705613:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826152.705749:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042972672 00000100:00100000:1.0:1787826152.705765:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042972672 00000100:00100000:1.0:1787826152.705825:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:1.0:1787826152.705833:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2388:x1874663042972672:12345-192.168.203.47@tcp:250:kworker.0 00010000:00080000:1.0:1787826152.705861:0:192359:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7528148b-9bee-4d31-b597-8aae3b0b4982@192.168.203.47@tcp t0 exp 0000000000000000 cur 8219 last 0 00000020:00000080:1.0:1787826152.705889:0:192359:0:(genops.c:1385:class_connect()) connect: client 7528148b-9bee-4d31-b597-8aae3b0b4982, cookie 0x878a5eea00cecf8b 00000100:00080000:1.0:1787826152.706023:0:192359:0:(import.c:65:import_set_state_nolock()) ffff8eb343644800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826152.706210:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042972288 00000100:00100000:0.0:1787826152.706215:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042972288 00000100:00100000:0.0:1787826152.706248:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 967 00000100:00100000:0.0:1787826152.706254:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042972288:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:0.0:1787826152.706271:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826152.713316:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+5:2388:x1874663042972672:12345-192.168.203.47@tcp:250:kworker.0 Request processed in 7467us (7687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826152.713345:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:0.0:1787826152.714086:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042972288:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 7827us (8617us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826152.714106:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 967 00000100:00100000:1.0:1787826152.790242:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826142/real 1787826142] req@ffff8eb34df15c00 x1874663049281792/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826152 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826152.790282:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8eb34df15c00 x1874663049281792/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826152 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826152.790303:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826152.790366:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787826152.790383:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049281792:0@lo:250:kworker.0 10000000:01000000:3.0:1787826152.790428:0:192353:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1787826152.790457:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecc35 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790471:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecc35 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790479:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1787826152.790507:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790522:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e800/0x878a5eea00cecc2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecc35 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790557:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecb94 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790565:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecb94 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790571:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826152.790575:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790581:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb4724ed800/0x878a5eea00cecb8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecb94 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790590:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecbb0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826152.790594:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:3.0:1787826152.790598:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecbb0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826152.790602:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787826152.790608:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 10000000:01000000:3.0:1787826152.790614:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:0.0:1787826152.790619:0:172937:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8209 00000100:00080000:0.0:1787826152.790626:0:172937:0:(import.c:589:import_select_connection()) MGC192.168.203.147@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826152.790635:0:172937:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826152.790670:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f747800 x1874663049284480/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1787826152.790682:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790692:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb4724ece00/0x878a5eea00cecba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecbb0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826152.790696:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826152.790708:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826152.790711:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:3.0:1787826152.790711:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecbda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826152.790723:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8214 00000100:00080000:0.0:1787826152.790731:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 10000000:00010000:3.0:1787826152.790737:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecbda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826152.790750:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 10000000:01000000:3.0:1787826152.790768:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826152.790773:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:0.0:1787826152.790774:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f747100 x1874663049284608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1787826152.790779:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ec00/0x878a5eea00cecbd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecbda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790791:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecbef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790802:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecbef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790807:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826152.790810:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790814:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb479b3f400/0x878a5eea00cecbe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecbef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790824:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecc0b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790830:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecc0b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790835:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826152.790838:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790841:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19800/0x878a5eea00cecc04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecc0b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790849:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecc19 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790859:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecc19 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790864:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826152.790867:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790869:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18200/0x878a5eea00cecc12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecc19 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790878:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecc43 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790884:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecc43 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790889:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826152.790892:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790895:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb479b3e400/0x878a5eea00cecc3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecc43 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790907:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecba2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790913:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecba2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790918:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826152.790921:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790924:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec600/0x878a5eea00cecb9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecba2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790939:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecbbe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790945:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecbbe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790949:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826152.790952:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790955:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb479b3ee00/0x878a5eea00cecbb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecbbe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790966:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecbcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.790973:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecbcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.790979:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787826152.790982:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.790986:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb4724ec800/0x878a5eea00cecbc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecbcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.790995:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecbfd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.791095:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecbfd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.791101:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787826152.791106:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.791111:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39e00/0x878a5eea00cecbf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecbfd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.791121:0:192353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cecc27 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826152.791127:0:192353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cecc27 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.791133:0:192353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787826152.791136:0:192353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787826152.791138:0:192353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19a00/0x878a5eea00cecc20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cecc27 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826152.791157:0:192353:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 364, was 0): CONNECTING 00000100:00080000:3.0:1787826152.791164:0:192353:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1787826152.791296:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049284480:0@lo:250:kworker.0 00000100:00100000:1.0:1787826152.791427:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826152.791641:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049284480 00000100:00100000:3.0:1787826152.791653:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049284480 00000100:00100000:3.0:1787826152.791698:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826152.791708:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3616:x1874663049284480:12345-0@lo:250:kworker.0 00010000:00080000:3.0:1787826152.791755:0:192361:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 205ad83e-e455-4070-92a2-f1e25b8f3f40@0@lo t0 exp 0000000000000000 cur 8219 last 0 00000020:00000080:3.0:1787826152.791790:0:192361:0:(genops.c:1385:class_connect()) connect: client 205ad83e-e455-4070-92a2-f1e25b8f3f40, cookie 0x878a5eea00cecf92 00000100:00080000:3.0:1787826152.791974:0:192361:0:(import.c:65:import_set_state_nolock()) ffff8eb46abef000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826152.792060:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+5:3616:x1874663049284480:12345-0@lo:250:kworker.0 Request processed in 350us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826152.792068:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787826152.792144:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.147@tcp: connect to target with instance 0 10000000:01000000:3.0:1787826152.792155:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:3.0:1787826152.792160:0:3616:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x878a5eea00cecf92 00000100:00080000:0.0:1787826152.792944:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826152.792949:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826152.792952:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826152.792959:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8214 00000100:00080000:0.0:1787826152.792963:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826152.792970:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826152.792990:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69c700 x1874663049284864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826152.793012:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826152.793016:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826152.793017:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826152.793020:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8214 00000100:00080000:0.0:1787826152.793023:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826152.793026:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826152.793038:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb3427e4a80 x1874663049285120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826152.793058:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826152.793061:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826152.793064:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826152.793067:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8214 00000100:00080000:0.0:1787826152.793069:0:172937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826152.793072:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826152.793106:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb479963b80 x1874663049285504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826152.793142:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049285376:0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793205:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826152.793242:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826152.793247:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049284736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793272:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826152.793297:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049285248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793319:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826152.793368:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826152.793373:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049284992:0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793396:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826152.793425:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049285376 00000100:00100000:0.0:1787826152.793433:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049285376 00000100:00100000:0.0:1787826152.793469:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049285248 00000100:00100000:0.0:1787826152.793473:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049285248 00000100:00100000:0.0:1787826152.793492:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6995 00000100:00100000:0.0:1787826152.793500:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049285376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793546:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049285376:12345-0@lo:400:kworker.0 Request processed in 46us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.793553:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6995 00000100:00100000:0.0:1787826152.793570:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6996 00000100:00100000:0.0:1787826152.793576:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049285248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793679:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049285248:12345-0@lo:400:kworker.0 Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.793686:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6996 00000100:00100000:0.0:1787826152.793705:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049284736 00000100:00100000:0.0:1787826152.793709:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049284736 00000100:00100000:0.0:1787826152.793751:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049284992 00000100:00100000:0.0:1787826152.793755:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049284992 00000100:00100000:0.0:1787826152.793776:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787826152.793782:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049284736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793810:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049284736:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.793817:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787826152.793828:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787826152.793835:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049284992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793858:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049284992:12345-0@lo:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.793864:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787826152.793909:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049284736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793920:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049285376:0@lo:400:kworker.0 00000100:00080000:0.0:1787826152.793940:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826152.793954:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049284992:0@lo:400:kworker.0 00000100:00100000:0.0:1787826152.793963:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049285248:0@lo:400:kworker.0 00000100:00080000:3.0:1787826152.802072:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:3.0:1787826152.802093:0:3616:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:3.0:1787826152.803195:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049284480:0@lo:250:kworker.0 00000100:00080000:2.0:1787826152.803267:0:192363:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.203.147@tcp to MGS@0@lo 00000100:00100000:2.0:1787826152.803321:0:192363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787826152.803343:0:192363:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:2.0:1787826152.803370:0:192363:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:2.0:1787826152.803377:0:192363:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from RECOVER to FULL 10000000:01000000:2.0:1787826152.803380:0:192363:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787826152.803415:0:192363:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:2.0:1787826152.803418:0:192363:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.203.147@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:1.0:1787826152.803653:0:172937:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.147@tcp 10000000:01000000:1.0:1787826152.803686:0:172937:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1787826152.803690:0:172937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787826152.803692:0:172937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787826152.803693:0:172937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826152.803695:0:172937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826152.803696:0:172937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826152.803698:0:172937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826152.803699:0:172937:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826152.803702:0:172937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826152.803704:0:172937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787826152.803781:0:172937:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787826152.803788:0:172937:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1787826152.803789:0:172937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787826152.803791:0:172937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826152.803792:0:172937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826152.803793:0:172937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826152.803794:0:172937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826152.803795:0:172937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826152.803797:0:172937:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826152.803798:0:172937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826152.803799:0:172937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787826152.803825:0:172937:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787826152.803832:0:172937:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1787826152.803834:0:172937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787826152.803836:0:172937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826152.803837:0:172937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826152.803839:0:172937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826152.803840:0:172937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826152.803841:0:172937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826152.803843:0:172937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826152.803844:0:172937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826152.803845:0:172937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787826152.803859:0:172937:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1787826152.803904:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049285760:0@lo:253:kworker.0 00000100:00100000:1.0:1787826152.804005:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826152.804068:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826152.804075:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049285888:0@lo:253:kworker.0 00000100:00100000:1.0:1787826152.804125:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826152.804153:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826152.804162:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049285632:0@lo:253:kworker.0 00000100:00100000:1.0:1787826152.804197:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826152.804240:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049285760 00000100:00100000:1.0:1787826152.804248:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049285760 00000100:00100000:1.0:1787826152.804293:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049285888 00000100:00100000:1.0:1787826152.804297:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049285888 00000100:00100000:1.0:1787826152.804309:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049285632 00000100:00100000:1.0:1787826152.804312:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049285632 00000100:00100000:1.0:1787826152.804361:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787826152.804373:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3619:x1874663049285760:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1787826152.804408:0:192361:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1787826152.804569:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826152.804579:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3619:x1874663049285888:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1787826152.804599:0:192360:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1787826152.804634:0:192364:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787826152.804785:0:192361:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 327 00000100:00080000:0.0:1787826152.806509:0:192353:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1787826152.806532:0:192353:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787826152.806589:0:192353:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787826152.806597:0:192353:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787826152.806720:0:192353:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787826152.806781:0:192353:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787826152.806787:0:192353:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787826152.806789:0:192353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826152.806790:0:192353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826152.806792:0:192353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826152.806793:0:192353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826152.806795:0:192353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826152.806797:0:192353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826152.806799:0:192353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826152.806801:0:192353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826152.806802:0:192353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826152.806806:0:192353:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787826152.806808:0:192353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826152.806809:0:192353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826152.806811:0:192353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826152.806812:0:192353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826152.806813:0:192353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826152.806814:0:192353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826152.806815:0:192353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826152.806816:0:192353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826152.806817:0:192353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826152.806819:0:192353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826152.806854:0:192353:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787826152.806880:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479963480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787826152.806970:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826152.807066:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826152.807351:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049284608:0@lo:38:kworker.0 00000100:00100000:3.0:1787826152.807404:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826152.807430:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049284864:0@lo:38:kworker.0 00000100:00100000:3.0:1787826152.807471:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826152.807507:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049284608 00000100:00100000:3.0:1787826152.807515:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049284608 00000100:00100000:3.0:1787826152.807555:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049284864 00000100:00100000:3.0:1787826152.807559:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049284864 00000100:00100000:3.0:1787826152.807582:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1787826152.807591:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049284608:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826152.807614:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826152.807660:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049284608:12345-0@lo:38:kworker.0 Request processed in 69us (255us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826152.807667:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1787826152.807685:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1787826152.807689:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049284864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826152.807698:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826152.807957:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049284864:12345-0@lo:38:kworker.0 Request processed in 266us (485us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826152.807964:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00080000:3.0:1787826152.808014:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826152.808021:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826152.808026:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049284864:0@lo:38:kworker.0 00000100:00100000:3.0:1787826152.808034:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049285120:0@lo:38:kworker.0 00000100:00100000:3.0:1787826152.808066:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826152.808096:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049285120 00000100:00100000:3.0:1787826152.808235:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049285120 00000100:00100000:3.0:1787826152.808264:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12654 00000100:00100000:3.0:1787826152.808270:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049285120:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826152.808284:0:8415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826152.808314:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049285120:12345-0@lo:38:kworker.0 Request processed in 42us (247us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826152.808320:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12654 00000100:00080000:3.0:1787826152.808436:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826152.808441:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826152.808444:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049285120:0@lo:38:kworker.0 00000100:00100000:3.0:1787826152.808451:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049285504:0@lo:38:kworker.0 00000100:00100000:3.0:1787826152.808478:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826152.808504:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049285504 00000100:00100000:3.0:1787826152.808508:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049285504 00000100:00100000:3.0:1787826152.808527:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1787826152.808532:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049285504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826152.808542:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826152.808569:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049285504:12345-0@lo:38:kworker.0 Request processed in 36us (90us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826152.808575:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00080000:3.0:1787826152.808600:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826152.808605:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826152.808608:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049285504:0@lo:38:kworker.0 00000100:00080000:3.0:1787826152.808645:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826152.808649:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826152.808652:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049284608:0@lo:38:kworker.0 00000100:00100000:2.0:1787826152.808887:0:192359:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1787826152.808900:0:192359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1787826152.809264:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049286016 00000100:00100000:2.0:1787826152.809271:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049286016 00000100:00100000:0.0:1787826152.809665:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787826152.809677:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3617:x1874663049285632:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787826152.809716:0:192365:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787826152.811446:0:192366:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787826152.811454:0:192366:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787826152.811457:0:192366:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787826152.811470:0:192366:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787826152.811832:0:192366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787826152.815402:0:192361:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787826152.815452:0:192361:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826152.819895:0:192361:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826152.819914:0:192361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787826152.819969:0:192364:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826152.819980:0:192364:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826152.820019:0:192364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820040:0:192364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826152.820051:0:192364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000072581s 00010000:00010000:3.0:1787826152.820057:0:192364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820064:0:192364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820072:0:192364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820079:0:192364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820085:0:192364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826152.820090:0:192364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820104:0:192364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820125:0:192364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820134:0:192364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.820141:0:192364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecf99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826152.820729:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3619:x1874663049285760:12345-0@lo:253:kworker.0 Request processed in 16352us (16718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826152.820756:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:3.0:1787826152.820798:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787826152.820803:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826152.820805:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826152.820807:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826152.820808:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826152.820816:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:2.0:1787826152.820817:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1787826152.820820:0:3619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826152.820824:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826152.820826:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787826152.820835:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049285760:0@lo:253:kworker.0 00000100:00100000:2.0:1787826152.820837:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:192353:x1874663049286016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826152.820889:0:192361:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787826152.820892:0:192361:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787826152.820896:0:192361:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1787826152.820901:0:192361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787826152.821213:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:192353:x1874663049286016:12345-0@lo:253:mount.lustre.0 Request processed in 384us (14242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826152.821231:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787826152.821266:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479963480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286016:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787826152.821284:0:192353:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787826152.821287:0:192353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787826152.821288:0:192353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787826152.821289:0:192353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826152.821290:0:192353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826152.821291:0:192353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826152.821293:0:192353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826152.821294:0:192353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826152.821296:0:192353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787826152.821298:0:192353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826152.821299:0:192353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787826152.821352:0:192353:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb4727dc000 from lustre-MDT0000 20000000:01000000:0.0:1787826152.821394:0:192365:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 10000000:01000000:3.0:1787826152.821399:0:192353:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787826152.821404:0:192353:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787826152.821415:0:192353:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8eb4727dc000 10000000:01000000:3.0:1787826152.821419:0:192353:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787826152.821424:0:192353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8eb4727dc000 10000000:01000000:3.0:1787826152.821427:0:192353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787826152.821432:0:192353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb4727dc000 from 1 10000000:01000000:3.0:1787826152.821435:0:192353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787826152.821478:0:192353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.821489:0:192353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.821500:0:192353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826152.821524:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826152.821587:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826152.821697:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826152.830602:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049286144 00000100:00100000:0.0:1787826152.830623:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049286144 00000100:00100000:0.0:1787826152.830702:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826152.830717:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:192353:x1874663049286144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826152.830749:0:192359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826152.830780:0:192359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64400/0x878a5eea00cecfa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecfa0 expref: -99 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.830813:0:192359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64400/0x878a5eea00cecfa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecfa0 expref: 8 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.830826:0:192359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64400/0x878a5eea00cecfa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecfa0 expref: 8 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.830835:0:192359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64400, rc 0) 00000100:00100000:0.0:1787826152.830943:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:192353:x1874663049286144:12345-0@lo:101:mount.lustre.0 Request processed in 229us (9356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.830951:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787826152.831113:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826152.831137:0:192353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.831149:0:192353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.831176:0:192353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787826152.831199:0:192353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.831208:0:192353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826152.831218:0:192353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787826152.831223:0:192353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787826152.831230:0:192353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8eb4727dc000 10000000:01000000:3.0:1787826152.831233:0:192353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787826152.831238:0:192353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787826152.831240:0:192353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787826152.831272:0:192353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.831280:0:192353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.831288:0:192353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826152.831311:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826152.831378:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826152.831412:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826152.831882:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049286272 00000100:00100000:0.0:1787826152.831891:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049286272 00000100:00100000:0.0:1787826152.831924:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787826152.831934:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:192353:x1874663049286272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826152.831944:0:192359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826152.831958:0:192359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65e00/0x878a5eea00cecfb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cecfae expref: -99 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.831977:0:192359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65e00/0x878a5eea00cecfb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cecfae expref: 9 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.831986:0:192359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65e00/0x878a5eea00cecfb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cecfae expref: 9 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.832000:0:192359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65e00, rc 0) 00000100:00100000:0.0:1787826152.832053:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:192353:x1874663049286272:12345-0@lo:101:mount.lustre.0 Request processed in 120us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.832059:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826152.832416:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826152.832435:0:192353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826152.832446:0:192353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826152.832534:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826152.832573:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826152.832607:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826152.832791:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049286400 00000100:00100000:0.0:1787826152.832798:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049286400 00000100:00100000:0.0:1787826152.832821:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787826152.832829:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:192353:x1874663049286400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826152.832997:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049286400:12345-0@lo:501:mount.lustre.0 Request processed in 168us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.833004:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826152.836224:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826152.836314:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826152.836451:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826152.836503:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f986a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826152.837176:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049286528 00000100:00100000:0.0:1787826152.837197:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049286528 00000100:00100000:0.0:1787826152.837265:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826152.837277:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049286528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826152.838720:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049286528:12345-0@lo:503:mount.lustre.0 Request processed in 1436us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826152.838735:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787826152.838895:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049286528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826152.841318:0:192367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479939880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192367:1874663049286656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826152.841452:0:192367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826152.841497:0:192367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826152.841617:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049286656 00000100:00100000:1.0:1787826152.841625:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049286656 00000100:00100000:1.0:1787826152.841670:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826152.841681:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192367:x1874663049286656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826152.842920:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192367:x1874663049286656:12345-0@lo:502:llog_process_th.0 Request processed in 1232us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826152.842935:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826152.843035:0:192367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479939880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192367:1874663049286656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787826152.843081:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826152.843094:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826152.843097:0:192367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787826152.843104:0:192367:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787826152.843107:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826152.843126:0:192367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8eb343ea3370) 00000020:00000080:1.0:1787826152.843153:0:192367:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1787826152.843159:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787826152.843260:0:192367:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787826152.843269:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecfc3 00000020:00000080:1.0:1787826152.843559:0:192367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787826152.843564:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826152.843568:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826152.843569:0:192367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787826152.843573:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826152.843576:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826152.843577:0:192367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787826152.843580:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826152.843588:0:192367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8eb343ea4d28) 00000020:00000080:1.0:1787826152.843601:0:192367:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1787826152.843605:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787826152.843608:0:192367:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787826152.843611:0:192367:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787826152.843619:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826152.843672:0:192367:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb4727dc000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787826152.843686:0:192367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8eb343ea19b8) 00000020:00000080:1.0:1787826152.843697:0:192367:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1787826152.843779:0:192367:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787826152.843789:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cecfd8 00000020:00000080:1.0:1787826152.843899:0:192367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787826152.843906:0:192367:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787826152.843911:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x878a5eea00cecfdf 00080000:01000000:1.0:1787826152.843916:0:192367:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787826152.843919:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cecfe6 20000000:01000000:0.0:1787826152.847097:0:192365:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826152.847116:0:192365:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787826152.847544:0:192360:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787826152.847697:0:192364:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826152.847703:0:192364:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826152.847731:0:192364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847765:0:192364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826152.847776:0:192364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000074148s 00010000:00010000:3.0:1787826152.847782:0:192364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847789:0:192364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847797:0:192364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847805:0:192364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847812:0:192364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826152.847817:0:192364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847826:0:192364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847842:0:192364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847849:0:192364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826152.847860:0:192364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00cecfed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826152.848352:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:3617:x1874663049285632:12345-0@lo:253:kworker.0 Request processed in 38640us (44116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826152.848378:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:3.0:1787826152.848579:0:3617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787826152.848583:0:3617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787826152.848584:0:3617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826152.848586:0:3617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826152.848587:0:3617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826152.848588:0:3617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826152.848590:0:3617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826152.848593:0:3617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826152.848594:0:3617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787826152.848599:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049285632:0@lo:253:kworker.0 20000000:01000000:3.0:1787826152.867283:0:192360:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787826152.867314:0:192360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787826152.867722:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3619:x1874663049285888:12345-0@lo:253:kworker.0 Request processed in 63137us (63588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826152.867750:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:0.0:1787826152.867921:0:192364:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787826152.867928:0:192364:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787826152.867957:0:192364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.867978:0:192364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787826152.867990:0:192364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000074148s 00010000:00010000:0.0:1787826152.867996:0:192364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.868003:0:192364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.868011:0:192364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.868018:0:192364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.868025:0:192364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826152.868031:0:192364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.868039:0:192364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.868053:0:192364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.868062:0:192364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826152.868068:0:192364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cecff4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826152.868292:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1787826152.868296:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787826152.868298:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826152.868299:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826152.868300:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826152.868302:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826152.868304:0:3619:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826152.868306:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826152.868308:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787826152.868312:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049285888:0@lo:253:kworker.0 00010000:00010000:2.0:1787826152.990869:0:192367:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1787826152.991085:0:192367:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: a9ce6693-0634-46c5-bf21-5ca7d026d44e idx: 0 lr: 335007449222 srv lr: 339302416384 lx: 0 gen 18 00000001:00080000:2.0:1787826152.991142:0:192367:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 330712483740 srv lr: 339302416384 lx: 0 gen 21 00000001:00000004:2.0:1787826152.991173:0:192367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 80, last_transno is 339302416384 00000001:00080000:2.0:1787826152.991308:0:192367:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1787826152.991435:0:192367:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb47f986540: xid 1874663042965504, transno 339302416387, client gen 18, slot idx 0 00000001:00080000:2.0:1787826152.991448:0:192367:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb47f986840: xid 1874663042966016, transno 339302416388, client gen 18, slot idx 1 00000001:00080000:2.0:1787826152.991453:0:192367:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb47f9860c0: xid 1874663042950784, transno 335007449219, client gen 18, slot idx 2 00000001:00080000:2.0:1787826152.991457:0:192367:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb47f986a80: xid 1874663048748160, transno 330712483739, client gen 21, slot idx 3 00000001:00080000:2.0:1787826152.991463:0:192367:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb47f986300: xid 1874663048748416, transno 330712483740, client gen 21, slot idx 4 00000001:00080000:2.0:1787826152.991468:0:192367:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb47f986f00: xid 1874663035574656, transno 322122554723, client gen 18, slot idx 5 00000001:00080000:2.0:1787826152.991472:0:192367:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb47f986e40: xid 1874663041393408, transno 330712482189, client gen 18, slot idx 6 00000020:00000080:2.0:1787826152.992588:0:192367:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8eb341a699b8) 00000020:00000080:2.0:1787826152.992622:0:192367:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1787826152.992854:0:192367:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787826152.992865:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced010 00000020:00000080:2.0:1787826152.994786:0:192367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787826153.010862:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x878a5eea00ced017 00000020:00000080:0.0:1787826153.013941:0:192367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787826153.013962:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826153.013971:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.013973:0:192367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787826153.013976:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787826153.013980:0:192367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787826153.013982:0:192367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826153.013983:0:192367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826153.013985:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787826153.013987:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.013989:0:192367:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787826153.013991:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826153.014007:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.014010:0:192367:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787826153.014015:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787826153.014078:0:192367:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787826153.014134:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826153.014139:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.014140:0:192367:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787826153.014144:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826153.014147:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.014149:0:192367:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787826153.014153:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787826153.014160:0:192367:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:0.0:1787826153.014197:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787826153.014218:0:192367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8eb46a874d28) 00000020:00000080:0.0:1787826153.014259:0:192367:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787826153.014268:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787826153.014395:0:192367:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787826153.014403:0:192367:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787826153.014413:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced025 00010000:00080000:0.0:1787826153.014459:0:192367:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb45a03b000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1787826153.017887:0:192367:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1787826153.038033:0:192367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826153.038058:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787826153.038115:0:192367:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787826153.038142:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced02c 00000100:00080000:3.0:1787826153.038157:0:192367:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826153.038164:0:192367:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45a03b000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826153.038213:0:192367:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47993a300 x1874663049286784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826153.038253:0:192367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787826153.038642:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826153.038647:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826153.038649:0:192367:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787826153.038653:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787826153.038656:0:192367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787826153.038658:0:192367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826153.038660:0:192367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826153.038661:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787826153.038664:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826153.038665:0:192367:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787826153.038668:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787826153.038673:0:192367:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787826153.038676:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826153.038678:0:192367:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787826153.038681:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787826153.038685:0:192367:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:3.0:1787826153.038714:0:192367:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787826153.038717:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826153.038734:0:192367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8eb344e619b8) 00000020:00000080:3.0:1787826153.038767:0:192367:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1787826153.038774:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787826153.038865:0:192367:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787826153.038873:0:192367:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787826153.038881:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced03a 00010000:00080000:3.0:1787826153.038919:0:192367:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb47754e000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1787826153.039152:0:192367:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1787826153.039585:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049286784:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826153.039674:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.039854:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049286784 00000100:00100000:0.0:1787826153.039866:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049286784 00000100:00100000:0.0:1787826153.039916:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12655 00000100:00100000:0.0:1787826153.039927:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049286784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787826153.039961:0:177386:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8219 last 0 00000020:00000080:0.0:1787826153.040000:0:177386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced041 00000004:00100000:0.0:1787826153.040028:0:177386:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826153.040146:0:177386:0:(import.c:65:import_set_state_nolock()) ffff8eb448c37000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826153.040215:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049286784:12345-0@lo:38:llog_process_th.0 Request processed in 288us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.040223:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12655 00000100:00100000:0.0:1787826153.040275:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826153.040285:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 4 00000100:00080000:0.0:1787826153.040296:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787826153.040302:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787826153.040305:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45a03b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000040:01000000:3.0:1787826153.040970:0:192367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787826153.041000:0:192367:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787826153.041522:0:192367:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 78, last_idx 79 00000040:00080000:3.0:1787826153.043966:0:192367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826153.044010:0:192367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].80, 64 off13312 00000100:00100000:2.0:1787826153.044155:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049286912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826153.044257:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.044380:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049286912 00000100:00100000:2.0:1787826153.044390:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049286912 00000100:00100000:2.0:1787826153.044447:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12656 00000100:00100000:2.0:1787826153.044465:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049286912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826153.044512:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:2.0:1787826153.044567:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049286912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.044575:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12656 00000100:00100000:2.0:1787826153.044633:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049286912:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787826153.047227:0:192367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x140:0x0].1, 64 off8256 00000100:00100000:0.0:1787826153.048145:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049286784:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787826153.050607:0:192373:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 80 synced_idx: 0 lgh_last_idx: 80 00000040:00080000:3.0:1787826153.050618:0:192373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13c:0x0] at index 79 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787826153.051824:0:192367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826153.051841:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787826153.051918:0:192367:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787826153.051946:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced048 00000100:00080000:1.0:1787826153.051961:0:192367:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787826153.051968:0:192367:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb47754e000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826153.052024:0:192367:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46e80e300 x1874663049287040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826153.052048:0:192367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787826153.052139:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826153.052143:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826153.052146:0:192367:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787826153.052149:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787826153.052152:0:192367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787826153.052154:0:192367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826153.052156:0:192367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826153.052157:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787826153.052160:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826153.052161:0:192367:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787826153.052164:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826153.052169:0:192367:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787826153.052173:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826153.052174:0:192367:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787826153.052177:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787826153.052182:0:192367:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:1.0:1787826153.052212:0:192367:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787826153.052215:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826153.052231:0:192367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8eb3449f19b8) 00000020:00000080:1.0:1787826153.052252:0:192367:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1787826153.052257:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787826153.052496:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049287040:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787826153.052596:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.052732:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049287040 00000100:00100000:1.0:1787826153.052753:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049287040 00000100:00100000:1.0:1787826153.052843:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22547 00000100:00100000:1.0:1787826153.052853:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1874663049287040:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1787826153.052886:0:43900:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8219 last 0 00000020:00000080:1.0:1787826153.052917:0:43900:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced056 00002000:00100000:1.0:1787826153.052936:0:43900:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8eb47a6a1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787826153.052942:0:43900:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787826153.052946:0:43900:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787826153.053049:0:43900:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787826153.053076:0:43900:0:(import.c:65:import_set_state_nolock()) ffff8eb47a6a0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826153.053145:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049287040:12345-0@lo:8:llog_process_th.0 Request processed in 291us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.053153:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22547 00000100:00100000:0.0:1787826153.058291:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826153.058316:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 8 00000100:00080000:0.0:1787826153.058342:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787826153.058351:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787826153.058368:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47754e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787826153.058411:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787826153.058424:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049287040:0@lo:8:llog_process_th.0 00000040:00080000:2.0:1787826153.058808:0:192373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13c:0x0] index 3 count 2 00000040:00080000:2.0:1787826153.058870:0:192373:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 80 synced_idx: 80 lgh_last_idx: 80 00000040:00080000:2.0:1787826153.058886:0:192373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00000004:00080000:2.0:1787826153.058920:0:192373:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787826153.059002:0:192373:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8219885675916ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787826153.059011:0:192373:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787826153.059047:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826153.059067:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049287168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826153.059156:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.059211:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826153.059220:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049287296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826153.059249:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.066587:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049287168 00000100:00100000:0.0:1787826153.066609:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049287168 00000100:00100000:0.0:1787826153.066726:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5767 00000100:00100000:0.0:1787826153.066755:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049287168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826153.066793:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826153.066915:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049287168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (7759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.066924:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5767 00000100:00100000:0.0:1787826153.066957:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049287296 00000100:00100000:0.0:1787826153.066961:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049287296 00000100:00100000:0.0:1787826153.066989:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22548 00000100:00100000:0.0:1787826153.066995:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049287296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787826153.067017:0:12319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6210 count 1 00000100:00100000:0.0:1787826153.067129:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049287296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 134us (7879us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826153.067136:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22548 00000004:00080000:0.0:1787826153.067188:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb348ffe300, transno 0 00000004:00080000:0.0:1787826153.067196:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb348ffe300/1, rc -2, transno 0 00000100:00100000:0.0:1787826153.067208:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049287296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826153.067245:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049287168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787826153.067591:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787826153.067803:0:192373:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 79, last_idx 80 00000040:00080000:2.0:1787826153.067829:0:192373:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x13c:0x0] at index 79 of catalog [0x1:0x2:0x0] 00000004:00080000:1.0:1787826153.068351:0:192367:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787826153.068369:0:192367:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787826153.068384:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced05d 00010000:00080000:1.0:1787826153.068430:0:192367:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb45ec37800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:1.0:1787826153.068844:0:192367:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1787826153.069182:0:192367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787826153.069203:0:192367:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787826153.073806:0:192367:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 78, last_idx 79 00000040:00080000:2.0:1787826153.074714:0:192367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826153.074766:0:192367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].80, 64 off13312 00000040:00080000:2.0:1787826153.075037:0:192367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x142:0x0].1, 64 off8256 00000004:00080000:3.0:1787826153.075185:0:192354:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1787826153.077279:0:192375:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 80 synced_idx: 0 lgh_last_idx: 80 00000040:00080000:3.0:1787826153.077291:0:192375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13e:0x0] at index 79 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1787826153.078322:0:192375:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 79, last_idx 80 00000040:00080000:3.0:1787826153.079126:0:192375:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x13e:0x0] at index 79 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787826153.079471:0:192367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826153.079489:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787826153.079551:0:192367:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787826153.079580:0:192367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced064 00000100:00080000:2.0:1787826153.079596:0:192367:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826153.079605:0:192367:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8eb45ec37800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826153.079723:0:192367:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348ffe300 x1874663049287424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826153.079758:0:192367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787826153.079845:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826153.079850:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826153.079852:0:192367:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787826153.079856:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826153.079860:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826153.079862:0:192367:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787826153.079865:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787826153.079867:0:192367:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787826153.079870:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826153.079873:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826153.079874:0:192367:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787826153.080128:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826153.080133:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826153.080134:0:192367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787826153.080139:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787826153.080183:0:192367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192367:1874663049287552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.080309:0:192367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.080464:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049287424:0@lo:8:llog_process_th.0 00000040:00080000:3.0:1787826153.080534:0:192375:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 80 synced_idx: 80 lgh_last_idx: 80 00000040:00080000:3.0:1787826153.080540:0:192375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x142:0x0] at index 80 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1787826153.080696:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049287552 00000100:00100000:1.0:1787826153.080705:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049287552 00000100:00100000:1.0:1787826153.080767:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787826153.080779:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:192367:x1874663049287552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826153.081181:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.081300:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049287424 00000100:00100000:3.0:1787826153.081307:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049287424 00000100:00100000:3.0:1787826153.081371:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22549 00000100:00100000:3.0:1787826153.081378:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3616:x1874663049287424:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787826153.081411:0:43899:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8219 last 0 00000020:00000080:3.0:1787826153.081454:0:43899:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced06b 00002000:00100000:3.0:1787826153.081474:0:43899:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8eb47986c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787826153.081479:0:43899:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787826153.081483:0:43899:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787826153.081573:0:43899:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787826153.081606:0:43899:0:(import.c:65:import_set_state_nolock()) ffff8eb47986d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826153.081801:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049287424:12345-0@lo:8:llog_process_th.0 Request processed in 422us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.081810:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22549 00000100:00100000:0.0:1787826153.081925:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826153.081937:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787826153.081946:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787826153.081952:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787826153.081956:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec37800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787826153.081980:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787826153.081987:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049287424:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787826153.082077:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049287680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826153.082117:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.082168:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049287680 00000100:00100000:0.0:1787826153.082173:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049287680 00000100:00100000:0.0:1787826153.082218:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5768 00000100:00100000:0.0:1787826153.082228:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049287680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826153.082247:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826153.082286:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049287680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.082292:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5768 00000100:00080000:0.0:1787826153.082315:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826153.082382:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049287680:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1787826153.083217:0:192375:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787826153.083317:0:192375:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8219909991277ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787826153.083343:0:192375:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787826153.086534:0:192354:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787826153.086782:0:192367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34898ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.087108:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:192367:x1874663049287552:12345-0@lo:502:llog_process_th.0 Request processed in 6324us (6793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.087123:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787826153.087241:0:192367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192367:1874663049287552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826153.087287:0:192367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826153.087296:0:192367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826153.087299:0:192367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787826153.087304:0:192367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787826153.087719:0:192353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787826153.087764:0:192353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787826153.087827:0:192353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.087840:0:192353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826153.087850:0:192353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb4727dc000 from 1 10000000:01000000:3.0:1787826153.087854:0:192353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826153.087913:0:192353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.087922:0:192353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.087932:0:192353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826153.087956:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479939f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049287808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826153.088013:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.088050:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3491726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.088147:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049287808 00000100:00100000:2.0:1787826153.088156:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049287808 00000100:00100000:2.0:1787826153.088205:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787826153.088216:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:192353:x1874663049287808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826153.088232:0:192365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826153.088250:0:192365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced072 expref: -99 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.088280:0:192365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced072 expref: 9 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.088290:0:192365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced072 expref: 9 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.088300:0:192365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39200, rc 0) 00000100:00100000:2.0:1787826153.088378:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:192353:x1874663049287808:12345-0@lo:101:mount.lustre.0 Request processed in 164us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.088384:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826153.088517:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479939f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049287808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826153.088532:0:192353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.088542:0:192353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.089148:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049287936:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787826153.089205:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.089253:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.089557:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049287936 00000100:00100000:2.0:1787826153.089564:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049287936 00000100:00100000:2.0:1787826153.089607:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787826153.089617:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:192353:x1874663049287936:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787826153.089650:0:192359:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787826153.089675:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787826153.089679:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787826153.089683:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787826153.089685:0:192359:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 330 00000100:00100000:2.0:1787826153.089804:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:192353:x1874663049287936:12345-0@lo:256:mount.lustre.0 Request processed in 188us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.089811:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787826153.089890:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049287936:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787826153.090909:0:192353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826153.094013:0:192353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.094042:0:192353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826153.094051:0:192353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb4727dc000 from 1 10000000:01000000:2.0:1787826153.094055:0:192353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826153.094113:0:192353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.094121:0:192353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.094133:0:192353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826153.094165:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826153.094254:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.094312:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34898a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.094404:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049288064 00000100:00100000:0.0:1787826153.094415:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049288064 00000100:00100000:0.0:1787826153.094483:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787826153.094495:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:192353:x1874663049288064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826153.094511:0:192365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826153.094528:0:192365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ced087 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced080 expref: -99 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.094555:0:192365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ced087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced080 expref: 10 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.094572:0:192365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ced087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced080 expref: 10 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.094581:0:192365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65a00, rc 0) 00000100:00100000:1.0:1787826153.094818:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826153.094839:0:192353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.094849:0:192353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.094952:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826153.095577:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.095658:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.095750:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049288064:12345-0@lo:101:mount.lustre.0 Request processed in 1255us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.095759:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787826153.095803:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049288192 00000100:00100000:0.0:1787826153.095809:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049288192 00000100:00100000:2.0:1787826153.095861:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787826153.095873:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049288192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826153.096132:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049288192:12345-0@lo:501:mount.lustre.0 Request processed in 261us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.096139:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787826153.096233:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826153.096278:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826153.096637:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.096668:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.096719:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049288320 00000100:00100000:3.0:1787826153.096725:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049288320 00000100:00100000:3.0:1787826153.096770:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787826153.096778:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049288320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826153.096940:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049288320:12345-0@lo:503:mount.lustre.0 Request processed in 163us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.096948:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787826153.097049:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826153.097982:0:192377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192377:1874663049288448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.098048:0:192377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.098115:0:192377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb444dde0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.098148:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049288448 00000100:00100000:3.0:1787826153.098154:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049288448 00000100:00100000:3.0:1787826153.098216:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787826153.098225:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192377:x1874663049288448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826153.098720:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192377:x1874663049288448:12345-0@lo:502:llog_process_th.0 Request processed in 494us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.098729:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787826153.098824:0:192377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192377:1874663049288448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787826153.098855:0:192377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826153.098866:0:192377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.098868:0:192377:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787826153.098885:0:192377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb4727dc000 00000020:00000080:0.0:1787826153.098888:0:192377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787826153.098899:0:192377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826153.098901:0:192377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.098903:0:192377:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787826153.098905:0:192377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826153.098907:0:192377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.098909:0:192377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787826153.098912:0:192377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb4727dc000 00000020:00000080:0.0:1787826153.098913:0:192377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787826153.099000:0:192377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479962680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192377:1874663049288576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826153.099037:0:192377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.108031:0:192377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4536879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.108311:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049288576 00000100:00100000:2.0:1787826153.108415:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049288576 00000100:00100000:2.0:1787826153.108492:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787826153.108504:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192377:x1874663049288576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.108730:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192377:x1874663049288576:12345-0@lo:502:llog_process_th.0 Request processed in 227us (9692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.108749:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787826153.110708:0:192377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479962680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192377:1874663049288576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787826153.110778:0:192377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826153.110791:0:192377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826153.110794:0:192377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787826153.110800:0:192377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787826153.111815:0:192353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1787826153.111855:0:192353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787826153.111893:0:192353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.111907:0:192353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826153.111978:0:192353:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787826153.111981:0:192353:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8eb4727dc000 10000000:01000000:3.0:1787826153.111985:0:192353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8eb4727dc000 10000000:01000000:3.0:1787826153.111990:0:192353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787826153.111997:0:192353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb4727dc000 from 1 10000000:01000000:3.0:1787826153.112000:0:192353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787826153.112047:0:192353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.112056:0:192353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.112067:0:192353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826153.112093:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479938e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826153.112176:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.112230:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.112259:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049288704 00000100:00100000:3.0:1787826153.112266:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049288704 00000100:00100000:3.0:1787826153.112311:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787826153.112320:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:192353:x1874663049288704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826153.112713:0:192359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826153.112734:0:192359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced08e expref: -99 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.112778:0:192359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced08e expref: 11 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.112790:0:192359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced08e expref: 11 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.112802:0:192359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8fc00, rc 0) 00000100:00100000:3.0:1787826153.112858:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192353:x1874663049288704:12345-0@lo:101:mount.lustre.0 Request processed in 538us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.112867:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787826153.113260:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479938e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826153.113280:0:192353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.113291:0:192353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826153.114618:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479938e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826153.115031:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.115090:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.115122:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049288832 00000100:00100000:3.0:1787826153.115130:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049288832 00000100:00100000:3.0:1787826153.115321:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787826153.115354:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192353:x1874663049288832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826153.115550:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192353:x1874663049288832:12345-0@lo:501:mount.lustre.0 Request processed in 197us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.115559:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787826153.115607:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479938e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826153.115664:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479938e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826153.115718:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.117169:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349172180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.118710:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049288960 00000100:00100000:1.0:1787826153.118724:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049288960 00000100:00100000:1.0:1787826153.118805:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826153.118816:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192353:x1874663049288960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826153.119050:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192353:x1874663049288960:12345-0@lo:503:mount.lustre.0 Request processed in 235us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.119058:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787826153.124759:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479938e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049288960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826153.126202:0:192380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192380:1874663049289088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.126288:0:192380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.126454:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049289088 00000100:00100000:2.0:1787826153.126462:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049289088 00000100:00100000:2.0:1787826153.126581:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826153.126592:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192380:x1874663049289088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.127773:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192380:x1874663049289088:12345-0@lo:502:llog_process_th.0 Request processed in 1178us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.127783:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826153.128007:0:192380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.128029:0:192380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192380:1874663049289088:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787826153.128092:0:192380:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787826153.128108:0:192380:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8eb341a6cd28) 00000020:00000080:2.0:1787826153.128135:0:192380:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787826153.128220:0:192380:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb4727dc000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787826153.128224:0:192380:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb4727dc000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787826153.128227:0:192380:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb4727dc000 4 00010000:00080000:2.0:1787826153.128255:0:192380:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb34df97000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1787826153.134262:0:192380:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1787826153.134764:0:192380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787826153.134818:0:192380:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826153.134899:0:192380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x878a5eea00ced0a3 00000100:00080000:2.0:1787826153.134912:0:192380:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826153.134917:0:192380:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb34df97000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826153.134953:0:192380:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348ffe300 x1874663049289216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826153.134982:0:192380:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787826153.136082:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049289216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826153.136185:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.138152:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049289216 00000100:00100000:2.0:1787826153.138173:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049289216 00000100:00100000:2.0:1787826153.138240:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1787826153.138250:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049289216:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826153.138465:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049289216:12345-0@lo:38:llog_process_th.0 Request processed in 213us (2278us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787826153.138473:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1787826153.138602:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826153.138613:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34df97000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826153.138618:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826153.138622:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049289216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826153.138866:0:192380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192380:1874663049289344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.140234:0:192380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.140282:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049289344 00000100:00100000:2.0:1787826153.140291:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049289344 00000100:00100000:2.0:1787826153.142551:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787826153.142583:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192380:x1874663049289344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.142829:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192380:x1874663049289344:12345-0@lo:502:llog_process_th.0 Request processed in 262us (2602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.142838:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787826153.145516:0:192380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.145571:0:192380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192380:1874663049289344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.145672:0:192380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192380:1874663049289472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.145770:0:192380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.145813:0:192380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349480240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.146482:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049289472 00000100:00100000:3.0:1787826153.146492:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049289472 00000100:00100000:3.0:1787826153.146558:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787826153.146570:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192380:x1874663049289472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826153.148301:0:192380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:192380:1874663049289472:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787826153.149477:0:192380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787826153.149597:0:192353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787826153.149631:0:192353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826153.149658:0:192353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.149672:0:192353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826153.149746:0:192353:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787826153.149749:0:192353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826153.149751:0:192353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826153.149752:0:192353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826153.149753:0:192353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826153.149754:0:192353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826153.149756:0:192353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826153.149758:0:192353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826153.149760:0:192353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826153.149762:0:192353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826153.149766:0:192353:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787826153.149769:0:192353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826153.149770:0:192353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826153.149772:0:192353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826153.149773:0:192353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826153.149774:0:192353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826153.149775:0:192353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826153.149776:0:192353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826153.149777:0:192353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826153.149778:0:192353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826153.149780:0:192353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826153.149810:0:192353:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787826153.149834:0:192353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049289600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826153.149927:0:192353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.149972:0:192353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb449753d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.150002:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049289600 00000100:00100000:2.0:1787826153.150010:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049289600 00000100:00100000:2.0:1787826153.150060:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787826153.150071:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:192353:x1874663049289600:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826153.150104:0:192359:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787826153.150122:0:192359:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787826153.152645:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:192380:x1874663049289472:12345-0@lo:502:llog_process_th.0 Request processed in 169us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.152671:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:0.0:1787826153.165575:0:192359:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826153.165602:0:192359:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787826153.165952:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:192353:x1874663049289600:12345-0@lo:253:mount.lustre.0 Request processed in 15874us (16017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.165968:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787826153.166087:0:192353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:192353:1874663049289600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787826153.166106:0:192353:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787826153.166110:0:192353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826153.166112:0:192353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826153.166113:0:192353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826153.166115:0:192353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826153.166116:0:192353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826153.166118:0:192353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826153.166119:0:192353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826153.166121:0:192353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826153.166123:0:192353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826153.166125:0:192353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787826153.166144:0:192353:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787826153.166923:0:192364:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826153.166931:0:192364:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826153.166959:0:192364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.166979:0:192364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced072 expref: 10 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.166993:0:192364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.167039:0:192364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ced072 expref: 10 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.167057:0:192364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00ced072 expref: 10 pid: 192365 timeout: 8319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826153.167074:0:192364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:192364:1874663049289728:0@lo:104: 00000100:00100000:3.0:1787826153.167134:0:192364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.167193:0:192364:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.167554:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049289728 00000100:00100000:2.0:1787826153.167564:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049289728 00000100:00100000:2.0:1787826153.167621:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4768 00000100:00100000:2.0:1787826153.167632:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:192364:x1874663049289728:12345-0@lo:104: 00010000:00010000:2.0:1787826153.167648:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.167715:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826153.167723:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:192364:x1874663049289728:12345-0@lo:104: Request processed in 93us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.167730:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4768 00000100:00100000:2.0:1787826153.167791:0:192364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:192364:1874663049289728:0@lo:104: 00010000:00010000:2.0:1787826153.167818:0:192364:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.167838:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826153.167846:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.167853:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826153.167858:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.167866:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826153.167874:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826153.167879:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826153.167913:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.167920:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826153.167944:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.167951:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f200/0x878a5eea00ced072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced079 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.167972:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826153.167974:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826153.167976:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826153.167991:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049289856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826153.168023:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.169511:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049289856 00000100:00100000:3.0:1787826153.169525:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049289856 00010000:00010000:3.0:1787826153.169571:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00ced072 expref: 11 pid: 192365 timeout: 8319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826153.169618:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12221 00000100:00100000:3.0:1787826153.169629:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:3617:x1874663049289856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826153.169646:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826153.169653:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00ced072 expref: 11 pid: 192365 timeout: 8319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169668:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00ced072 expref: 11 pid: 192365 timeout: 8319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169686:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf39200/0x878a5eea00ced079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ced072 expref: 11 pid: 192365 timeout: 8319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169711:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169721:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826153.169748:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002818178s 00010000:00010000:3.0:1787826153.169754:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169761:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169768:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169775:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169782:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ec00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826153.169787:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169795:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169819:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.169831:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826153.169906:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:3617:x1874663049289856:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.169914:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12221 00000100:00100000:2.0:1787826153.170114:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049289856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826153.170216:0:192364:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.170226:0:192364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.170233:0:192364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced0aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826153.179666:0:192353:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 330712484068 00000040:01000000:0.0:1787826153.181465:0:192353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787826153.181643:0:192385:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 330712484068 00000020:00080000:2.0:1787826153.181649:0:192385:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484068 00000040:01000000:2.0:1787826153.184919:0:192386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787826153.185302:0:192353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1787826153.187351:0:192387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192387:1874663049289984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826153.187454:0:192387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.187487:0:192387:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480d549c0 going to sleep for 11 seconds 00000040:01000000:1.0:1787826153.187753:0:192353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787826153.187805:0:192353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787826153.188218:0:192353:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787826153.188227:0:192353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787826153.188262:0:192353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826153.189224:0:192353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787826153.189804:0:192353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787826153.189847:0:192353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787826153.189987:0:192353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787826153.190673:0:192353:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x83:0x0] (8/32) registered 00000100:00100000:2.0:1787826153.191860:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049289984 00000100:00100000:2.0:1787826153.191879:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049289984 00000100:00100000:2.0:1787826153.191966:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12657 00000100:00100000:2.0:1787826153.191980:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192387:x1874663049289984:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826153.192136:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192387:x1874663049289984:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 159us (4682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.192145:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12657 00000100:00100000:0.0:1787826153.192257:0:192387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192387:1874663049289984:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787826153.192305:0:192387:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787826153.192402:0:192387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192387:1874663049290112:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826153.192458:0:192387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.192493:0:192387:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480d549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.192531:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049290112 00000100:00100000:3.0:1787826153.192536:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049290112 00000100:00100000:3.0:1787826153.192565:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12658 00000100:00100000:3.0:1787826153.192574:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192387:x1874663049290112:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826153.192720:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192387:x1874663049290112:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 147us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.192727:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12658 00000100:00100000:0.0:1787826153.192748:0:192387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192387:1874663049290112:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826153.192825:0:192387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192387:1874663049290240:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826153.192850:0:192387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.192877:0:192387:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480d549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.193382:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049290240 00000100:00100000:3.0:1787826153.193389:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049290240 00000100:00100000:3.0:1787826153.193424:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12659 00000100:00100000:3.0:1787826153.193433:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192387:x1874663049290240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826153.193510:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192387:x1874663049290240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.193517:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12659 00000100:00100000:0.0:1787826153.193530:0:192387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192387:1874663049290240:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826153.193616:0:192387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192387:1874663049290368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826153.193689:0:192387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.193714:0:192387:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480d54540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.194116:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049290368 00000100:00100000:3.0:1787826153.194122:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049290368 00000100:00100000:3.0:1787826153.194151:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12660 00000100:00100000:3.0:1787826153.194158:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192387:x1874663049290368:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826153.194432:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192387:x1874663049290368:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 273us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.194439:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12660 00000100:00100000:0.0:1787826153.194470:0:192387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192387:1874663049290368:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787826153.197449:0:192387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787826153.197601:0:192387:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1787826153.200817:0:192386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787826153.200940:0:192386:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787826153.200947:0:192386:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1787826153.208624:0:192353:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 339302416388 00010000:00080000:2.0:1787826153.209994:0:192388:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 192388 00010000:02000000:2.0:1787826153.210013:0:192388:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1787826153.210019:0:192388:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1787826153.210023:0:192388:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1787826153.210545:0:192353:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787826153.210570:0:192353:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787826153.210597:0:192353:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787826153.210623:0:192353:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787826153.218037:0:192353:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826153.218932:0:192353:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787826153.301545:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787826153.944899:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787826153.944910:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb4727dc000 from 331 10000000:01000000:1.0:1787826153.944916:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787826153.944987:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.945001:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.945015:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.945051:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049290496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.945163:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.945225:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.945923:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049290496 00000100:00100000:0.0:1787826153.945937:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049290496 00000100:00100000:0.0:1787826153.946013:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787826153.946024:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:6488:x1874663049290496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826153.946043:0:192365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826153.946066:0:192365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced0b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced0b1 expref: -99 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.946098:0:192365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced0b1 expref: 11 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.946129:0:192365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced0b1 expref: 11 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.946140:0:192365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65600, rc 0) 00000100:00100000:0.0:1787826153.946204:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049290496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.946212:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787826153.946475:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049290496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826153.946500:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.946515:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.946602:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049290624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.946659:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.946694:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.947556:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049290624 00000100:00100000:0.0:1787826153.947568:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049290624 00000100:00100000:0.0:1787826153.947634:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787826153.947646:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049290624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826153.947687:0:192360:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826153.947719:0:192360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826153.947723:0:192360:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 331 00000100:00100000:0.0:1787826153.947867:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049290624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 223us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.947876:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787826153.948128:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049290624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787826153.948204:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826153.948216:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.948226:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826153.948236:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787826153.948240:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb34df96000 from 52 10000000:01000000:1.0:1787826153.948243:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826153.948275:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.948285:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.948294:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.948316:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049290752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.948387:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.948417:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.949399:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049290752 00000100:00100000:0.0:1787826153.949414:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049290752 00000100:00100000:0.0:1787826153.949476:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787826153.949486:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049290752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826153.949504:0:192365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826153.949524:0:192365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64000/0x878a5eea00ced0c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced0bf expref: -99 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.949555:0:192365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64000/0x878a5eea00ced0c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced0bf expref: 12 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.949572:0:192365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64000/0x878a5eea00ced0c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced0bf expref: 12 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.949582:0:192365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64000, rc 0) 00000100:00100000:0.0:1787826153.949650:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049290752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.949657:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787826153.950455:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049290752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826153.950482:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0c6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.950494:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced0c6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.950602:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049290880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.950653:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.950688:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.951076:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049290880 00000100:00100000:0.0:1787826153.951085:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049290880 00000100:00100000:0.0:1787826153.951128:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787826153.951137:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049290880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.951321:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049290880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.951358:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787826153.952119:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049290880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.952182:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.952259:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.952304:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1c5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.955443:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049291008 00000100:00100000:2.0:1787826153.955462:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049291008 00000100:00100000:2.0:1787826153.955534:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787826153.955547:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049291008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826153.955790:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049291008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (3530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.955800:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826153.958694:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787826153.959954:0:192418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1787826153.960746:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1787826153.960783:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826153.960799:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0c6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.960814:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0c6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826153.960826:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787826153.960830:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb34df96000 from 328 10000000:01000000:1.0:1787826153.960833:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787826153.960887:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.960896:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.960908:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.960941:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.961036:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.961086:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.961172:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049291136 00000100:00100000:0.0:1787826153.961182:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049291136 00000100:00100000:0.0:1787826153.961247:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787826153.961258:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049291136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826153.961277:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826153.961295:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65000/0x878a5eea00ced0d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced0cd expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.961361:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65000/0x878a5eea00ced0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced0cd expref: 13 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.961374:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65000/0x878a5eea00ced0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced0cd expref: 13 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.961390:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65000, rc 0) 00000100:00100000:0.0:1787826153.961447:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049291136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.961454:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787826153.961636:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826153.961654:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0d4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.961664:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced0d4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826153.961749:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787826153.961790:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.961819:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.961892:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049291264 00000100:00100000:1.0:1787826153.961897:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049291264 00000100:00100000:1.0:1787826153.961935:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826153.961944:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049291264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826153.961962:0:192359:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826153.961985:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826153.961989:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787826153.961993:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787826153.961996:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787826153.961998:0:192359:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 331 00000100:00100000:1.0:1787826153.962103:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049291264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.962111:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787826153.962192:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787826153.962292:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787826153.962299:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0d4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.962308:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0d4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826153.962318:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787826153.962321:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1787826153.962351:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787826153.962377:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.962385:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.962393:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826153.962408:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.962442:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.962470:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450139480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.962533:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049291392 00000100:00100000:1.0:1787826153.962538:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049291392 00000100:00100000:1.0:1787826153.962606:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826153.962615:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049291392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826153.962624:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826153.962642:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3c00/0x878a5eea00ced0e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced0db expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.962662:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3c00/0x878a5eea00ced0e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced0db expref: 14 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.962672:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3c00/0x878a5eea00ced0e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced0db expref: 14 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.962681:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3c00, rc 0) 00000100:00100000:1.0:1787826153.962716:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049291392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.962723:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787826153.963151:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826153.963166:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826153.963176:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced0e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826153.963261:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.963293:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.963318:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450139480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.963370:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049291520 00000100:00100000:3.0:1787826153.963374:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049291520 00000100:00100000:3.0:1787826153.963399:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787826153.963407:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049291520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.963580:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049291520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.963588:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787826153.963622:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.963653:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.963705:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.963718:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450139480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826153.963739:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049291648 00000100:00100000:3.0:1787826153.963745:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049291648 00000100:00100000:3.0:1787826153.963764:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787826153.963769:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049291648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.967125:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049291648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3338us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826153.967145:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787826153.967312:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826153.968882:0:192419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1787826153.969115:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1787826153.969155:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787826153.969169:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.969184:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826153.969196:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1787826153.969199:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb34df96000 from 1 10000000:01000000:0.0:1787826153.969202:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787826153.969257:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.969267:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.969280:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826153.969311:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.969617:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.969709:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb342682cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.972681:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049291776 00000100:00100000:1.0:1787826153.972705:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049291776 00000100:00100000:1.0:1787826153.972824:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787826153.972839:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049291776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826153.972864:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826153.972894:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce2c00/0x878a5eea00ced0f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced0e9 expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.972939:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce2c00/0x878a5eea00ced0f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced0e9 expref: 15 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.972953:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce2c00/0x878a5eea00ced0f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced0e9 expref: 15 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.972969:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2c00, rc 0) 00000100:00100000:1.0:1787826153.973078:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049291776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.973086:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787826153.973250:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826153.973275:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.973286:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced0f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826153.973316:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787826153.973383:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.973393:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826153.973403:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787826153.973406:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb34df96000 from 7 10000000:01000000:0.0:1787826153.973410:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826153.973441:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.973450:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.973459:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826153.973483:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.973530:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.973572:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb342682cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.973847:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049291904 00000100:00100000:1.0:1787826153.973854:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049291904 00000100:00100000:1.0:1787826153.973895:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787826153.973905:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049291904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826153.973917:0:192365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826153.973930:0:192365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce2800/0x878a5eea00ced0fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced0f7 expref: -99 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.973953:0:192365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce2800/0x878a5eea00ced0fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced0f7 expref: 16 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.973964:0:192365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce2800/0x878a5eea00ced0fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced0f7 expref: 16 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.973972:0:192365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2800, rc 0) 00000100:00100000:1.0:1787826153.974009:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049291904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.974015:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787826153.974281:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049291904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826153.974296:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0fe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.974305:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced0fe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826153.974419:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.974453:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.974485:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb342682cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.974662:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049292032 00000100:00100000:1.0:1787826153.974668:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049292032 00000100:00100000:1.0:1787826153.974704:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787826153.974712:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34441cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049292032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.974888:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34441cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049292032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.974896:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787826153.974974:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.975014:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.975073:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.975107:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480dfc900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.975202:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049292160 00000100:00100000:1.0:1787826153.975208:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049292160 00000100:00100000:1.0:1787826153.975243:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787826153.975250:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049292160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.975392:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049292160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.975400:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787826153.975585:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826153.976823:0:192420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787826153.977050:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787826153.977082:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826153.977094:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0fe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.977106:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0fe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826153.977117:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787826153.977121:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb481220000 from 52 10000000:01000000:1.0:1787826153.977124:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826153.977168:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.977178:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.977189:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.977216:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.977285:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.977459:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4815a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.982009:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049292288 00000100:00100000:0.0:1787826153.982032:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049292288 00000100:00100000:0.0:1787826153.982114:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787826153.982129:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049292288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826153.982154:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826153.982182:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64600/0x878a5eea00ced10c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced105 expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.982222:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64600/0x878a5eea00ced10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced105 expref: 17 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.982236:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64600/0x878a5eea00ced10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced105 expref: 17 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.982246:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64600, rc 0) 00000100:00100000:0.0:1787826153.982398:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049292288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (5112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.982407:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787826153.983916:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826153.983953:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.983969:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826153.984086:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826153.984159:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.984214:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.984301:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049292416 00000100:00100000:0.0:1787826153.984310:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049292416 00000100:00100000:0.0:1787826153.984406:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787826153.984417:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049292416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.984585:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049292416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.984594:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787826153.985146:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826153.985194:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826153.985264:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.985293:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.985366:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049292544 00000100:00100000:0.0:1787826153.985373:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049292544 00000100:00100000:0.0:1787826153.985413:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787826153.985422:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049292544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.985552:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049292544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.985560:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787826153.985715:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826153.986687:0:192421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1787826153.987213:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1787826153.987255:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826153.987270:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.987284:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826153.987296:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787826153.987300:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1787826153.987303:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787826153.987388:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.987398:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.987409:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826153.987438:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826153.987513:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826153.987564:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.988037:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049292672 00000100:00100000:1.0:1787826153.988047:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049292672 00000100:00100000:1.0:1787826153.988111:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787826153.988125:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049292672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826153.988144:0:192359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826153.988163:0:192359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3e00/0x878a5eea00ced11a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced113 expref: -99 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.988194:0:192359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3e00/0x878a5eea00ced11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced113 expref: 18 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.988207:0:192359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3e00/0x878a5eea00ced11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced113 expref: 18 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.988218:0:192359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3e00, rc 0) 00000100:00100000:1.0:1787826153.988286:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049292672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.988294:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787826153.988483:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826153.988504:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.988515:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826153.988604:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.988639:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.988675:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb48164df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.988739:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049292800 00000100:00100000:1.0:1787826153.988744:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049292800 00000100:00100000:1.0:1787826153.988782:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787826153.988790:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4726b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049292800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.988967:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4726b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049292800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.988976:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787826153.989057:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.989093:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826153.989152:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826153.989174:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb48164df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826153.989633:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049292928 00000100:00100000:1.0:1787826153.989640:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049292928 00000100:00100000:1.0:1787826153.989670:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787826153.989679:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a4bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049292928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.990667:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a4bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049292928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 982us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826153.990678:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826153.990799:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049292928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826153.992121:0:192422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1787826153.992529:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787826153.992578:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787826153.992592:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.992607:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826153.992619:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787826153.992622:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb481220000 from 7 10000000:01000000:1.0:1787826153.992626:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826153.992680:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.992689:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826153.992702:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826153.992744:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826153.992828:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826153.992872:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34898a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826153.992933:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049293056 00000100:00100000:0.0:1787826153.992942:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049293056 00000100:00100000:0.0:1787826153.993006:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826153.993020:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a4bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049293056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826153.993036:0:192361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826153.993053:0:192361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64200/0x878a5eea00ced128 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced121 expref: -99 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.993080:0:192361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64200/0x878a5eea00ced128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced121 expref: 19 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.993092:0:192361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64200/0x878a5eea00ced128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced121 expref: 19 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826153.993102:0:192361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64200, rc 0) 00000100:00100000:0.0:1787826153.993201:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a4bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049293056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826153.993209:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787826153.996284:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826153.996350:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826153.996525:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826153.996725:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826153.996822:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826153.996877:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480dfc900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826153.997756:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049293184 00000100:00100000:2.0:1787826153.997770:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049293184 00000100:00100000:2.0:1787826153.997858:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787826153.997870:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049293184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826153.998166:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049293184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826153.998175:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787826154.001459:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826154.001549:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826154.001657:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826154.001713:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480dfc900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826154.002076:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049293312 00000100:00100000:0.0:1787826154.002088:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049293312 00000100:00100000:0.0:1787826154.002172:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826154.002184:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049293312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826154.002387:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049293312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826154.002398:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787826154.002693:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826154.003849:0:192423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787826154.004216:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787826154.004249:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826154.004263:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.004279:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826154.004292:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787826154.004295:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb47bfd6800 from 52 10000000:01000000:1.0:1787826154.004298:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826154.004385:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.004395:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.004409:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826154.004441:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826154.004526:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826154.004578:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34898a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826154.005698:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049293440 00000100:00100000:3.0:1787826154.005712:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049293440 00000100:00100000:3.0:1787826154.005794:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787826154.005807:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049293440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826154.005827:0:192359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826154.005848:0:192359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8e200/0x878a5eea00ced136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced12f expref: -99 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.005879:0:192359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8e200/0x878a5eea00ced136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced12f expref: 20 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.005893:0:192359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8e200/0x878a5eea00ced136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced12f expref: 20 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.005908:0:192359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8e200, rc 0) 00000100:00100000:3.0:1787826154.005997:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049293440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826154.006006:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826154.006664:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826154.006691:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced136 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826154.006704:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced136 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826154.006832:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826154.006886:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826154.006931:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb48164df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826154.008176:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049293568 00000100:00100000:3.0:1787826154.008191:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049293568 00000100:00100000:3.0:1787826154.008267:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787826154.008279:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049293568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826154.008537:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049293568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826154.008545:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787826154.008753:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.008818:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.008889:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.008930:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826154.009027:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049293696 00000100:00100000:0.0:1787826154.009033:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049293696 00000100:00100000:0.0:1787826154.009069:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787826154.009078:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049293696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826154.009179:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049293696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826154.009186:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787826154.009293:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826154.011925:0:192424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1787826154.013249:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1787826154.013312:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826154.013357:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced136 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.013373:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced136 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826154.013395:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787826154.013399:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1787826154.013545:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787826154.013606:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.013617:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.013630:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826154.013666:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.013774:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.013835:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826154.014951:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049293824 00000100:00100000:3.0:1787826154.014966:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049293824 00000100:00100000:3.0:1787826154.015106:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787826154.015131:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049293824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826154.015153:0:192361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826154.015176:0:192361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8fa00/0x878a5eea00ced144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced13d expref: -99 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.015211:0:192361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8fa00/0x878a5eea00ced144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced13d expref: 21 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.015224:0:192361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8fa00/0x878a5eea00ced144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced13d expref: 21 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.015235:0:192361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8fa00, rc 0) 00000100:00100000:3.0:1787826154.015525:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049293824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826154.015538:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787826154.015650:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826154.015674:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced144 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.015685:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced144 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826154.015795:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.015838:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.021829:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826154.024052:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049293952 00000100:00100000:0.0:1787826154.024074:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049293952 00000100:00100000:0.0:1787826154.024198:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826154.024213:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049293952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826154.024840:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049293952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 627us (8998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826154.024851:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787826154.026707:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049293952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.026803:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.026889:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.026944:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049294080 00000100:00100000:2.0:1787826154.026952:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049294080 00000100:00100000:2.0:1787826154.027010:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787826154.027021:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049294080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.027266:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826154.033044:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049294080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6007us (6137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826154.033064:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787826154.033183:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826154.035741:0:192426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1787826154.036707:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1787826154.036755:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787826154.036772:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced144 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.036787:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced144 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826154.036802:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787826154.036806:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb47bfd6800 from 7 10000000:01000000:2.0:1787826154.036809:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826154.036871:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.036880:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.036895:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826154.036930:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.037028:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.037085:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049294208 00000100:00100000:2.0:1787826154.037093:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049294208 00000100:00100000:2.0:1787826154.037154:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787826154.037167:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4729f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049294208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826154.037185:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826154.037201:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf39a00/0x878a5eea00ced152 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced14b expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.037233:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf39a00/0x878a5eea00ced152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced14b expref: 22 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.037246:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf39a00/0x878a5eea00ced152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced14b expref: 22 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.037257:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39a00, rc 0) 00000100:00100000:2.0:1787826154.037296:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4729f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049294208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826154.037316:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787826154.037491:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826154.037520:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826154.037537:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced152 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.037547:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced152 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826154.037617:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.037646:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.037677:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049294336 00000100:00100000:2.0:1787826154.037681:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049294336 00000100:00100000:2.0:1787826154.037712:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787826154.037719:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049294336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.037868:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049294336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826154.037875:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787826154.037901:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826154.037912:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.037941:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.037994:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.038015:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049294464 00000100:00100000:2.0:1787826154.038019:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049294464 00000100:00100000:2.0:1787826154.038041:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787826154.038049:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a46f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049294464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.038142:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a46f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049294464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826154.038149:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787826154.038189:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826154.038202:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826154.044924:0:192427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787826154.045267:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787826154.045312:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826154.045364:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced152 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.045393:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced152 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826154.045597:0:6488:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1787826154.045601:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8eb46a873370 from 1 10000000:01000000:2.0:1787826154.045605:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787826154.045663:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.045673:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.045687:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826154.045719:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.045817:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.045870:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049294592 00000100:00100000:2.0:1787826154.045879:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049294592 00000100:00100000:2.0:1787826154.045940:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787826154.045952:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049294592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826154.045970:0:192359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826154.045989:0:192359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ced160 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced159 expref: -99 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.046016:0:192359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ced160 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced159 expref: 23 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.046033:0:192359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ced160 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced159 expref: 23 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.046044:0:192359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38800, rc 0) 00000100:00100000:2.0:1787826154.046082:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049294592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826154.046089:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787826154.046142:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344f5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826154.046170:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826154.046186:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced160 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.046196:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced160 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826154.046218:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787826154.046222:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced160 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.046228:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced160 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826154.046234:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787826154.046236:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8eb46a873370 from 1 10000000:01000000:2.0:1787826154.046238:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787826154.046252:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.046264:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.046271:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826154.046284:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.048581:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.048700:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344f5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826154.049152:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049294720 00000100:00100000:1.0:1787826154.049166:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049294720 00000100:00100000:1.0:1787826154.049239:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787826154.049251:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049294720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826154.049271:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826154.049295:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3800/0x878a5eea00ced16e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced167 expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.049359:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3800/0x878a5eea00ced16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced167 expref: 24 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.049372:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3800/0x878a5eea00ced16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced167 expref: 24 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.049394:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3800, rc 0) 00000100:00100000:1.0:1787826154.049484:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049294720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826154.049491:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787826154.051045:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826154.051076:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced16e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.051091:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced16e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826154.051218:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826154.051284:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826154.051388:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344f5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826154.053154:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049294848 00000100:00100000:1.0:1787826154.053171:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049294848 00000100:00100000:1.0:1787826154.053250:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787826154.053262:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049294848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826154.053492:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049294848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (2206us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826154.053501:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787826154.057374:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049294848:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787826154.057655:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787826154.057670:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced16e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.057684:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced16e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.324854:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826154.430656:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826154.430787:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042972800 00000100:00100000:2.0:1787826154.430802:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042972800 00000100:00100000:2.0:1787826154.430883:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:2.0:1787826154.430896:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+5:15163:x1874663042972800:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826154.430918:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826154.430943:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf38600/0x878a5eea00ced175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f101 expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.430979:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf38600/0x878a5eea00ced175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f101 expref: 6 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.430993:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf38600/0x878a5eea00ced175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f101 expref: 6 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.431004:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38600, rc 0) 00000100:00100000:2.0:1787826154.431083:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+6:15163:x1874663042972800:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 189us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826154.431091:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:2.0:1787826154.434515:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826154.436040:0:192359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042972928 00000100:00100000:1.0:1787826154.436060:0:192359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042972928 00000100:00100000:1.0:1787826154.436149:0:192359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:1.0:1787826154.436165:0:192359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+6:15163:x1874663042972928:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826154.436202:0:192359:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1787826154.436227:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826154.436233:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787826154.436237:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787826154.436240:0:192359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787826154.436243:0:192359:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 331 00000100:00100000:1.0:1787826154.443772:0:192359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7528148b-9bee-4d31-b597-8aae3b0b4982+6:15163:x1874663042972928:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 Request processed in 7598us (9260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826154.443907:0:192359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:3.0:1787826154.445882:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826154.446610:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042973056 00000100:00100000:1.0:1787826154.446621:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042973056 00000100:00100000:1.0:1787826154.446662:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 972 00000100:00100000:1.0:1787826154.446671:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663042973056:12345-192.168.203.47@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1787826154.446702:0:187906:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'a9ce6693-0634-46c5-bf21-5ca7d026d44e' at ffff8eb34b9e5000, cookie 0x878a5eea00cecffb 00010000:00080000:1.0:1787826154.446709:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp recovering/t330712482189 exp ffff8eb34b9e5000 cur 8221 last 1787826152 00010000:02000400:1.0:1787826154.446717:0:187906:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1787826154.446723:0:187906:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1787826154.446760:0:187906:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787826154.446907:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826154.446982:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042973056:12345-192.168.203.47@tcp:38:ll_cfg_requeue.0 Request processed in 310us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826154.446989:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 972 00000100:00100000:2.0:1787826154.449288:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826154.449612:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042973184 00000100:00100000:1.0:1787826154.449626:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042973184 00000100:00100000:1.0:1787826154.449694:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:1.0:1787826154.449706:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+6:15163:x1874663042973184:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826154.449722:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826154.449753:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce2400/0x878a5eea00ced17c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f108 expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.449782:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce2400/0x878a5eea00ced17c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f108 expref: 7 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.449793:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce2400/0x878a5eea00ced17c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f108 expref: 7 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826154.449802:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2400, rc 0) 00000100:00100000:1.0:1787826154.449868:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+7:15163:x1874663042973184:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 164us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826154.449875:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:2.0:1787826154.456447:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826154.456519:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826154.456545:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663041393408 00000100:00100000:3.0:1787826154.456576:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663041393408 00000100:00100000:3.0:1787826154.456650:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 973 00000100:00100000:3.0:1787826154.456662:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663041393408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00080000:3.0:1787826154.456684:0:188682:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 339302416389, current: 330712482189, replaying 00010000:00010000:3.0:1787826154.456694:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826154.456722:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8fe00/0x878a5eea00ced183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d64bee expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826154.456863:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042973312 00000100:00100000:3.0:1787826154.456867:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042973312 00000100:00100000:3.0:1787826154.456911:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:3.0:1787826154.456919:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+7:15163:x1874663042973312:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826154.457195:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+8:15163:x1874663042973312:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 275us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826154.457203:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00000004:00080000:3.0:1787826154.464028:0:188682:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7187us 00000100:00100000:0.0:1787826154.475230:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826154.479245:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042973440 00000100:00100000:3.0:1787826154.479265:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042973440 00000100:00100000:3.0:1787826154.479373:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:3.0:1787826154.479389:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+8:15163:x1874663042973440:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826154.479582:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+8:15163:x1874663042973440:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 195us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826154.479591:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:2.0:1787826154.496609:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826154.500749:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042973568 00000100:00100000:3.0:1787826154.500772:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042973568 00000100:00100000:3.0:1787826154.500857:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:3.0:1787826154.500872:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+8:15163:x1874663042973568:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826154.500896:0:192361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826154.500923:0:192361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8e400/0x878a5eea00ced18a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f10f expref: -99 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.500961:0:192361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8e400/0x878a5eea00ced18a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f10f expref: 9 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.500974:0:192361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8e400/0x878a5eea00ced18a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f10f expref: 9 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.500987:0:192361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8e400, rc 0) 00000100:00100000:3.0:1787826154.501077:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042973568:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 209us (4486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826154.501085:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 66 00000004:00200000:2.0:1787826154.505685:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00000004:00080000:2.0:1787826154.505741:0:188682:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x17e0:0x0], cookie = 0x878a5eea00cba2c0 00000004:00080000:2.0:1787826154.505746:0:188682:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x878a5eea00cba2c0 in new mfd 00010000:00010000:2.0:1787826154.505947:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8fe00/0x878a5eea00ced183 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.505972:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb34d1bd900) 00010000:00010000:2.0:1787826154.505976:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826154.505981:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8fe00/0x878a5eea00ced183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826154.506011:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8fe00, rc 0) 00010000:02000000:2.0:1787826154.506020:0:188682:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=157, val=2147483648*** 00000100:00100000:3.0:1787826154.510998:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826154.511146:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042973696 00000100:00100000:0.0:1787826154.511161:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042973696 00000100:00100000:0.0:1787826154.511231:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:0.0:1787826154.511245:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042973696:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826154.511560:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042973696:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 316us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826154.511569:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00010000:00020000:2.0:1787826154.515897:0:188682:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8eb348ffe300 x1874663041393408/t330712482189(330712482189) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:510/0 lens 520/664 e 0 to 0 dl 1787826165 ref 1 fl Interpret:/604/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826154.518148:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826154.518232:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042973824 00000100:00100000:3.0:1787826154.518248:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042973824 00000100:00100000:3.0:1787826154.518316:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:3.0:1787826154.518424:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042973824:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826154.518719:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042973824:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 393us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826154.518739:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:1.0:1787826154.547168:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826154.547991:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042973952 00000100:00100000:3.0:1787826154.548007:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042973952 00000100:00100000:3.0:1787826154.548088:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:3.0:1787826154.548100:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+9:15163:x1874663042973952:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826154.548116:0:192360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826154.548133:0:192360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00ced198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f116 expref: -99 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.548161:0:192360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00ced198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f116 expref: 10 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.548173:0:192360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00ced198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f116 expref: 10 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826154.548183:0:192360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8f200, rc 0) 00000100:00100000:3.0:1787826154.548255:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:15163:x1874663042973952:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 157us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826154.548263:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:1.0:1787826154.558215:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826154.558618:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042974080 00000100:00100000:3.0:1787826154.558634:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042974080 00000100:00100000:3.0:1787826154.558699:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:3.0:1787826154.558709:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:15163:x1874663042974080:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826154.558848:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+10:15163:x1874663042974080:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 139us (649us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826154.558858:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:2.0:1787826154.565651:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2388:x1874663041393408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 108975us (109207us total) trans 330712482189 rc 301/0 00000100:00100000:2.0:1787826154.565668:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 973 00010000:00010000:1.0:1787826155.353301:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826156.378203:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826156.379241:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049294976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826156.379359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826156.379435:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049294976 00000100:00100000:0.0:1787826156.379445:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049294976 00000100:00100000:0.0:1787826156.379519:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5769 00000100:00100000:0.0:1787826156.379531:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049294976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826156.379572:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826156.379625:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049294976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826156.379633:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5769 00000100:00080000:0.0:1787826156.379663:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826156.379723:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049294976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826156.383043:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049295104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826156.383150:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826156.383652:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049295104 00000100:00100000:0.0:1787826156.383663:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049295104 00000100:00100000:0.0:1787826156.383753:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5770 00000100:00100000:0.0:1787826156.383767:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049295104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826156.383812:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826156.383882:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049295104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826156.383890:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5770 00000100:00080000:0.0:1787826156.383925:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826156.384214:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049295104:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787826157.396744:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826157.820430:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826157.820471:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826157.820501:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826157.820536:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042974464 00000100:00100000:1.0:1787826157.820546:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042974464 00000100:00100000:1.0:1787826157.820602:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6997 00000100:00100000:1.0:1787826157.820613:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042974464:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826157.820681:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042974464:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826157.820689:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6997 00000100:00080000:1.0:1787826157.820724:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826157.821689:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042974336 00000100:00100000:3.0:1787826157.821697:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042974336 00000100:00100000:3.0:1787826157.821770:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 182 00000100:00100000:3.0:1787826157.821780:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042974336:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826157.821834:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042974336:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 56us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826157.821841:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 182 00000100:00100000:3.0:1787826157.821865:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042974208 00000100:00100000:3.0:1787826157.821869:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042974208 00000100:00100000:3.0:1787826157.821893:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00100000:3.0:1787826157.821900:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042974208:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826157.821923:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042974208:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826157.821929:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00080000:1.0:1787826157.822140:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826158.422068:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826158.422100:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049295232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826158.422170:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826158.422458:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826158.424299:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826158.424307:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826158.424311:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826158.424319:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8219 00000100:00100000:3.0:1787826158.424405:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049295360:0@lo:400:kworker.0 00000100:00080000:0.0:1787826158.424422:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826158.424431:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826158.424458:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb479962a00 x1874663049295488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826158.424478:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826158.424488:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826158.424492:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826158.424494:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826158.424498:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8219 00000100:00080000:0.0:1787826158.424500:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826158.424504:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb4727db000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826158.424516:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb479963480 x1874663049295744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826158.424545:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1787826158.424547:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826158.424553:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826158.424556:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787826158.424556:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049295616:0@lo:400:kworker.0 00000100:00080000:0.0:1787826158.424565:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8219 00000100:00080000:0.0:1787826158.424570:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826158.424574:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826158.424589:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b75500 x1874663049296000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826158.424597:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826158.424627:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826158.424631:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826158.424633:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826158.424637:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8219 00000100:00100000:3.0:1787826158.424639:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049295360 00000100:00080000:0.0:1787826158.424640:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826158.424647:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826158.424648:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049295360 00000100:00100000:0.0:1787826158.424660:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47a66d180 x1874663049296384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826158.424687:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787826158.424691:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826158.424693:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb34df97000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826158.424698:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb34df97000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826158.424714:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787826158.424728:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f747480 x1874663049296768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826158.424729:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049295360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.424772:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049295232 00000100:00100000:3.0:1787826158.424784:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049295360:12345-0@lo:400:kworker.0 Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826158.424792:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826158.424831:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049295616 00000100:00100000:3.0:1787826158.424835:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049295616 00000100:00100000:3.0:1787826158.424882:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787826158.424889:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049295616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.424909:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049295232 00000100:00100000:3.0:1787826158.424925:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049295616:12345-0@lo:400:kworker.0 Request processed in 36us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826158.424933:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787826158.424954:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12661 00000100:00080000:3.0:1787826158.424958:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826158.424963:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049295232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826158.424982:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049296256:0@lo:400:kworker.0 00000004:00000024:0.0:1787826158.424993:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:3.0:1787826158.425013:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826158.425044:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049295232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826158.425055:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12661 00000100:00100000:3.0:1787826158.425058:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049295616:0@lo:400:kworker.0 00000100:00100000:3.0:1787826158.425074:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049295360:0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.425085:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049296512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826158.425107:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049296256 00000100:00100000:3.0:1787826158.425111:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049296256 00000100:00100000:3.0:1787826158.425145:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6998 00000100:00100000:3.0:1787826158.425152:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049296256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.425210:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826158.425217:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049296256:12345-0@lo:400:kworker.0 Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826158.425226:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6998 00000100:00100000:3.0:1787826158.425241:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049296512 00000100:00100000:3.0:1787826158.425245:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049296512 00000100:00100000:0.0:1787826158.425255:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049295488:0@lo:38:kworker.0 00000100:00100000:0.0:1787826158.425283:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826158.425289:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6999 00000100:00100000:3.0:1787826158.425298:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049296512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.425306:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049295744:0@lo:38:kworker.0 00000100:00100000:0.0:1787826158.425638:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826158.425654:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049296512:12345-0@lo:400:kworker.0 Request processed in 355us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826158.425662:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6999 00000100:00100000:0.0:1787826158.425667:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049296000:0@lo:38:kworker.0 00000100:00100000:3.0:1787826158.425710:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049295488 00000100:00100000:3.0:1787826158.425715:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049295488 00000100:00100000:0.0:1787826158.425720:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826158.425741:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049295744 00000100:00100000:0.0:1787826158.425746:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049296384:0@lo:38:kworker.0 00000100:00100000:3.0:1787826158.425746:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049295744 00000100:00100000:3.0:1787826158.425766:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1787826158.425772:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049295488:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787826158.425797:0:188682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8225 last 0 00000020:00000080:3.0:1787826158.425829:0:188682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x878a5eea00ced19f 00000004:00100000:3.0:1787826158.425842:0:188682:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787826158.425894:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826158.425923:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049296768:0@lo:38:kworker.0 00000100:00100000:0.0:1787826158.425956:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826158.425987:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049296128:0@lo:400:kworker.0 00000100:00080000:3.0:1787826158.425999:0:188682:0:(import.c:65:import_set_state_nolock()) ffff8eb47a6a7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826158.426013:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826158.426042:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787826158.426050:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049295872:0@lo:400:kworker.0 00000100:00100000:3.0:1787826158.426054:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874663049295488:12345-0@lo:38:kworker.0 Request processed in 278us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826158.426062:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1787826158.426076:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049296384 00000100:00100000:0.0:1787826158.426080:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826158.426080:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049296384 00000100:00100000:3.0:1787826158.426094:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049296768 00000100:00100000:0.0:1787826158.426098:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049296640:0@lo:400:kworker.0 00000100:00100000:3.0:1787826158.426099:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049296768 00000100:00100000:3.0:1787826158.426109:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049295872 00000100:00100000:3.0:1787826158.426111:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049295872 00000100:00100000:3.0:1787826158.426129:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787826158.426135:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049295872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.426201:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826158.426238:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1787826158.426244:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049295744:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826158.426258:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8225 last 0 00000020:00000080:0.0:1787826158.426282:0:187904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x878a5eea00ced1a6 00000004:00100000:0.0:1787826158.426288:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826158.426307:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa5f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826158.426430:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874663049295744:12345-0@lo:38:kworker.0 Request processed in 183us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826158.426437:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1787826158.426452:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1787826158.426456:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049296384:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826158.426469:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8225 last 0 00000020:00000080:0.0:1787826158.426490:0:187904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x878a5eea00ced1ad 00000004:00100000:0.0:1787826158.426496:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826158.426510:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa59800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826158.426538:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874663049296384:12345-0@lo:38:kworker.0 Request processed in 80us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826158.426544:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1787826158.426557:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1787826158.426561:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049296768:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826158.426573:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8225 last 0 00000020:00000080:0.0:1787826158.426594:0:187904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x878a5eea00ced1b4 00000004:00100000:0.0:1787826158.426599:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826158.426611:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb477e04000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826158.426636:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049296768:12345-0@lo:38:kworker.0 Request processed in 73us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826158.426642:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1787826158.426660:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049296000 00000100:00100000:0.0:1787826158.426664:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049296000 00000100:00100000:0.0:1787826158.426685:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12662 00000100:00100000:0.0:1787826158.426690:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049296000:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826158.426712:0:8415:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8eb34b9e0800, cookie 0x878a5eea00ced002 00010000:00080000:0.0:1787826158.426717:0:8415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8eb34b9e0800 cur 8225 last 1787826152 00000004:00100000:0.0:1787826158.426726:0:8415:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826158.426739:0:8415:0:(import.c:65:import_set_state_nolock()) ffff8eb477e03000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1787826158.426861:0:192388:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1787826158.426866:0:192388:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 339302416389 00000020:00080000:2.0:1787826158.426871:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826158.426875:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 339302416389 00000020:00080000:2.0:1787826158.426878:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826158.426880:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 339302416389 00000100:00100000:0.0:1787826158.427018:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049296000:12345-0@lo:38:kworker.0 Request processed in 89us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826158.427026:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12662 00000100:00100000:0.0:1787826158.427051:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049296128 00000100:00100000:0.0:1787826158.427055:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049296128 00000100:00100000:0.0:1787826158.427080:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049296640 00000100:00100000:0.0:1787826158.427083:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049296640 00000100:00100000:0.0:1787826158.427444:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7000 00000100:00100000:0.0:1787826158.427454:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049296128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.427502:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049296128:12345-0@lo:400:kworker.0 Request processed in 50us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826158.427509:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7000 00000100:00100000:0.0:1787826158.427522:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7001 00000100:00100000:0.0:1787826158.427528:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049296640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.427554:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049296640:12345-0@lo:400:kworker.0 Request processed in 27us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826158.427559:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7001 00000100:00100000:0.0:1787826158.427621:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049296512:0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.427661:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049295232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826158.427687:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049296640:0@lo:400:kworker.0 00000100:00100000:0.0:1787826158.427696:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049296128:0@lo:400:kworker.0 00010000:00080000:0.0:1787826158.427735:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb479962a00 x1874663049295488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826158.427748:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 80 00000100:00080000:0.0:1787826158.429029:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8eb479962a00 x1874663049295488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826173 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826158.429042:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787826158.429047:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787826158.429051:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787826158.429057:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049295488:0@lo:38:kworker.0 00010000:00080000:0.0:1787826158.429086:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb479963480 x1874663049295744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826158.429303:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 80 00000100:00100000:3.0:1787826158.430207:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049295872:12345-0@lo:400:kworker.0 Request processed in 4066us (4121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826158.430220:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1787826158.430268:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826158.430286:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826158.430290:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826158.430338:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049296256:0@lo:400:kworker.0 00000100:00100000:1.0:1787826158.430575:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049295872:0@lo:400:kworker.0 00000100:00080000:0.0:1787826158.431536:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8eb479963480 x1874663049295744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826173 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826158.431547:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787826158.431551:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787826158.431555:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787826158.431560:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049295744:0@lo:38:kworker.0 00000100:00080000:0.0:1787826158.431586:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 80 00000100:00080000:0.0:1787826158.431596:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787826158.431599:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1787826158.431603:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 330712483740 gen 2 00000100:00080000:0.0:1787826158.431606:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff8eb48165c000 from lustre-MDT0000_UUID committed 330712483740 last 0 00000100:00080000:0.0:1787826158.431608:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1787826158.441095:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049296000:0@lo:38:kworker.0 00010000:00080000:3.0:1787826158.441141:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb47a66d180 x1874663049296384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826158.441158:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 80 00010000:00080000:0.0:1787826158.442103:0:192599:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1787826158.442109:0:192599:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1787826158.442114:0:192599:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1787826158.443788:0:192599:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1787826158.444645:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8eb47a66d180 x1874663049296384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826173 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826158.444658:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1787826158.444663:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1787826158.444668:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787826158.444674:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049296384:0@lo:38:kworker.0 00010000:00080000:3.0:1787826158.444721:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb44f747480 x1874663049296768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826158.444738:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 80 00000100:00080000:3.0:1787826158.444747:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787826158.444751:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787826158.444753:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34df97000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826158.444758:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049296768:0@lo:38:kworker.0 00000100:00100000:3.0:1787826158.444804:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049296896:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787826158.444862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826158.445422:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049296896 00000100:00100000:0.0:1787826158.445430:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049296896 00000100:00100000:0.0:1787826158.445475:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12663 00000100:00100000:0.0:1787826158.445494:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049296896:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787826158.445518:0:177386:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb479939500 x1874663049296896/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:514/0 lens 224/0 e 0 to 0 dl 1787826169 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826158.445534:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049296896:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 51us (672us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826158.445540:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12663 00000020:00080000:3.0:1787826158.445722:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826158.445727:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 339302416389 00000001:00100000:3.0:1787826158.944375:0:184693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787826158.945268:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787826158.945824:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:2.0:1787826158.957740:0:192640:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787826159.451034:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787826159.811012:0:192693:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826159.811262:0:192693:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826159.872031:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826159.872076:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826159.872108:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826159.872144:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042974848 00000100:00100000:0.0:1787826159.872156:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042974848 00000100:00100000:0.0:1787826159.872213:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7002 00000100:00100000:0.0:1787826159.872224:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042974848:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826159.872299:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042974848:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826159.872307:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7002 00000100:00100000:0.0:1787826159.872482:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042974720 00000100:00100000:0.0:1787826159.872486:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042974720 00000100:00100000:0.0:1787826159.872518:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 185 00000100:00100000:0.0:1787826159.872525:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042974720:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826159.872556:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042974720:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826159.872563:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 185 00000100:00080000:0.0:1787826159.872582:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826159.872587:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826159.873548:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042974592 00000100:00100000:2.0:1787826159.873556:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042974592 00000100:00100000:2.0:1787826159.873599:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:2.0:1787826159.873607:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2390:x1874663042974592:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826159.873646:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2390:x1874663042974592:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 41us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826159.873653:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 73 00010000:00010000:1.0:1787826160.468486:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826160.685279:0:192743:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826160.685662:0:192743:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787826161.492723:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049297024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826161.492791:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826161.492952:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049297024 00000100:00100000:2.0:1787826161.492960:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049297024 00000100:00100000:2.0:1787826161.493022:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5771 00000100:00100000:2.0:1787826161.493033:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049297024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826161.493485:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826161.493546:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049297024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 515us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826161.493554:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5771 00010000:00010000:1.0:1787826161.493642:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826161.493708:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049297152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826161.493743:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826161.493849:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049297152 00000100:00100000:1.0:1787826161.493854:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049297152 00000100:00100000:1.0:1787826161.493892:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5772 00000100:00100000:1.0:1787826161.493900:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049297152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826161.493919:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 3923492864 avail 3691970560 00000100:00080000:0.0:1787826161.493980:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826161.493984:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826161.494525:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049297152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 624us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826161.494533:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5772 00000100:00100000:0.0:1787826161.494607:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049297152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826161.495450:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049297024:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787826162.516486:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826163.540512:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826163.541605:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826163.541610:0:179516:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1787826163.541756:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049297280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826163.541793:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049297664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826163.541876:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049297408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826163.545964:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826163.546036:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049298176:0@lo:400:kworker.0 00000100:00100000:3.0:1787826163.546084:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826163.546109:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049298688:0@lo:400:kworker.0 00000100:00100000:3.0:1787826163.546130:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826163.546161:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826163.546169:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049298816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826163.546201:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826163.546237:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049297664 00000100:00100000:3.0:1787826163.546245:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049297664 00000100:00100000:3.0:1787826163.546292:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049298176 00000100:00100000:3.0:1787826163.546295:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049298176 00000100:00100000:3.0:1787826163.546314:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049298688 00000100:00100000:3.0:1787826163.546317:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049298688 00000100:00100000:3.0:1787826163.546349:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787826163.546359:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049297664:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826163.546387:0:187906:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb47993ad80 x1874663049297664/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:519/0 lens 224/0 e 0 to 0 dl 1787826174 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826163.546442:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049297664:12345-0@lo:400:kworker.0 Request processed in 83us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826163.546449:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787826163.546465:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787826163.546467:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826163.546471:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049298176:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826163.546479:0:187906:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb47993aa00 x1874663049298176/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:519/0 lens 224/0 e 0 to 0 dl 1787826174 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826163.546484:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049297920:0@lo:400:kworker.0 00000100:00100000:1.0:1787826163.546507:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826163.546507:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049298176:12345-0@lo:400:kworker.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826163.546513:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787826163.546523:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049297408 00000100:00100000:1.0:1787826163.546525:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049298432:0@lo:400:kworker.0 00000100:00100000:3.0:1787826163.546526:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049297408 00000100:00100000:3.0:1787826163.546542:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787826163.546547:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826163.546547:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049298688:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826163.546554:0:187906:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb479938e00 x1874663049298688/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:519/0 lens 224/0 e 0 to 0 dl 1787826174 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826163.546568:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826163.546574:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049297536:0@lo:400:kworker.0 00000100:00100000:1.0:1787826163.546598:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826163.546609:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049298048:0@lo:400:kworker.0 00000100:00100000:1.0:1787826163.546627:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826163.546644:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049298560:0@lo:400:kworker.0 00000100:00100000:1.0:1787826163.546679:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826163.546708:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049297920 00000100:00100000:1.0:1787826163.546712:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049297920 00000100:00100000:1.0:1787826163.546751:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049298432 00000100:00100000:1.0:1787826163.546754:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049298432 00000100:00100000:3.0:1787826163.547119:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049298688:12345-0@lo:400:kworker.0 Request processed in 571us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826163.547127:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787826163.547137:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049297536 00000100:00100000:3.0:1787826163.547140:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049297536 00000100:00100000:3.0:1787826163.547157:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787826163.547163:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049297408:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787826163.547171:0:187906:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb448cd4380 x1874663049297408/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:519/0 lens 224/0 e 0 to 0 dl 1787826174 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826163.547257:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787826163.547266:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049297536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.547983:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826163.548046:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049297792:0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.548081:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826163.548093:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049298304:0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.548115:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826163.548155:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049297280 00000100:00100000:2.0:1787826163.548160:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049297280 00000100:00100000:2.0:1787826163.548202:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787826163.548209:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049297280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.548248:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049297280:12345-0@lo:400:kworker.0 Request processed in 39us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826163.548257:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787826163.548301:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049298816 00000100:00100000:2.0:1787826163.548305:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049298816 00000100:00100000:2.0:1787826163.548340:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049298304 00000100:00100000:2.0:1787826163.548344:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049298304 00000100:00100000:2.0:1787826163.548363:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12664 00000100:00100000:2.0:1787826163.548685:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049298816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826163.548715:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:2.0:1787826163.548754:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049298816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 385us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826163.548761:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12664 00000100:00100000:2.0:1787826163.548774:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12665 00000100:00100000:2.0:1787826163.548781:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049298304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.548811:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049298304:12345-0@lo:400:kworker.0 Request processed in 31us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826163.548817:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12665 00000100:00100000:2.0:1787826163.548864:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049297280:0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.548878:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049298304:0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.548940:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049297792 00000100:00100000:2.0:1787826163.548944:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049297792 00000100:00100000:2.0:1787826163.548971:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787826163.548977:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049297792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.549069:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049297792:12345-0@lo:400:kworker.0 Request processed in 92us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826163.549076:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787826163.549110:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049297792:0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.549154:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049298816:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787826163.549169:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb477f67b80 x1874663049297664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826163.549178:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049297664:0@lo:400:kworker.0 00010000:00080000:2.0:1787826163.549262:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb34df15c00 x1874663049298176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826163.549272:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049298176:0@lo:400:kworker.0 00010000:00080000:2.0:1787826163.549440:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb472567b80 x1874663049298688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826163.549452:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049298688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.551142:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049298048 00000100:00100000:2.0:1787826163.551155:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049298048 00000100:00100000:2.0:1787826163.551449:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049298560 00000100:00100000:2.0:1787826163.551455:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049298560 00000100:00100000:2.0:1787826163.551488:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7003 00000100:00100000:2.0:1787826163.551498:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049297920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826163.553004:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049297408:12345-0@lo:400:kworker.0 Request processed in 5831us (6526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826163.553019:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787826163.553036:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7004 00000100:00100000:1.0:1787826163.553052:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049298432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826163.553086:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7005 00000100:00100000:3.0:1787826163.553093:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049298048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826163.553196:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049297536:12345-0@lo:400:kworker.0 Request processed in 5930us (6596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826163.553203:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787826163.553227:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7006 00000100:00100000:0.0:1787826163.553235:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049298560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826163.553268:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049298560:12345-0@lo:400:kworker.0 Request processed in 35us (6589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826163.553278:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7006 00000100:00100000:0.0:1787826163.553441:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049297536:0@lo:400:kworker.0 00000100:00100000:2.0:1787826163.560005:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049297920:12345-0@lo:400:kworker.0 Request processed in 8497us (13486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826163.560021:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7003 00000100:00080000:2.0:1787826163.560102:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826163.560108:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826163.560111:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826163.564360:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049298048:12345-0@lo:400:kworker.0 Request processed in 11257us (17721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826163.564376:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7005 00000100:00100000:0.0:1787826163.566420:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049298048:0@lo:400:kworker.0 00000100:00100000:0.0:1787826163.566442:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049298560:0@lo:400:kworker.0 00010000:00080000:0.0:1787826163.566458:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb477f65180 x1874663049297408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826163.566468:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049297408:0@lo:400:kworker.0 00000100:00100000:0.0:1787826163.566481:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049297920:0@lo:400:kworker.0 00000100:00100000:1.0:1787826163.567311:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049298432:12345-0@lo:400:kworker.0 Request processed in 14262us (20758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826163.567337:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7004 00000100:00100000:0.0:1787826163.571182:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049298432:0@lo:400:kworker.0 00010000:00010000:0.0:1787826164.564679:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826164.991920:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826164.991969:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826164.992110:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042975232 00000100:00100000:0.0:1787826164.992120:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042975232 00000100:00100000:0.0:1787826164.992203:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 192 00000100:00100000:0.0:1787826164.992216:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042975232:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826164.992291:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042975232:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 78us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826164.992299:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 192 00000100:00100000:2.0:1787826164.992353:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042975104 00000100:00100000:2.0:1787826164.992359:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042975104 00000100:00100000:2.0:1787826164.992399:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00100000:2.0:1787826164.992407:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042975104:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826164.992442:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042975104:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 36us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826164.992449:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00080000:3.0:1787826164.992911:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826164.995568:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826164.995685:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042975360 00000100:00100000:2.0:1787826164.995694:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042975360 00000100:00100000:2.0:1787826164.995838:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7007 00000100:00100000:2.0:1787826164.995849:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042975360:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826164.995925:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042975360:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 78us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826164.995932:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7007 00000100:00080000:3.0:1787826164.995993:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826165.588711:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826166.613630:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826166.613991:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826166.614020:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049298944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826166.614116:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826166.614317:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049298944 00000100:00100000:0.0:1787826166.614354:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049298944 00000100:00100000:0.0:1787826166.614436:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5773 00000100:00100000:0.0:1787826166.614449:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049298944:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826166.614464:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049299072:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826166.614490:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826166.614524:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826166.614537:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049298944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826166.614545:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5773 00000100:00100000:0.0:1787826166.614566:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049299072 00000100:00100000:0.0:1787826166.614569:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049299072 00000100:00100000:0.0:1787826166.614592:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5774 00000100:00100000:0.0:1787826166.614599:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049299072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826166.614616:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826166.614727:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049298944:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787826166.615009:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826166.615016:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826166.615078:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049299072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 478us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826166.615087:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5774 00000100:00100000:2.0:1787826166.615747:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049299072:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826167.636534:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826168.660945:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049299200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826168.661067:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826168.661145:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049299200 00000100:00100000:3.0:1787826168.661157:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049299200 00000100:00100000:3.0:1787826168.661232:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12666 00000100:00100000:3.0:1787826168.661254:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049299200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826168.661302:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00010000:00010000:0.0:1787826168.661380:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826168.662363:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049299328:0@lo:400:kworker.0 00000100:00100000:0.0:1787826168.662434:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826168.662527:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049299328 00000100:00100000:0.0:1787826168.662534:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049299328 00000100:00100000:0.0:1787826168.662585:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787826168.662594:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049299328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826168.662653:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049299328:12345-0@lo:400:kworker.0 Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826168.662661:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787826168.662719:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049299328:0@lo:400:kworker.0 00000100:00100000:3.0:1787826168.663793:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049299200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2532us (2717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826168.663808:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12666 00000100:00100000:2.0:1787826168.664029:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049299200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826168.664510:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049299456:0@lo:400:kworker.0 00000100:00080000:1.0:1787826168.664773:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826168.664779:0:172937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1787826168.664908:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049299712:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.664918:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826168.665040:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049299584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826168.665133:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049299840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826168.668351:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826168.668430:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049300352:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.668689:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049299968:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.668729:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826168.668759:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049300480:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.668791:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826168.668885:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826168.669041:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826168.669073:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049300096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826168.669154:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826168.669192:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826168.669202:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049300608:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.669234:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826168.669286:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049299456 00000100:00100000:2.0:1787826168.669296:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049299456 00000100:00100000:2.0:1787826168.669370:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049299840 00000100:00100000:2.0:1787826168.669374:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049299840 00000100:00100000:2.0:1787826168.669397:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049299584 00000100:00100000:2.0:1787826168.669400:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049299584 00000100:00100000:2.0:1787826168.669414:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049300608 00000100:00100000:2.0:1787826168.669416:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049300608 00000100:00100000:2.0:1787826168.669431:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787826168.669442:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049299456:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787826168.669463:0:188992:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb342776300 x1874663049299456/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:524/0 lens 224/0 e 0 to 0 dl 1787826179 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826168.669533:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049299456:12345-0@lo:400:kworker.0 Request processed in 93us (4615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826168.669542:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787826168.669568:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787826168.669574:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049299840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.669606:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049299840:12345-0@lo:400:kworker.0 Request processed in 32us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826168.669612:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787826168.669622:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787826168.669636:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049299584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.669667:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049299584:12345-0@lo:400:kworker.0 Request processed in 40us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826168.669673:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787826168.669683:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787826168.669689:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049300608:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787826168.669696:0:188992:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb34df15c00 x1874663049300608/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:524/0 lens 224/0 e 0 to 0 dl 1787826179 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826168.669723:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049300608:12345-0@lo:400:kworker.0 Request processed in 34us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826168.669728:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787826168.669995:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826168.670094:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049300224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826168.670126:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826168.670158:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049299712 00000100:00100000:0.0:1787826168.670163:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049299712 00000100:00100000:0.0:1787826168.670188:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049300224 00000100:00100000:0.0:1787826168.670191:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049300224 00000100:00100000:0.0:1787826168.670203:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787826168.670205:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049299584:0@lo:400:kworker.0 00000100:00100000:0.0:1787826168.670209:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049299712:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787826168.670219:0:188682:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb472564380 x1874663049299712/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:524/0 lens 224/0 e 0 to 0 dl 1787826179 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826168.670251:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787826168.670257:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049299712:12345-0@lo:400:kworker.0 Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826168.670259:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049300224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826168.670263:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:3.0:1787826168.670267:0:187906:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8eb472565500 x1874663049300224/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:524/0 lens 224/0 e 0 to 0 dl 1787826179 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826168.670301:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049300224:12345-0@lo:400:kworker.0 Request processed in 43us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826168.670307:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1787826168.670371:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826168.670635:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049299968 00000100:00100000:1.0:1787826168.670641:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049299968 00000100:00100000:1.0:1787826168.670681:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049300480 00000100:00100000:1.0:1787826168.670685:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049300480 00000100:00100000:1.0:1787826168.670705:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049300352 00000100:00100000:1.0:1787826168.670708:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049300352 00000100:00100000:1.0:1787826168.670728:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049300096 00000100:00100000:1.0:1787826168.670731:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049300096 00000100:00100000:1.0:1787826168.670753:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7008 00000100:00100000:1.0:1787826168.670761:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049299968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826168.670804:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049299968:12345-0@lo:400:kworker.0 Request processed in 45us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826168.670916:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7008 00000100:00100000:2.0:1787826168.671042:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7009 00000100:00100000:2.0:1787826168.671052:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049300480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.671089:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049300480:12345-0@lo:400:kworker.0 Request processed in 39us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826168.671096:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7009 00010000:00080000:0.0:1787826168.671122:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb476ca7480 x1874663049299712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826168.671134:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049299712:0@lo:400:kworker.0 00010000:00080000:0.0:1787826168.671146:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb476ca5c00 x1874663049300224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826168.671155:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049300224:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.671164:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7010 00000100:00100000:2.0:1787826168.671171:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049300352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826168.671202:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7011 00000100:00100000:2.0:1787826168.671203:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049300352:12345-0@lo:400:kworker.0 Request processed in 33us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826168.671209:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7010 00000100:00100000:0.0:1787826168.671210:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049300096:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787826168.671241:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb476ca7100 x1874663049300608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826168.671249:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049300096:12345-0@lo:400:kworker.0 Request processed in 40us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826168.671251:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049300608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826168.671255:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7011 00000100:00100000:2.0:1787826168.671263:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049299968:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.671275:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049300480:0@lo:400:kworker.0 00010000:00080000:2.0:1787826168.671290:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb476ca4380 x1874663049299456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826168.671298:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049299456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.671353:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049299840:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.671365:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049300352:0@lo:400:kworker.0 00000100:00100000:2.0:1787826168.671397:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049300096:0@lo:400:kworker.0 00000100:00080000:0.0:1787826168.673752:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826168.673766:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826169.684968:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826170.106808:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826170.106877:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826170.106917:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826170.107018:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042975616 00000100:00100000:3.0:1787826170.107033:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042975616 00000100:00100000:0.0:1787826170.107075:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042975744 00000100:00100000:0.0:1787826170.107085:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042975744 00000100:00100000:3.0:1787826170.107135:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 199 00000100:00100000:3.0:1787826170.107151:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042975616:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826170.107160:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7012 00000100:00100000:0.0:1787826170.107175:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042975744:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826170.107255:0:192360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042975488 00000100:00100000:2.0:1787826170.107262:0:192360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042975488 00000100:00100000:2.0:1787826170.107308:0:192360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00080000:1.0:1787826170.107313:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826170.107365:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826170.107368:0:192360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2391:x1874663042975488:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826170.107439:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042975616:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 291us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826170.107449:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 199 00000100:00100000:0.0:1787826170.114023:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042975744:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 6829us (7081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826170.114045:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7012 00000100:00100000:2.0:1787826170.114087:0:192360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2391:x1874663042975488:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 6766us (7203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826170.114100:0:192360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:1.0:1787826170.642726:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826170.643142:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042975872 00000100:00100000:3.0:1787826170.643152:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042975872 00000100:00100000:3.0:1787826170.643214:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 200 00000100:00100000:3.0:1787826170.643225:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042975872:12345-192.168.203.47@tcp:38:ptlrpcd_rcv.0 00010000:02000400:3.0:1787826170.643276:0:187904:0:(ldlm_lib.c:974:target_handle_reconnect()) lustre-MDT0000: Client a9ce6693-0634-46c5-bf21-5ca7d026d44e (at 192.168.203.47@tcp) reconnected, waiting for 2 clients in recovery for 0:54 00010000:00080000:3.0:1787826170.655814:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp recovering/t330712482189 exp ffff8eb34b9e5000 cur 8237 last 1787826170 00000004:00100000:3.0:1787826170.655850:0:187904:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.203.47@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1787826170.655875:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1787826170.656042:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826170.656202:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042975872:12345-192.168.203.47@tcp:38:ptlrpcd_rcv.0 Request processed in 12977us (13485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826170.656213:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 200 00000100:00100000:3.0:1787826170.658306:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826170.658630:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663041393408 00000100:00100000:2.0:1787826170.658640:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663041393408 00000100:00100000:2.0:1787826170.658731:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 978 00000100:00100000:2.0:1787826170.658741:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663041393408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00080000:2.0:1787826170.658758:0:188992:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 339302416389, current: 330712482189, replaying 00010000:00010000:2.0:1787826170.658766:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826170.658790:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ced1bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d64bee expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826170.658853:0:188992:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff8eb479939c00 x1874663041393408/t0(330712482189) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 520/3488 e 0 to 0 dl 1787826181 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00000400:2.0:1787826170.658863:0:188992:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff8eb479939c00 x1874663041393408/t330712482189(330712482189) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 520/3488 e 0 to 0 dl 1787826181 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00200000:2.0:1787826170.695607:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x17e0:0x0]: returning size 4096 00010000:00010000:2.0:1787826170.695680:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ced1bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.695698:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb472727400) 00010000:00010000:2.0:1787826170.695701:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826170.695705:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ced1bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.695728:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39000, rc 0) 00000100:00100000:2.0:1787826170.695989:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663041393408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 37247us (37745us total) trans 330712482189 rc 301/301 00000100:00100000:2.0:1787826170.696000:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 978 00000100:00100000:1.0:1787826170.703034:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826170.703142:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042965504 00000100:00100000:3.0:1787826170.703153:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042965504 00000100:00100000:3.0:1787826170.703268:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 979 00000100:00100000:3.0:1787826170.703280:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042965504:12345-192.168.203.47@tcp:101:multiop.0 00010000:00080000:3.0:1787826170.703302:0:187905:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 339302416389, current: 339302416387, replaying 00010000:00010000:3.0:1787826170.703311:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826170.703356:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ced1c2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f0d7 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826170.703763:0:187905:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x1bd2:0x0], cookie = 0x878a5eea00cecedc 00000004:00080000:3.0:1787826170.703767:0:187905:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x878a5eea00cecedc in new mfd 00010000:00010000:3.0:1787826170.703882:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ced1c2 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0d7 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.703896:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481693600) 00010000:00010000:3.0:1787826170.703899:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826170.703904:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ced1c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0d7 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.704088:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8ec00, rc 0) 00000100:00100000:3.0:1787826170.704157:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2388:x1874663042965504:12345-192.168.203.47@tcp:101:multiop.0 Request processed in 878us (1134us total) trans 339302416387 rc 301/301 00000100:00100000:3.0:1787826170.704165:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 979 00000100:00100000:0.0:1787826170.706229:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826170.706300:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042966912 00000100:00100000:3.0:1787826170.706309:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042966912 00000100:00100000:3.0:1787826170.706493:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 980 00000100:00100000:3.0:1787826170.706504:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2388:x1874663042966912:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00080000:3.0:1787826170.706526:0:187904:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 339302416389, current: 339302416389, replaying 00000100:00100000:3.0:1787826170.706545:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2388:x1874663042966912:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 43us (334us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826170.706552:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 980 00000020:00080000:2.0:1787826170.706587:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826170.706592:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 339302416389, next_transno: 339302416389 00010000:00080000:2.0:1787826170.706596:0:192388:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (339302416389) 00000020:00080000:2.0:1787826170.706599:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826170.706608:0:192388:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1874663042966912 t339302416389 from 192.168.203.47@tcp req@ffff8eb472567480 x1874663042966912/t0(339302416389) o36->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 528/0 e 0 to 0 dl 1787826181 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826170.706786:0:192388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.706802:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.706828:0:192388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.706841:0:192388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.706848:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.706855:0:192388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707212:0:192388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707220:0:192388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707226:0:192388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707231:0:192388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826170.707235:0:192388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707242:0:192388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707254:0:192388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb472727c00) 00010000:00010000:2.0:1787826170.707258:0:192388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826170.707262:0:192388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707268:0:192388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826170.707286:0:192388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000126133e9 reply state 000000009f7edd18 transno 339302416389 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707297:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.707303:0:192388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb472727e00) 00010000:00010000:2.0:1787826170.707305:0:192388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826170.707308:0:192388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1787826170.707425:0:192388:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1787826170.707440:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826170.707443:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 339302416390 00000020:00080000:2.0:1787826170.707446:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826170.707448:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 339302416390 00010000:00010000:1.0:1787826170.710315:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826170.710700:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826170.710776:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042967424 00000100:00100000:2.0:1787826170.710786:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042967424 00000100:00100000:2.0:1787826170.710989:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 981 00000100:00100000:2.0:1787826170.711000:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2388:x1874663042967424:12345-192.168.203.47@tcp:36:rm.0 00010000:00080000:2.0:1787826170.711020:0:188992:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 339302416390, current: 339302416390, replaying 00000100:00100000:2.0:1787826170.711039:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2388:x1874663042967424:12345-192.168.203.47@tcp:36:rm.0 Request processed in 42us (345us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826170.711046:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 981 00000020:00080000:3.0:1787826170.711083:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826170.711087:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 339302416390, next_transno: 339302416390 00010000:00080000:3.0:1787826170.711091:0:192388:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (339302416390) 00000020:00080000:3.0:1787826170.711094:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826170.711104:0:192388:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1874663042967424 t339302416390 from 192.168.203.47@tcp req@ffff8eb476ca4700 x1874663042967424/t0(339302416390) o36->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 512/0 e 0 to 0 dl 1787826181 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826170.711181:0:192388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711196:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711207:0:192388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711218:0:192388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711236:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711243:0:192388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711355:0:192388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711364:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711371:0:192388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711594:0:192388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711602:0:192388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711609:0:192388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711624:0:192388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826170.711629:0:192388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711641:0:192388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711653:0:192388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd3:0x0].0x0 (ffff8eb481693d00) 00010000:00010000:3.0:1787826170.711655:0:192388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826170.711659:0:192388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711666:0:192388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e800/0x878a5eea00ced1ec lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1bd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711692:0:192388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711698:0:192388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711703:0:192388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711708:0:192388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826170.711711:0:192388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711717:0:192388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711723:0:192388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481693000) 00010000:00010000:3.0:1787826170.711725:0:192388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826170.711728:0:192388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711737:0:192388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e600/0x878a5eea00ced1de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826170.711747:0:192388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b9b40db reply state 0000000015f75d02 transno 339302416390 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711756:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.711762:0:192388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb472727e00) 00010000:00010000:3.0:1787826170.711764:0:192388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826170.711766:0:192388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787826170.712110:0:192388:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787826170.712128:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826170.712131:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 339302416391 00000020:00080000:3.0:1787826170.712134:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826170.712136:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 339302416391 00000100:00100000:0.0:1787826170.715696:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826170.715764:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826170.717213:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042976000 00000100:00100000:3.0:1787826170.717288:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042976000 00000100:00100000:3.0:1787826170.717369:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042976128 00000100:00100000:3.0:1787826170.717373:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042976128 00000100:00100000:3.0:1787826170.717442:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 982 00000100:00100000:3.0:1787826170.717453:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042976000:12345-192.168.203.47@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787826170.717488:0:187905:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8eb472564a80 x1874663042976000/t0(0) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 328/0 e 0 to 0 dl 1787826181 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826170.717508:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042976000:12345-192.168.203.47@tcp:101:ldlm_lock_repla.0 Request processed in 58us (1824us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826170.717518:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 982 00000100:00100000:3.0:1787826170.717529:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 983 00000100:00100000:3.0:1787826170.717536:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042976128:12345-192.168.203.47@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787826170.717545:0:187905:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8eb472564000 x1874663042976128/t0(0) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 328/0 e 0 to 0 dl 1787826181 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826170.717554:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042976128:12345-192.168.203.47@tcp:101:ldlm_lock_repla.0 Request processed in 20us (1791us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826170.717559:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 983 00000020:00080000:2.0:1787826170.717639:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826170.717644:0:192388:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 339302416391 00010000:00080000:2.0:1787826170.717648:0:192388:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1787826170.717650:0:192388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787826170.717656:0:192388:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826170.717659:0:192388:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826170.717666:0:192388:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.47@tcp: req@ffff8eb472564a80 x1874663042976000/t0(0) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 328/0 e 0 to 0 dl 1787826181 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826170.717683:0:192388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826170.717708:0:192388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1f3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d64bee expref: -99 pid: 192388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.717734:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1f3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 13 pid: 192388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.717749:0:192388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1f3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 13 pid: 192388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.717756:0:192388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38a00, rc 0) 00010000:00080000:2.0:1787826170.717820:0:192388:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1787826170.717833:0:192388:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787826170.717835:0:192388:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787826170.717840:0:192388:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.47@tcp: req@ffff8eb472564000 x1874663042976128/t0(0) o101->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 328/0 e 0 to 0 dl 1787826181 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787826170.717852:0:192388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826170.717862:0:192388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ced1fa lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d64b3f expref: -99 pid: 192388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.717876:0:192388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ced1fa lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64b3f expref: 13 pid: 192388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.717888:0:192388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ced1fa lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64b3f expref: 13 pid: 192388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.717894:0:192388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39000, rc 0) 00010000:00080000:2.0:1787826170.717930:0:192388:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1787826170.717937:0:192388:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1787826170.719785:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826170.719875:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042976256 00000100:00100000:2.0:1787826170.719884:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042976256 00000100:00100000:2.0:1787826170.720074:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 201 00000100:00100000:2.0:1787826170.720085:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:2388:x1874663042976256:12345-192.168.203.47@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1787826170.720103:0:188992:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb476ca6680 x1874663042976256/t0(0) o400->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 224/0 e 0 to 0 dl 1787826181 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826170.720126:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:2388:x1874663042976256:12345-192.168.203.47@tcp:400:ptlrpcd_rcv.0 Request processed in 45us (351us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826170.720133:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 201 00010000:00080000:3.0:1787826170.720176:0:192388:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1787826170.720437:0:192388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 80, last_transno is 343597383680 00000001:00100000:2.0:1787826170.725916:0:192354:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000001:00100000:2.0:1787826170.725932:0:192354:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1787826170.725965:0:192354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416390 is committed 00000001:00080000:3.0:1787826170.726100:0:192388:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1787826170.726154:0:192388:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1787826170.726174:0:192388:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8eb479939500 x1874663049296896/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:526/0 lens 224/0 e 1 to 0 dl 1787826181 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826170.726485:0:192388:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.47@tcp: req@ffff8eb476ca6680 x1874663042976256/t0(0) o400->a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp:526/0 lens 224/0 e 0 to 0 dl 1787826181 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826170.726507:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787826170.726527:0:3616:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8eb477f65880 x1874663049296896/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1787826186 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826170.726539:0:3616:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8eb477f65880 x1874663049296896/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1787826186 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826170.726548:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826170.726573:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00010000:02000000:3.0:1787826170.726575:0:192388:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:16, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1787826170.726584:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005bef9733): req@ffff8eb46ea69880 x1874663049275776/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826138 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826170.726603:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049296896:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787826170.726759:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826170.726771:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049300736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826170.726830:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826170.726897:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826170.726942:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049300736 00000100:00100000:1.0:1787826170.726949:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049300736 00000100:00100000:1.0:1787826170.726987:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049275776 00000100:00100000:1.0:1787826170.726990:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049275776 00000100:00100000:1.0:1787826170.727011:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12667 00000100:00100000:1.0:1787826170.727020:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049300736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826170.727081:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:1.0:1787826170.727129:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049300736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826170.727136:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12667 00000100:00100000:1.0:1787826170.727156:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12668 00000100:00100000:1.0:1787826170.727162:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049275776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826170.727173:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:1.0:1787826170.727202:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049275776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826170.727207:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12668 00000100:00100000:1.0:1787826170.727252:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049275776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826170.727279:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049300736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787826170.729868:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.729897:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.729908:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.729915:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826170.729921:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.729931:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.729960:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb472727e00) 00010000:00010000:0.0:1787826170.729964:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826170.729971:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.729978:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00ced1d7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.730024:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.730031:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.730037:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.730041:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826170.730044:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.730050:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.730058:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb472727e00) 00010000:00010000:0.0:1787826170.730061:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826170.730064:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.730071:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f800/0x878a5eea00ced1e5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826170.730892:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826170.731144:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042974976 00000100:00100000:1.0:1787826170.731160:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042974976 00000100:00100000:1.0:1787826170.731452:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 984 00000100:00100000:1.0:1787826170.731465:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+8:158321:x1874663042974976:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826170.731561:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826170.731592:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ced201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f11d expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.731904:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced208 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.732144:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.732158:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826170.732218:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787826170.732233:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826170.732270:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.732297:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ced201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f11d expref: 10 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.732319:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced208 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f11d expref: 9 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.732353:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:1.0:1787826170.732356:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826170.732360:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2600, rc 0) 00000100:00100000:1.0:1787826170.732435:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:158321:x1874663042974976:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 972us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826170.732442:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 984 00000100:00100000:2.0:1787826170.739297:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826170.739440:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042976384 00000100:00100000:0.0:1787826170.739457:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042976384 00000100:00100000:0.0:1787826170.739533:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 985 00000100:00100000:0.0:1787826170.739548:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:158321:x1874663042976384:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826170.739593:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:0.0:1787826170.739712:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:158321:x1874663042976384:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 165us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826170.739720:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 985 00000100:00100000:0.0:1787826170.744830:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826170.745464:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042976512 00000100:00100000:2.0:1787826170.745479:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042976512 00000100:00100000:2.0:1787826170.745565:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 986 00000100:00100000:2.0:1787826170.745579:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158321:x1874663042976512:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826170.745657:0:188682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:2.0:1787826170.745770:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158321:x1874663042976512:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 193us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826170.745779:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 986 00000100:00100000:1.0:1787826170.752179:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826170.752770:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042976640 00000100:00100000:0.0:1787826170.752788:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042976640 00000100:00100000:0.0:1787826170.752867:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5775 00000100:00100000:0.0:1787826170.752882:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158321:x1874663042976640:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826170.752931:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826170.753033:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158321:x1874663042976640:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 153us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826170.753042:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5775 00000100:00100000:1.0:1787826170.755457:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826170.755571:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042976768 00000100:00100000:0.0:1787826170.755584:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042976768 00000100:00100000:0.0:1787826170.755691:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22550 00000100:00100000:0.0:1787826170.755702:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2388:x1874663042976768:12345-192.168.203.47@tcp:8:lfs.0 00010000:00080000:0.0:1787826170.755751:0:43896:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a9ce6693-0634-46c5-bf21-5ca7d026d44e@192.168.203.47@tcp t0 exp 0000000000000000 cur 8237 last 0 00000020:00000080:0.0:1787826170.755791:0:43896:0:(genops.c:1385:class_connect()) connect: client a9ce6693-0634-46c5-bf21-5ca7d026d44e, cookie 0x878a5eea00ced20f 00002000:00100000:0.0:1787826170.755808:0:43896:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a9ce6693-0634-46c5-bf21-5ca7d026d44e/ffff8eb47a4ed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787826170.755839:0:43896:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787826170.755943:0:43896:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787826170.755987:0:43896:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa5c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826170.756088:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042976768:12345-192.168.203.47@tcp:8:lfs.0 Request processed in 386us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826170.756097:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22550 00000100:00100000:1.0:1787826170.763727:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826170.765575:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042976896 00000100:00100000:2.0:1787826170.765598:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042976896 00000100:00100000:2.0:1787826170.765717:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5776 00000100:00100000:2.0:1787826170.765732:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158321:x1874663042976896:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:2.0:1787826170.765770:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826170.765889:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158321:x1874663042976896:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 160us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826170.765897:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5776 00000100:00080000:1.0:1787826170.767034:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000080:1.0:1787826170.769988:0:192388:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb65b85783e10 00100000:10000000:1.0:1787826170.770009:0:192388:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1787826170.771906:0:192756:0:(mdd_orphans.c:363:mdd_orphan_key_test_and_delete()) Found orphan [0x20001a9e3:0x1bd2:0x0] count 1, skip it 00000004:00080000:2.0:1787826170.772293:0:192374:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x1862:0x0] 00000100:00100000:2.0:1787826170.772374:0:192374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192374:1874663049300864:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787826170.772509:0:192376:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x17e7:0x0] 00000100:00100000:3.0:1787826170.772538:0:192376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192376:1874663049300992:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787826170.772578:0:192374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826170.772630:0:192376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826170.772650:0:192374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb48164d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826170.772659:0:192376:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45890d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826170.772880:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049300864 00000100:00100000:1.0:1787826170.772890:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049300864 00000100:00100000:1.0:1787826170.773093:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049300992 00000100:00100000:1.0:1787826170.773097:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049300992 00000100:00080000:2.0:1787826170.773179:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826170.773185:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826170.774008:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22551 00000100:00100000:3.0:1787826170.774028:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:192374:x1874663049300864:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787826170.774072:0:43903:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6273 -> diff = -31 00000100:00100000:0.0:1787826170.774079:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22552 00002000:02000040:3.0:1787826170.774079:0:43903:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6243 to 0x280000401:6273) 00000100:00100000:0.0:1787826170.774096:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:192376:x1874663049300992:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787826170.774116:0:43901:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6209 -> diff = -90 00002000:02000040:0.0:1787826170.774121:0:43901:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6120 to 0x2c0000401:6209) 00002000:00010000:1.0:1787826170.787416:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1881:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.787437:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.787459:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1881:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.787465:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1881:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.787473:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.787491:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.787504:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.787513:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.787542:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826170.787778:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.787788:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.787797:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.787802:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.787812:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.787831:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.787839:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced216 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.787869:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.787871:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.787874:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826170.788535:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1880:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.788543:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.788556:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1880:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.788560:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1880:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.788566:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.789187:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.789201:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.789209:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.789307:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.789421:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x187f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.789427:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.789438:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187f:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.789442:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.789447:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.789463:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.789472:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.789480:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.792898:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826170.792918:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.792937:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.792944:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.792964:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.792991:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.793000:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00ced21d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.793035:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.793040:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.793047:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.793050:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.793058:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.793068:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.793077:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.793079:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.793081:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.793843:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826170.793859:0:43903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a52a778b/0x878a5eea00ced224 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.794060:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x187e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.794068:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.794082:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187e:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.794087:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.794094:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.794109:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.794136:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.794144:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.798027:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.798049:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.798067:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.798073:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.798085:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.798113:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.798128:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.798130:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.798133:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.798259:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826170.798270:0:43903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cb2dc7f/0x878a5eea00ced22b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.798363:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1841:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.798373:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798389:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1841:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.798394:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1841:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826170.798403:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.798403:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798424:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798435:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798450:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798475:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826170.798642:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826170.798650:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.798660:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.798664:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.798674:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.798690:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.798698:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00ced232 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.798701:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1840:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.798711:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.798720:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.798722:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1840:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:0.0:1787826170.798723:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.798727:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.798728:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1840:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.798734:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798745:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798753:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798760:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798778:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.798821:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x183f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.798826:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798836:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183f:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.798839:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.798843:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798853:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798862:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798870:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798883:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826170.798921:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x183e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.798926:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798934:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183e:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.798937:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.798940:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798949:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798958:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798965:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.798976:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787826170.799194:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826170.799201:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799210:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.799213:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799221:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799239:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799247:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced239 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799264:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826170.799267:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799273:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.799277:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799284:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799293:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799300:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced240 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799313:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.799317:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799340:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.799343:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799351:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.799361:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.799363:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.799369:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.799373:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced247 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799387:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.799388:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.799390:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826170.799446:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x183d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.799453:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799462:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183d:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.799465:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.799469:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799478:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799486:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799494:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799519:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.799567:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x183c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.799572:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799734:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183c:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.799737:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.799741:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799750:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799758:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799765:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799819:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826170.799867:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x183b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.799872:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799880:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183b:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.799883:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.799886:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799895:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799902:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.799909:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799952:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826170.799958:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799966:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.799970:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799978:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799992:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.799999:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced24e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800024:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826170.800028:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800036:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.800039:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800048:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800059:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800066:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced255 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800078:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.800081:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800090:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.800093:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800102:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800111:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800119:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.800120:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.800122:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.800471:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x187d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.800477:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800488:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187d:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.800491:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.800495:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800507:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800522:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800530:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800553:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826170.800681:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.800689:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.800697:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.800701:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.800709:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.800722:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.800730:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003395a97/0x878a5eea00ced263 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.800747:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.800749:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.800751:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.800796:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x187c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.800803:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800812:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187c:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.800815:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.800820:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800829:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800838:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800846:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800909:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826170.800949:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x187b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.800954:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800963:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187b:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.800966:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.800971:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800981:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800989:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.800998:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801023:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787826170.801031:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826170.801036:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801043:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.801048:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801056:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801067:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801075:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb8d52a/0x878a5eea00ced26a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801088:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.801092:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801099:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.801103:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801111:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801133:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801142:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000886d256e/0x878a5eea00ced271 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801154:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.801156:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.801158:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.801199:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x187a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.801204:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801211:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187a:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.801214:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x187a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.801217:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801226:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801233:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801239:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801252:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826170.801289:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1879:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.801295:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801308:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1879:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.801311:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1879:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.801315:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801345:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801354:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801361:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801374:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787826170.801380:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826170.801384:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801391:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.801394:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801402:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801417:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801425:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094c34c91/0x878a5eea00ced278 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801438:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.801441:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801448:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.801451:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801459:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801469:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801476:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00ced27f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801488:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.801490:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.801492:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.801533:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1878:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.801539:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801548:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1878:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.801551:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1878:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.801555:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801563:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801570:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801825:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801841:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.801849:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.801853:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801861:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.801864:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801878:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801891:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801899:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef0bd820/0x878a5eea00ced286 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801912:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.801914:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.801915:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.801960:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1877:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.801966:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801974:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1877:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.801977:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1877:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.801981:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801990:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.801998:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802017:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802029:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.802034:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.802037:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802044:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.802047:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802055:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802064:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802071:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456440ad/0x878a5eea00ced28d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802081:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802082:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802084:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.802116:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1876:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.802121:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802129:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1876:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.802132:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1876:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.802136:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802145:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802153:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802161:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802171:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.802176:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.802179:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802185:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.802188:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802194:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802205:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802212:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c90d7b0/0x878a5eea00ced294 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802224:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802226:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802228:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.802266:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1875:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.802271:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802280:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1875:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.802283:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1875:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.802287:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802296:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802304:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802313:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802350:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.802357:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.802361:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802368:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.802372:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802380:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802390:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802399:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2a4bb8/0x878a5eea00ced29b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802412:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802414:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802416:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.802457:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1874:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.802463:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802471:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1874:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.802474:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1874:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.802477:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802485:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802491:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802498:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802508:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.802514:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.802517:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802524:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.802527:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802535:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802546:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802559:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064d450b8/0x878a5eea00ced2a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802651:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802653:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802656:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.802700:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1873:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.802705:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802713:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1873:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.802716:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1873:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.802720:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802728:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802736:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802744:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802757:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.802764:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.802767:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802775:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.802778:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802787:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802798:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802805:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000258c21ba/0x878a5eea00ced2a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802817:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802819:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802821:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.802862:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1872:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.802867:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802875:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1872:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.802878:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1872:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.802883:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802898:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802906:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802914:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802926:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.802932:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.802936:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802943:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.802946:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802955:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802966:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802974:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005fb1500/0x878a5eea00ced2b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.802987:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802989:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.802991:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.803030:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1871:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.803035:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803042:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1871:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.803045:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1871:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.803049:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803057:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803064:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803071:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803084:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.803090:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.803093:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803104:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.803106:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803113:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803121:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803128:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f86338e/0x878a5eea00ced2b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803138:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803140:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803141:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.803183:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1870:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.803188:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803195:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1870:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.803198:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1870:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.803202:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803211:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803219:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803226:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803238:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.803244:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.803248:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803255:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.803258:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803265:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803275:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803283:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00ced2be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803296:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803298:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803300:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.803364:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x186f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.803370:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803378:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186f:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.803382:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.803386:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803395:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803403:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803410:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803423:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.803429:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.803432:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803439:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.803443:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803457:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803467:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803475:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b0236c7/0x878a5eea00ced2c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803488:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803490:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803492:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.803530:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x186e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.803536:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803544:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186e:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.803547:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.803551:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803560:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803569:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803732:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803746:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.803753:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.803757:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803764:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.803767:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803774:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803785:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803793:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2fd0344/0x878a5eea00ced2cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803807:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803809:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803811:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.803853:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x186d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.803859:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803867:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186d:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.803870:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.803874:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803883:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803891:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803899:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803911:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826170.803917:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.803920:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803928:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.803931:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803939:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803949:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803958:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4accf9/0x878a5eea00ced2d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.803970:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803972:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.803974:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.804098:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.804107:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826170.804167:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x186c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804172:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804181:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186c:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804184:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804188:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804198:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804206:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804213:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804234:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826170.804276:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x186b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804281:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804290:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186b:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804293:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804297:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804308:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804316:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804347:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804361:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787826170.804399:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x186a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804404:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804412:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186a:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804416:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x186a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804420:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804428:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804435:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804443:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804455:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787826170.804492:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1869:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804498:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804506:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1869:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804509:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1869:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804514:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804523:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804531:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804539:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804549:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787826170.804600:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1868:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804605:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804621:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1868:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804625:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1868:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804629:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804638:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804645:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804652:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804661:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1787826170.804699:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1867:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804704:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804712:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1867:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804715:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1867:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804718:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804726:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804734:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804742:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804751:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1787826170.804788:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1866:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804794:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804801:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1866:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804804:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1866:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804808:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804817:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804825:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804832:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804841:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1787826170.804881:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1865:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804886:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804895:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1865:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804897:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1865:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804902:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804911:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804919:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804927:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804942:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1787826170.804977:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1864:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.804982:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.804990:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1864:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.804993:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1864:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.804997:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805138:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805149:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805156:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805165:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1787826170.805204:0:43903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1863:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826170.805210:0:43903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805218:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1863:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:2.0:1787826170.805221:0:43903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1863:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826170.805225:0:43903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805233:0:43903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805241:0:43903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805249:0:43903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.805258:0:43903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00080000:2.0:1787826170.805285:0:43903:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6242 00000100:00100000:2.0:1787826170.805443:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:192374:x1874663049300864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 31418us (32861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826170.805455:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22551 00000100:00100000:2.0:1787826170.805538:0:192374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192374:1874663049300864:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787826170.805557:0:192374:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1881:0x0] from OST, last_created [0x280000401:0x1881:0x0]last_used is [0x280000401:0x1862:0x0] 00000100:00100000:2.0:1787826170.805734:0:192374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192374:1874663049301248:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787826170.805782:0:192374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826170.805807:0:192374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450139c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826170.805831:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049301248 00000100:00100000:2.0:1787826170.805839:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049301248 00000100:00100000:2.0:1787826170.805891:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22553 00000100:00100000:2.0:1787826170.805902:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:192374:x1874663049301248:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787826170.805949:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6274 00010000:00010000:0.0:1787826170.806268:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1787826170.806280:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.806293:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.806298:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.806308:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.806346:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.806355:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00ced2da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826170.806388:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826170.806404:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049301120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826170.806448:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826170.806604:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1787826170.806612:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806629:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.806632:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806641:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806660:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806667:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005576b96/0x878a5eea00ced2e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806685:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1787826170.806689:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806696:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.806700:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806707:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806716:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806723:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002363fcde/0x878a5eea00ced2e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806735:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787826170.806739:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806747:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.806750:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806757:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806767:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806775:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00ced2ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806789:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787826170.806794:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806801:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.806804:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806812:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806821:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806830:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced2f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806842:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787826170.806846:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806853:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.806856:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806864:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806874:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806881:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00ced2fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806894:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826170.806898:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806905:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.806909:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806916:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806926:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806933:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00ced304 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806944:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826170.806948:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806955:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.806958:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806966:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806975:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806983:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00ced30b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.806997:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826170.807001:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.807302:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826170.807315:0:43901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00ced25c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826170.807384:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049301120 00000100:00100000:1.0:1787826170.807740:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049301120 00000100:00100000:1.0:1787826170.807810:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5777 00000100:00100000:1.0:1787826170.807821:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049301120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826170.807853:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 896 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826170.807940:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049301120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826170.807947:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5777 00000100:00100000:1.0:1787826170.808031:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049301120:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1787826170.808182:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x183a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.808203:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808209:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.808214:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808218:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183a:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.808222:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x183a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826170.808224:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808229:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808239:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808244:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808248:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00ced312 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808253:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808261:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808267:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.808271:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808272:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826170.808276:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.808279:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808292:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808302:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808310:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00ced319 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.808314:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1839:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.808318:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808320:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.808336:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808343:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.808347:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808350:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1839:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.808354:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1839:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826170.808355:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808358:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808366:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808374:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808375:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc5972f/0x878a5eea00ced320 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808383:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808398:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.808400:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808400:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.808402:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.808411:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826170.808417:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787826170.808419:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808422:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.808427:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.808430:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808437:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808447:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808454:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00ced327 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.808462:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1838:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.808466:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808468:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.808469:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.808471:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.808474:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1838:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.808477:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1838:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826170.808479:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.808481:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808489:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808496:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808507:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808529:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826170.808549:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.808553:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808561:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.808565:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.808568:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1837:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.808573:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808580:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1837:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.808583:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1837:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.808587:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808595:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808602:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808650:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808664:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808670:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00ced32e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.808685:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.808687:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.808688:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.808818:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808841:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.808883:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1836:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.808889:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808898:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1836:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.808901:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1836:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.808905:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808915:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808923:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808931:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808946:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787826170.808953:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826170.808957:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808964:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826170.808968:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808976:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.808993:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809002:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced335 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809015:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826170.809018:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809024:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826170.809027:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809034:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809044:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809052:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced33c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809064:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809066:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809069:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.809083:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826170.809112:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1835:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.809117:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809125:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1835:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.809128:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1835:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.809132:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809141:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809150:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809157:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809177:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.809214:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1834:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.809219:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809226:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1834:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.809229:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1834:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.809234:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809249:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809257:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809265:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809278:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787826170.809285:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826170.809289:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809296:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826170.809300:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809309:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809319:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809351:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced343 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.809359:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.809363:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809364:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809366:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809368:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.809371:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.809374:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.809387:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.809398:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.809405:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00ced34a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.809408:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1833:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.809413:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.809418:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809420:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1833:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:3.0:1787826170.809420:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.809422:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809424:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1833:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.809428:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809437:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809444:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809452:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809473:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.809511:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1832:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.809516:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809529:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1832:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.809533:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1832:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.809537:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809546:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809555:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809563:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809576:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787826170.809582:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826170.809586:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809592:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826170.809595:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809602:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809635:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809643:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced351 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809657:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.809657:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809660:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809667:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826170.809670:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809678:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809688:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809696:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00ced358 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809711:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809714:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809716:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826170.809757:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1831:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.809763:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809772:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1831:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.809776:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1831:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.809780:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809788:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809796:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809804:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809818:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826170.809824:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826170.809826:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.809835:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.809846:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.809851:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.809864:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1830:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.809869:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809876:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1830:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.809878:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1830:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.809882:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809890:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809897:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809903:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809915:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826170.809921:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826170.809924:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809931:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826170.809934:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809940:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809950:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809956:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00ced366 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.809970:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809972:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.809973:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826170.809987:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:192374:x1874663049301248:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4081us (4200us total) trans 34359738464 rc 0/0 00000100:00100000:2.0:1787826170.809997:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22553 00002000:00010000:1.0:1787826170.810010:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x182f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.810020:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810027:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810030:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182f:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.810038:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.810047:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810054:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810059:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810070:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00ced35f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810074:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810088:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810099:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826170.810101:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826170.810105:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810108:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.810117:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.810121:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810131:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810143:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.810149:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x182e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826170.810152:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00ced36d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810156:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810177:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182e:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.810181:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.810184:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810187:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826170.810189:0:192374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192374:1874663049301248:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1787826170.810192:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.810196:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810198:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.810205:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826170.810212:0:192374:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1881:0x0]-[0x280000401:0x18a1:0x0] 00010000:00010000:1.0:1787826170.810213:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810234:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826170.810262:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.810266:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.810272:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x182d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826170.810274:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826170.810276:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.810278:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810285:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182d:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:3.0:1787826170.810287:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810288:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.810293:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810301:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810309:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810316:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810379:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826170.810415:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1787826170.810421:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x182c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826170.810422:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810431:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810435:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.810442:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810444:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182c:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.810451:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.810458:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810461:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810471:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810479:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810481:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810501:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00ced37b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810502:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810530:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826170.810535:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.810538:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826170.810548:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.810552:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810561:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810573:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810582:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00ced382 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.810585:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x182b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.810595:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.810600:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.810604:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.810605:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182b:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:0.0:1787826170.810607:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.810611:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826170.810675:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.810686:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00ced374 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.810699:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.810701:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.810703:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.810751:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.814496:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.814524:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.814538:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.814548:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.814730:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.814900:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x182a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.814907:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.814919:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182a:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.814923:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x182a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.814927:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.814936:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.814944:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.814951:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.814984:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826170.814993:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815002:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.815015:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815026:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815045:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815054:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec399062/0x878a5eea00ced389 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815088:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826170.815091:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815098:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.815101:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815108:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815118:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815125:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.815127:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.815129:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.815263:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826170.815268:0:43901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006869c1cd/0x878a5eea00ced390 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.815380:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1829:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.815386:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815395:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1829:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.815399:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1829:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.815403:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815413:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815421:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815428:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815557:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826170.815563:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815571:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.815655:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815664:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815676:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.815685:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.815686:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.815688:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.815728:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826170.815734:0:43901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00ced397 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.815781:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826170.815796:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1828:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.815802:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815812:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1828:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.815815:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1828:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.815820:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815829:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815838:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815853:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815903:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.815946:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1827:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.815952:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815961:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1827:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.815964:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1827:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.815968:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815977:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815985:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.815993:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816087:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826170.816095:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816104:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.816107:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816115:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816128:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816136:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00ced39e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816152:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.816156:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816164:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.816167:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816174:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816184:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816192:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.816194:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.816196:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.816231:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826170.816236:0:43901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b72d46/0x878a5eea00ced3a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.816296:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1826:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.816302:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816310:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1826:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.816313:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1826:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.816317:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.816390:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.816434:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816444:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816452:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816496:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826170.816529:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826170.816535:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.816542:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1825:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826170.816543:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826170.816547:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816547:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816556:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1825:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:0.0:1787826170.816557:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816560:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1825:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.816565:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.816569:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.816582:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c1de34c/0x878a5eea00ced3ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826170.816597:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.816598:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826170.816600:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.816651:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816661:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816669:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816693:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826170.816736:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1824:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.816742:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816750:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1824:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.816753:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1824:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.816757:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816766:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816775:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816788:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816838:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826170.816888:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1823:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.816893:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816900:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1823:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.816903:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1823:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.816906:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816914:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816921:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.816929:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816957:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826170.816963:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826170.816964:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.816973:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.816974:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.816980:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.816991:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.816995:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.816997:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.817011:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.817024:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.817032:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f0831b9/0x878a5eea00ced3ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.817050:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826170.817055:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.817062:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826170.817066:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.817073:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.817094:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.817103:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826170.817105:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.817109:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826170.817112:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.817118:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013ffaf80/0x878a5eea00ced3b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.817136:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.817138:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.817140:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826170.817178:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826170.817183:0:43901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced3c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826170.817248:0:43901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1822:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826170.817253:0:43901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.817262:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1822:0x0].0x0 since=8237s v=(0 0) 00010000:00010000:1.0:1787826170.817265:0:43901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1822:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826170.817269:0:43901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.817279:0:43901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.817288:0:43901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.817295:0:43901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826170.817431:0:43901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787826170.817934:0:43901:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6119 00000100:00100000:1.0:1787826170.818097:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:192376:x1874663049300992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 44000us (45462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826170.818109:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22552 00010000:00010000:2.0:1787826170.818823:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826170.818834:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.818847:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826170.818852:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.818864:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.818887:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.818895:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a00b0c4f/0x878a5eea00ced3c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826170.818925:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.818927:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826170.818929:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826170.819175:0:192376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192376:1874663049300992:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787826170.819199:0:192376:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1841:0x0] from OST, last_created [0x2c0000401:0x1841:0x0]last_used is [0x2c0000401:0x17e7:0x0] 00000100:00100000:3.0:1787826170.819319:0:192376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192376:1874663049301504:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787826170.819355:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826170.819373:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049301376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826170.819400:0:192376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826170.819416:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826170.819440:0:192376:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45890d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826170.819473:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049301504 00000100:00100000:3.0:1787826170.819481:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049301504 00000100:00100000:3.0:1787826170.819541:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22554 00000100:00100000:3.0:1787826170.819552:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:192376:x1874663049301504:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787826170.819606:0:43897:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6210 00010000:00010000:0.0:1787826170.820144:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826170.820163:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049301376 00000100:00100000:0.0:1787826170.820169:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049301376 00000100:00100000:0.0:1787826170.820240:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5778 00000100:00100000:0.0:1787826170.820250:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049301376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826170.820269:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579392 pending 896 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826170.820365:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049301376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826170.820372:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5778 00000100:00100000:1.0:1787826170.820478:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049301376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826170.826015:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:192376:x1874663049301504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6452us (6604us total) trans 4294975535 rc 0/0 00000100:00100000:2.0:1787826170.826032:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22554 00000100:00100000:3.0:1787826170.826095:0:192376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192376:1874663049301504:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787826170.826117:0:192376:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1841:0x0]-[0x2c0000401:0x1861:0x0] 00000100:00100000:1.0:1787826171.733264:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049301632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826171.733357:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826171.733601:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826171.733710:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049301632 00000100:00100000:2.0:1787826171.733720:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049301632 00000100:00100000:2.0:1787826171.733779:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5779 00000100:00100000:2.0:1787826171.733789:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049301632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826171.733812:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00080000:3.0:1787826171.733890:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826171.734068:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826171.734079:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049301760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826171.734111:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826171.734140:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049301760 00000100:00100000:0.0:1787826171.734144:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049301760 00000100:00100000:0.0:1787826171.734172:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5780 00000100:00100000:0.0:1787826171.734179:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049301760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826171.734190:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826171.734222:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049301760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826171.734229:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5780 00000100:00100000:0.0:1787826171.734275:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049301760:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787826171.734395:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826171.745359:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049301632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11559us (11991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826171.745375:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5779 00000100:00100000:1.0:1787826171.749534:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049301632:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826172.756518:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826173.781424:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826173.782429:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049301888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826173.782497:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826173.782570:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049301888 00000100:00100000:0.0:1787826173.782577:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049301888 00000100:00100000:0.0:1787826173.782634:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12669 00000100:00100000:0.0:1787826173.782643:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049301888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826173.783343:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826173.783507:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049301888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 863us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826173.783515:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12669 00000100:00100000:0.0:1787826173.783574:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049301888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826173.783925:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049302016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.783966:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826173.784004:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049302528:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.784029:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826173.784047:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049303040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.784068:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826173.784089:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826173.784094:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049302144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.784117:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826173.784135:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049302656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.784157:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826173.784179:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049303168:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.784201:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826173.784366:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049302528 00000100:00100000:0.0:1787826173.784759:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049303040 00000100:00100000:0.0:1787826173.784766:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049303040 00000100:00100000:0.0:1787826173.784804:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049302144 00000100:00100000:0.0:1787826173.784808:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049302144 00000100:00100000:0.0:1787826173.784839:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787826173.784847:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049303040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.784897:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049303040:12345-0@lo:400:kworker.0 Request processed in 51us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826173.784904:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787826173.784919:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787826173.784925:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049302144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.784953:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049302144:12345-0@lo:400:kworker.0 Request processed in 28us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826173.784959:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787826173.784980:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049302656 00000100:00100000:0.0:1787826173.784984:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049302656 00000100:00100000:0.0:1787826173.785008:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12670 00000100:00100000:0.0:1787826173.785014:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049302656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.785048:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049302656:12345-0@lo:400:kworker.0 Request processed in 34us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826173.785054:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12670 00000100:00100000:0.0:1787826173.785073:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049303168 00000100:00100000:0.0:1787826173.785077:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049303168 00000100:00100000:0.0:1787826173.785102:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7013 00000100:00100000:0.0:1787826173.785109:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049303168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.785141:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049303168:12345-0@lo:400:kworker.0 Request processed in 32us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826173.785148:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7013 00000100:00080000:0.0:1787826173.785167:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826173.785171:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826173.785188:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049302272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826173.785297:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049302528 00000100:00100000:1.0:1787826173.785351:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787826173.785358:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049302528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826173.786346:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049302528:12345-0@lo:400:kworker.0 Request processed in 986us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826173.786355:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787826173.786556:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049302016 00000100:00100000:3.0:1787826173.786561:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049302016 00000100:00100000:3.0:1787826173.786607:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787826173.786614:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049302016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.786662:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049302016:12345-0@lo:400:kworker.0 Request processed in 49us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826173.786668:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787826173.786776:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826173.787315:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826173.789542:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049302784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.789624:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826173.789835:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049302784 00000100:00100000:1.0:1787826173.789844:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049302784 00000100:00100000:1.0:1787826173.789904:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7014 00000100:00100000:1.0:1787826173.789914:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049302784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.790006:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049302272 00000100:00100000:3.0:1787826173.790010:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049302272 00000100:00100000:3.0:1787826173.790042:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787826173.790048:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049302272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826173.790124:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049302784:12345-0@lo:400:kworker.0 Request processed in 211us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826173.790131:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7014 00000100:00080000:1.0:1787826173.790158:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826173.790162:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826173.792647:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049302272:12345-0@lo:400:kworker.0 Request processed in 2588us (7420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826173.792663:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787826173.793840:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049302400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.794040:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826173.794079:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049302912:0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.794107:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826173.794134:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049303424:0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.794159:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826173.794337:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049302400 00000100:00100000:1.0:1787826173.794346:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049302400 00000100:00100000:3.0:1787826173.794350:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049302144:0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.794372:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049302656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.794392:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049303168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.794407:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049302016:0@lo:400:kworker.0 00000100:00100000:1.0:1787826173.794421:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049303424 00000100:00100000:3.0:1787826173.794423:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049302528:0@lo:400:kworker.0 00000100:00100000:1.0:1787826173.794427:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049303424 00000100:00100000:3.0:1787826173.794440:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049303040:0@lo:400:kworker.0 00000100:00100000:1.0:1787826173.794457:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787826173.794468:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049302400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826173.794534:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049302400:12345-0@lo:400:kworker.0 Request processed in 68us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826173.794544:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787826173.794563:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787826173.794570:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049303424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826173.794609:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049303424:12345-0@lo:400:kworker.0 Request processed in 39us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826173.794615:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:1.0:1787826173.794635:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826173.795024:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049302400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826173.795038:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049303424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.797995:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049302912 00000100:00100000:0.0:1787826173.798010:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049302912 00000100:00100000:0.0:1787826173.798080:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7015 00000100:00100000:0.0:1787826173.798091:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049302912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.798180:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049302912:12345-0@lo:400:kworker.0 Request processed in 91us (4071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826173.798187:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7015 00000100:00100000:0.0:1787826173.798254:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049302912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.798300:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049302784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.798311:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049303296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.798383:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826173.798411:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049303296 00000100:00100000:0.0:1787826173.798416:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049303296 00000100:00100000:0.0:1787826173.798443:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7016 00000100:00100000:0.0:1787826173.798449:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049303296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.798481:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049303296:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826173.798488:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7016 00000100:00100000:0.0:1787826173.798518:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049303296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826173.798547:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049302272:0@lo:400:kworker.0 00000100:00080000:1.0:1787826173.798700:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787826174.804810:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826175.236740:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826175.236794:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826175.236834:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826175.236868:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826175.236895:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826175.236984:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042977152 00000100:00100000:1.0:1787826175.236994:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042977152 00000100:00100000:1.0:1787826175.237066:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042977280 00000100:00100000:1.0:1787826175.237070:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042977280 00000100:00100000:1.0:1787826175.237094:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 208 00000100:00100000:1.0:1787826175.237105:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2392:x1874663042977152:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826175.237180:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2392:x1874663042977152:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 76us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826175.237188:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 208 00000100:00100000:1.0:1787826175.237209:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 209 00000100:00100000:1.0:1787826175.237216:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042977280:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826175.237240:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042977280:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826175.237246:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 209 00000100:00080000:0.0:1787826175.237451:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826175.237455:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826175.237815:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042977024 00000100:00100000:2.0:1787826175.237821:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042977024 00000100:00100000:2.0:1787826175.237865:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:2.0:1787826175.237872:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2391:x1874663042977024:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826175.237919:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2391:x1874663042977024:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 47us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826175.237926:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:2.0:1787826175.237958:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042977536 00000100:00100000:2.0:1787826175.237963:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042977536 00000100:00100000:2.0:1787826175.237991:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042977408 00000100:00100000:2.0:1787826175.237994:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042977408 00000100:00100000:2.0:1787826175.238015:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7017 00000100:00100000:2.0:1787826175.238021:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042977536:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826175.238045:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042977536:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826175.238051:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7017 00000100:00100000:2.0:1787826175.238062:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7018 00000100:00100000:2.0:1787826175.238068:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042977408:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826175.238090:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042977408:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 22us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826175.238096:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7018 00000100:00080000:0.0:1787826175.238307:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826175.238311:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826175.828595:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826175.828619:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049303552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826175.828689:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826175.829034:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049303552 00000100:00100000:0.0:1787826175.829044:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049303552 00000100:00100000:0.0:1787826175.829106:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12671 00000100:00100000:0.0:1787826175.829116:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049303552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826175.829152:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:0.0:1787826175.829200:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049303552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826175.829208:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12671 00000100:00100000:1.0:1787826175.829402:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049303680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826175.829434:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826175.829485:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049303552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826175.829556:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049303680 00000100:00100000:0.0:1787826175.829561:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049303680 00000100:00100000:0.0:1787826175.829622:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5781 00000100:00100000:0.0:1787826175.829630:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049303680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826175.829651:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826175.829690:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049303680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826175.829700:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5781 00000100:00080000:1.0:1787826175.829911:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826175.829938:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049303680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787826175.830217:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826175.830427:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826175.830439:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049303808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826175.830478:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826175.830563:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049303808 00000100:00100000:2.0:1787826175.830570:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049303808 00000100:00100000:2.0:1787826175.830628:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5782 00000100:00100000:2.0:1787826175.830637:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049303808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826175.830658:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826175.830704:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049303808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826175.830710:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5782 00000100:00100000:2.0:1787826175.830746:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049303808:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787826175.830881:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787826176.350113:0:184693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738464 is committed 00000001:00080000:2.0:1787826176.360097:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975535 is committed 00000001:00100000:2.0:1787826176.360177:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000100:00100000:0.0:1787826176.852520:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826176.852543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049303936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826176.852623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826176.852819:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049304064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826176.852858:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826176.853144:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826176.853708:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049303936 00000100:00100000:2.0:1787826176.853717:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049303936 00000100:00100000:1.0:1787826176.853851:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049304064 00000100:00100000:1.0:1787826176.853856:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049304064 00000100:00100000:2.0:1787826176.853929:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5783 00000100:00100000:2.0:1787826176.853939:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049303936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826176.853962:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826176.854033:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049303936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826176.854041:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5783 00000100:00100000:2.0:1787826176.854087:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049303936:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787826176.859537:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826176.859549:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826176.862943:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5784 00000100:00100000:1.0:1787826176.862963:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049304064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826176.862991:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826176.863080:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049304064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (10221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826176.863087:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5784 00000100:00100000:0.0:1787826176.863179:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049304064:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1787826177.772094:0:192958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1787826177.876923:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826178.900991:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049304192:0@lo:400:kworker.0 00000100:00100000:3.0:1787826178.901014:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049304448:0@lo:400:kworker.0 00010000:00010000:0.0:1787826178.901128:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826178.901527:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049304576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.904403:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826178.904403:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826178.904467:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826178.904499:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049304704:0@lo:400:kworker.0 00000100:00100000:1.0:1787826178.904500:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049305088:0@lo:400:kworker.0 00000100:00100000:1.0:1787826178.904553:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826178.904569:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826178.904599:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049305216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826178.904620:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049304192 00000100:00100000:2.0:1787826178.904630:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826178.904633:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049304192 00000100:00100000:2.0:1787826178.904672:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049305728:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.904706:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826178.904707:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787826178.904721:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049304192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.904763:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049304320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826178.904799:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049304192:12345-0@lo:400:kworker.0 Request processed in 80us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826178.904807:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826178.904813:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787826178.904827:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049304832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826178.904862:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049304448 00000100:00100000:0.0:1787826178.904866:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049304448 00000100:00100000:0.0:1787826178.904900:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049304576 00000100:00100000:0.0:1787826178.904903:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049304576 00000100:00100000:0.0:1787826178.904917:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049304704 00000100:00100000:0.0:1787826178.904919:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049304704 00000100:00100000:0.0:1787826178.904932:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049305216 00000100:00100000:0.0:1787826178.904934:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049305216 00000100:00100000:0.0:1787826178.904944:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049305728 00000100:00100000:0.0:1787826178.904946:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049305728 00000100:00100000:0.0:1787826178.904955:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049304320 00000100:00100000:0.0:1787826178.904958:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049304320 00000100:00100000:0.0:1787826178.904972:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787826178.904979:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049304448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826178.905020:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049304448:12345-0@lo:400:kworker.0 Request processed in 42us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826178.905027:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787826178.905041:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787826178.905047:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049304576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826178.905074:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049304576:12345-0@lo:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826178.905081:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826178.905085:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787826178.905100:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787826178.905107:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049304704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.905118:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049305344:0@lo:400:kworker.0 00000100:00100000:0.0:1787826178.905140:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049304704:12345-0@lo:400:kworker.0 Request processed in 33us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826178.905147:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787826178.905154:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826178.905163:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787826178.905172:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049305216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.905179:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049305856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826178.905230:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049305216:12345-0@lo:400:kworker.0 Request processed in 60us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826178.905237:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787826178.905250:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787826178.905256:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049305728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.907853:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826178.907996:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787826178.908146:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049304320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.908243:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049304320:12345-0@lo:400:kworker.0 Request processed in 237us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826178.908252:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787826178.908303:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049304832 00000100:00100000:2.0:1787826178.908314:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049304832 00000100:00100000:2.0:1787826178.908377:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049305344 00000100:00100000:2.0:1787826178.908381:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049305344 00000100:00100000:2.0:1787826178.908395:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049305856 00000100:00100000:2.0:1787826178.908397:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049305856 00000100:00100000:2.0:1787826178.908407:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12672 00000100:00100000:2.0:1787826178.908413:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049304832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.908450:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049304832:12345-0@lo:400:kworker.0 Request processed in 37us (3374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826178.908456:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12672 00000100:00100000:2.0:1787826178.908469:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12673 00000100:00100000:2.0:1787826178.908474:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049305344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.908500:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049305344:12345-0@lo:400:kworker.0 Request processed in 26us (3349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826178.908506:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12673 00000100:00100000:2.0:1787826178.908515:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12674 00000100:00100000:2.0:1787826178.908520:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049305856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826178.908549:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:2.0:1787826178.908597:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049305856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826178.908604:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12674 00000100:00100000:2.0:1787826178.908677:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049304320:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.908689:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049304832:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.908698:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049305344:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.908712:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049305856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826178.909349:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049304192:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.909369:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049304704:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.909381:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049305216:0@lo:400:kworker.0 00000100:00080000:2.0:1787826178.912391:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826178.912405:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826178.912578:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049305728:12345-0@lo:400:kworker.0 Request processed in 7313us (7867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826178.912599:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787826178.912612:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049305728:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.913564:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049305088 00000100:00100000:2.0:1787826178.913578:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049305088 00000100:00100000:2.0:1787826178.913974:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7019 00000100:00100000:2.0:1787826178.913990:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049305088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826178.914055:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049305600:0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.914070:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049305088:12345-0@lo:400:kworker.0 Request processed in 87us (9518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826178.914076:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7019 00000100:00100000:1.0:1787826178.914097:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826178.914123:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049305600 00000100:00100000:2.0:1787826178.914127:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049305600 00000100:00100000:1.0:1787826178.914144:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049304576:0@lo:400:kworker.0 00000100:00100000:1.0:1787826178.914156:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049305088:0@lo:400:kworker.0 00000100:00100000:3.0:1787826178.914202:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049304448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826178.914211:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049304960:0@lo:400:kworker.0 00000100:00100000:3.0:1787826178.914238:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826178.914260:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049305472:0@lo:400:kworker.0 00000100:00100000:3.0:1787826178.914283:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826178.914344:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049304960 00000100:00100000:3.0:1787826178.914350:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049304960 00000100:00100000:1.0:1787826178.915380:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049305472 00000100:00100000:1.0:1787826178.915390:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049305472 00000100:00080000:0.0:1787826178.917572:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826178.917587:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826178.917883:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7020 00000100:00100000:2.0:1787826178.917901:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049305600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826178.918049:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049305600:12345-0@lo:400:kworker.0 Request processed in 154us (3951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826178.918058:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7020 00000100:00100000:2.0:1787826178.918127:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975535 gen 2 00000100:00100000:2.0:1787826178.918165:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049305600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826178.918463:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7021 00000100:00100000:3.0:1787826178.918474:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049304960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826178.918522:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049304960:12345-0@lo:400:kworker.0 Request processed in 51us (4283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826178.918529:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7021 00000100:00100000:3.0:1787826178.918572:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049304960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826178.924475:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7022 00000100:00100000:1.0:1787826178.924496:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049305472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826178.924674:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049305472:12345-0@lo:400:kworker.0 Request processed in 185us (10389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826178.924684:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7022 00000100:00100000:3.0:1787826178.925181:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738464 gen 2 00000100:00100000:3.0:1787826178.925211:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049305472:0@lo:400:kworker.0 00000001:02000400:2.0:1787826179.616974:0:193007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1787826179.924566:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826180.347721:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826180.347776:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826180.347818:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826180.347854:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826180.347880:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826180.347982:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042977920 00000100:00100000:1.0:1787826180.347995:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042977920 00000100:00100000:1.0:1787826180.348076:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042977792 00000100:00100000:1.0:1787826180.348080:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042977792 00000100:00100000:1.0:1787826180.348112:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 216 00000100:00100000:1.0:1787826180.348125:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042977920:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826180.348224:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042977920:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 101us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826180.348232:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 216 00000100:00100000:1.0:1787826180.348257:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 217 00000100:00100000:1.0:1787826180.348263:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2390:x1874663042977792:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826180.348287:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:2390:x1874663042977792:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826180.348292:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 217 00000100:00080000:0.0:1787826180.348592:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826180.348598:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826180.348853:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042978176 00000100:00100000:3.0:1787826180.348860:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042978176 00000100:00100000:3.0:1787826180.348913:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042978048 00000100:00100000:3.0:1787826180.348917:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042978048 00000100:00080000:0.0:1787826180.349014:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826180.349018:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826180.349053:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7023 00000100:00100000:3.0:1787826180.349064:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2390:x1874663042978176:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826180.349263:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2390:x1874663042978176:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 201us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826180.349271:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7023 00000100:00100000:3.0:1787826180.349289:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7024 00000100:00100000:3.0:1787826180.349295:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042978048:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826180.349323:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2390:x1874663042978048:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826180.349361:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7024 00000100:00100000:2.0:1787826180.349851:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042977664 00000100:00100000:2.0:1787826180.349859:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042977664 00000100:00100000:2.0:1787826180.349926:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:2.0:1787826180.349937:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2390:x1874663042977664:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826180.349992:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2390:x1874663042977664:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 57us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826180.350000:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:2.0:1787826180.948579:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826180.948612:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826180.948612:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049306112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826180.948629:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049305984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826180.948925:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826180.953494:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826180.953552:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049306240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826180.954171:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826180.954317:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049305984 00000100:00100000:0.0:1787826180.954342:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049305984 00000100:00100000:0.0:1787826180.954876:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12675 00000100:00100000:0.0:1787826180.955044:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049305984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826180.955098:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:0.0:1787826180.955187:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049305984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 299us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826180.955195:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12675 00000100:00100000:1.0:1787826180.955315:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049305984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826180.957288:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826180.957480:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826180.957592:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049306112 00000100:00100000:2.0:1787826180.957603:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049306112 00000100:00100000:0.0:1787826180.957630:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049306240 00000100:00100000:0.0:1787826180.957637:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049306240 00000100:00100000:2.0:1787826180.957704:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5785 00000100:00100000:2.0:1787826180.957720:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049306112:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826180.957746:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5786 00000100:00100000:0.0:1787826180.957755:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049306240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826180.957793:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826180.957867:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049306240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826180.957878:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5786 00002000:00000024:2.0:1787826180.959210:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826180.959349:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049306112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1631us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826180.959361:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5785 00000100:00080000:3.0:1787826180.959481:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826180.959490:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826180.959559:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049306240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826180.959681:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049306112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826181.313322:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826181.313493:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042978304 00000100:00100000:1.0:1787826181.313509:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042978304 00000100:00100000:1.0:1787826181.313612:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 987 00000100:00100000:1.0:1787826181.313627:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:158791:x1874663042978304:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:1.0:1787826181.313681:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:1.0:1787826181.313778:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:158791:x1874663042978304:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 153us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826181.313787:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 987 00000100:00100000:0.0:1787826181.332439:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826181.333130:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042978432 00000100:00100000:1.0:1787826181.333145:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042978432 00000100:00100000:1.0:1787826181.333236:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 988 00000100:00100000:1.0:1787826181.333250:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158791:x1874663042978432:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:1.0:1787826181.333306:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:1.0:1787826181.333438:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158791:x1874663042978432:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 189us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826181.333447:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 988 00000100:00100000:2.0:1787826181.339692:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826181.339864:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042978560 00000100:00100000:0.0:1787826181.339879:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042978560 00000100:00100000:0.0:1787826181.339957:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5787 00000100:00100000:0.0:1787826181.339968:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158791:x1874663042978560:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826181.340003:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826181.340100:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:158791:x1874663042978560:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 132us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826181.340109:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5787 00000100:00100000:0.0:1787826181.343502:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826181.343628:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042978688 00000100:00100000:1.0:1787826181.343642:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042978688 00000100:00100000:1.0:1787826181.343729:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5788 00000100:00100000:1.0:1787826181.343742:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:158791:x1874663042978688:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:1.0:1787826181.343776:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826181.343870:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:158791:x1874663042978688:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 130us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826181.343878:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5788 00000100:00100000:2.0:1787826181.373658:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826181.373848:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042978944 00000100:00100000:0.0:1787826181.373864:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042978944 00000100:00100000:0.0:1787826181.373946:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 989 00000100:00100000:0.0:1787826181.373959:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47fb09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+9:157888:x1874663042978944:12345-192.168.203.47@tcp:36:multiop.0 00010000:00010000:0.0:1787826181.374091:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.374112:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.374128:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826181.374453:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3570401 reply state 00000000aea0d310 transno 343597383681 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.374470:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.374479:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:0.0:1787826181.374483:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787826181.374488:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826181.374632:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47fb09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:157888:x1874663042978944:12345-192.168.203.47@tcp:36:multiop.0 Request processed in 673us (989us total) trans 343597383681 rc 0/0 00000100:00100000:0.0:1787826181.374641:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 989 00000100:00100000:3.0:1787826181.385300:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826181.385646:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042979072 00000100:00100000:1.0:1787826181.385660:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042979072 00000100:00100000:1.0:1787826181.385840:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 990 00000100:00100000:1.0:1787826181.385853:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:157888:x1874663042979072:12345-192.168.203.47@tcp:101:multiop.0 00010000:00010000:1.0:1787826181.385887:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826181.385916:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ced3d6 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f124 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826181.385994:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ced3d6 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f124 expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826181.386012:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ced3d6 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f124 expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826181.386034:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:1.0:1787826181.386039:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826181.386043:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3600, rc 0) 00000100:00100000:1.0:1787826181.387811:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:157888:x1874663042979072:12345-192.168.203.47@tcp:101:multiop.0 Request processed in 1945us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826181.387828:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 990 00000100:00100000:1.0:1787826181.396417:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826181.396594:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042979200 00000100:00100000:2.0:1787826181.396620:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042979200 00000100:00100000:2.0:1787826181.396816:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22555 00000100:00100000:2.0:1787826181.396829:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042979200:12345-192.168.203.47@tcp:2:multiop.0 00002000:00010000:2.0:1787826181.397081:0:43897:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1862:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826181.397086:0:43897:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x1862:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787826181.397088:0:43897:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x1862:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826181.397091:0:43897:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x1862:0x0] updating lvb ctime from disk: 0 -> 1787826181 00002000:00010000:2.0:1787826181.397093:0:43897:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1862:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826181.397447:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042979200:12345-192.168.203.47@tcp:2:multiop.0 Request processed in 618us (1042us total) trans 34359738465 rc 0/0 00000100:00100000:2.0:1787826181.397457:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22555 00000100:00100000:3.0:1787826181.406494:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826181.408484:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042979328 00000100:00100000:2.0:1787826181.408507:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042979328 00000100:00100000:2.0:1787826181.408622:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 991 00000100:00100000:2.0:1787826181.408634:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:157888:x1874663042979328:12345-192.168.203.47@tcp:101:multiop.0 00010000:00010000:2.0:1787826181.408662:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826181.408691:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced3dd lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f12b expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.408801:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715400/0x878a5eea00ced3e4 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.408824:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715400/0x878a5eea00ced3e4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.408838:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715400/0x878a5eea00ced3e4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826181.408900:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826181.408926:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715400/0x878a5eea00ced3e4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.408959:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced3dd lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f12b expref: 14 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.408982:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715400/0x878a5eea00ced3e4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f12b expref: 13 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.408991:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:2.0:1787826181.408995:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826181.409000:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715400, rc 0) 00000100:00100000:2.0:1787826181.409101:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:157888:x1874663042979328:12345-192.168.203.47@tcp:101:multiop.0 Request processed in 468us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826181.409109:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 991 00000100:00100000:3.0:1787826181.417798:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826181.421850:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042979584 00000100:00100000:0.0:1787826181.421874:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042979584 00000100:00100000:0.0:1787826181.421959:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:0.0:1787826181.421975:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+13:157888:x1874663042979584:12345-192.168.203.47@tcp:35:multiop.0 00000004:00080000:0.0:1787826181.422421:0:187907:0:(mdd_object.c:4014:mdd_close()) Object [0x20001a9e3:0x1bd2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826181.422525:0:187907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x140:0x0].2, 64 off8320 00000004:00080000:0.0:1787826181.422553:0:187907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8248249226070ns, next at 8249249212113ns, rc = 0 00010000:00010000:0.0:1787826181.422648:0:187907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.422670:0:187907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.422684:0:187907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.422693:0:187907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.422705:0:187907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.422712:0:187907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826181.422747:0:187907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826181.422893:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157888:x1874663042979584:12345-192.168.203.47@tcp:35:multiop.0 Request processed in 918us (5107us total) trans 343597383682 rc 0/0 00000100:00100000:0.0:1787826181.422904:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1 00010000:00010000:2.0:1787826181.423228:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826181.423239:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.423249:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826181.423254:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.423265:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.423283:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:2.0:1787826181.423288:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826181.423296:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.423303:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00ced3eb lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 187907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.423322:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826181.423384:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826181.423386:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826181.428140:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826181.428478:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042979712 00000100:00100000:2.0:1787826181.428492:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042979712 00000100:00100000:2.0:1787826181.428576:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 992 00000100:00100000:2.0:1787826181.428589:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157751:x1874663042979712:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1787826181.428623:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826181.428650:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f132 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428743:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428762:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428776:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428793:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428801:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428809:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428894:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428916:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428925:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428931:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826181.428937:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428946:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.428961:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:2.0:1787826181.429240:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826181.429246:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429253:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714a00/0x878a5eea00ced3f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429269:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429276:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429283:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429288:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826181.429291:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429297:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429305:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff8eb34b49db00) 00010000:00010000:2.0:1787826181.429307:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826181.429310:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429315:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714c00/0x878a5eea00ced400 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429415:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced3f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f132 expref: 15 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429439:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:2.0:1787826181.429442:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826181.429446:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f132 expref: 15 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826181.429457:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715200, rc 0) 00000100:00100000:2.0:1787826181.429557:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:157751:x1874663042979712:12345-192.168.203.47@tcp:101:bash.0 Request processed in 971us (1430us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826181.429568:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 992 00000100:00100000:2.0:1787826181.973374:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826181.973406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049306368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826181.973502:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826181.973584:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049306368 00000100:00100000:2.0:1787826181.973594:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049306368 00000100:00100000:2.0:1787826181.973670:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5789 00000100:00100000:2.0:1787826181.973682:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049306368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826181.973716:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826181.973770:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049306368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826181.973778:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5789 00000100:00100000:2.0:1787826181.973839:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049306368:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787826181.973897:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826181.974095:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826181.974108:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049306496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826181.974146:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826181.974179:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049306496 00000100:00100000:1.0:1787826181.974183:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049306496 00000100:00100000:1.0:1787826181.974221:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5790 00000100:00100000:1.0:1787826181.974230:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049306496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826181.974244:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826181.974290:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049306496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826181.974297:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5790 00000100:00080000:1.0:1787826181.974480:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826181.974511:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049306496:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787826181.977827:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826182.997567:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826184.020451:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826184.020788:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049307008:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.020868:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.020930:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049307520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.020956:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.020971:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049308032:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.020990:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.021018:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826184.021024:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049306880:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021045:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.021062:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049307392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021082:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.021097:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049307904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021117:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.021151:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049307008 00000100:00100000:0.0:1787826184.021159:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049307008 00000100:00100000:0.0:1787826184.021207:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049306880 00000100:00100000:0.0:1787826184.021210:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049306880 00000100:00100000:0.0:1787826184.021231:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787826184.021240:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049307008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021290:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049307008:12345-0@lo:400:kworker.0 Request processed in 51us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.021298:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787826184.021316:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787826184.021342:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049306880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021373:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049306880:12345-0@lo:400:kworker.0 Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.021379:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787826184.021397:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049307520 00000100:00100000:0.0:1787826184.021400:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049307520 00000100:00100000:0.0:1787826184.021424:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049308032 00000100:00100000:0.0:1787826184.021427:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049308032 00000100:00100000:0.0:1787826184.021441:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049307392 00000100:00100000:0.0:1787826184.021443:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049307392 00000100:00100000:0.0:1787826184.021456:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049307904 00000100:00100000:0.0:1787826184.021458:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049307904 00000100:00100000:0.0:1787826184.021474:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7025 00000100:00100000:0.0:1787826184.021481:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049307520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021509:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049307520:12345-0@lo:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.021515:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7025 00000100:00100000:0.0:1787826184.021535:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7026 00000100:00100000:0.0:1787826184.021541:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049308032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021564:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049308032:12345-0@lo:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.021569:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7026 00000100:00100000:0.0:1787826184.021578:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7027 00000100:00100000:0.0:1787826184.021583:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049307392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021605:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049307392:12345-0@lo:400:kworker.0 Request processed in 22us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.021609:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7027 00000100:00100000:0.0:1787826184.021617:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7028 00000100:00100000:0.0:1787826184.021622:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049307904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021642:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049307904:12345-0@lo:400:kworker.0 Request processed in 19us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.021646:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7028 00000100:00100000:0.0:1787826184.021693:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049306880:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021703:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049307392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021711:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049307904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021720:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049307008:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021728:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049307520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021736:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049308032:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021793:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049306752:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021818:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.021835:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049307264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021857:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.021880:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049307776:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021900:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.021918:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787826184.021924:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049306624:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021949:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.021970:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049307136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.021989:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.022003:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049307648:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022021:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.022034:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049308160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022052:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.022074:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049306752 00000100:00100000:0.0:1787826184.022078:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049306752 00000100:00100000:0.0:1787826184.022103:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049307136 00000100:00100000:0.0:1787826184.022106:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049307136 00000100:00100000:0.0:1787826184.022119:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049307648 00000100:00100000:0.0:1787826184.022122:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049307648 00000100:00100000:0.0:1787826184.022131:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049308160 00000100:00100000:0.0:1787826184.022134:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049308160 00000100:00100000:0.0:1787826184.022146:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787826184.022152:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049306752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022186:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049306752:12345-0@lo:400:kworker.0 Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.022192:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787826184.022204:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787826184.022210:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049307136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022234:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049307136:12345-0@lo:400:kworker.0 Request processed in 25us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.022239:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787826184.022248:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787826184.022252:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049307648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022274:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049307648:12345-0@lo:400:kworker.0 Request processed in 21us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.022279:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787826184.022291:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787826184.022296:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049308160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022321:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049308160:12345-0@lo:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.022350:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787826184.022368:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049307264 00000100:00100000:0.0:1787826184.022372:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049307264 00000100:00100000:0.0:1787826184.022393:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049307776 00000100:00100000:0.0:1787826184.022396:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049307776 00000100:00100000:0.0:1787826184.022411:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12676 00000100:00100000:0.0:1787826184.022417:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049307264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022447:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049307264:12345-0@lo:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.022452:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12676 00000100:00100000:0.0:1787826184.022463:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12677 00000100:00100000:0.0:1787826184.022468:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049307776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022493:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049307776:12345-0@lo:400:kworker.0 Request processed in 25us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.022498:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12677 00000100:00100000:0.0:1787826184.022520:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049306624 00000100:00100000:0.0:1787826184.022534:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049306624 00000100:00100000:0.0:1787826184.022562:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787826184.022569:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049306624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022597:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049306624:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.022602:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787826184.022652:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049306624:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022663:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049307136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022670:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049307648:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022677:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049308160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022685:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049306752:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022694:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049307264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826184.022702:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049307776:0@lo:400:kworker.0 00000100:00080000:0.0:1787826184.022752:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826184.022757:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826184.022760:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826184.022762:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826184.025469:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049308288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826184.025734:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826184.025822:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049308288 00000100:00100000:0.0:1787826184.025830:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049308288 00000100:00100000:0.0:1787826184.025884:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12678 00000100:00100000:0.0:1787826184.025894:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049308288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826184.025931:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826184.026383:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049308288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 489us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826184.026392:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12678 00000100:00100000:2.0:1787826184.026412:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049308288:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826185.049028:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826185.469528:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826185.469581:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826185.469624:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826185.469646:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826185.469668:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826185.469706:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042979840 00000100:00100000:1.0:1787826185.469716:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042979840 00000100:00100000:1.0:1787826185.469766:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 83 00000100:00100000:1.0:1787826185.469775:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb349227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042979840:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826185.469843:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb349227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042979840:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826185.469850:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 83 00000100:00100000:1.0:1787826185.469883:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042980224 00000100:00100000:1.0:1787826185.469887:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042980224 00000100:00100000:1.0:1787826185.469918:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042980352 00000100:00100000:1.0:1787826185.469921:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042980352 00000100:00100000:1.0:1787826185.469941:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7029 00000100:00100000:1.0:1787826185.469948:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042980224:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826185.469976:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+7:2389:x1874663042980224:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826185.469984:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7029 00000100:00100000:1.0:1787826185.469996:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7030 00000100:00100000:1.0:1787826185.470001:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042980352:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826185.470025:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2389:x1874663042980352:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826185.470031:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7030 00000100:00100000:0.0:1787826185.472153:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042979968 00000100:00100000:0.0:1787826185.472168:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042979968 00000100:00100000:0.0:1787826185.472247:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042980096 00000100:00100000:0.0:1787826185.472251:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042980096 00000100:00100000:0.0:1787826185.472283:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 224 00000100:00100000:0.0:1787826185.472293:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:2389:x1874663042979968:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826185.472401:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+14:2389:x1874663042979968:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 109us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826185.472408:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 224 00000100:00100000:0.0:1787826185.472426:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 225 00000100:00100000:0.0:1787826185.472433:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042980096:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826185.472457:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2389:x1874663042980096:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826185.472463:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 225 00000100:00080000:0.0:1787826185.472484:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826185.472487:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826185.472500:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826185.472502:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787826186.068534:0:192374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8252895206308ns, next at 8253895202525ns, rc = 0 00000100:00100000:3.0:1787826186.068609:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049308416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826186.068710:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826186.068780:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826186.068788:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049308544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826186.068835:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826186.068875:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826186.068883:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049308544 00000100:00100000:3.0:1787826186.068889:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049308672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826186.068892:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049308544 00000100:00100000:3.0:1787826186.068923:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826186.068964:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049308416 00000100:00100000:3.0:1787826186.068969:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049308416 00000100:00100000:0.0:1787826186.068970:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049308672 00000100:00100000:0.0:1787826186.068975:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049308672 00000100:00100000:0.0:1787826186.069005:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5791 00000100:00100000:3.0:1787826186.069015:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12679 00000100:00100000:0.0:1787826186.069019:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049308544:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826186.069028:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049308416:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:0.0:1787826186.069058:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000004:00000024:3.0:1787826186.069059:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:0.0:1787826186.069285:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049308544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 269us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826186.069293:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5791 00000100:00100000:0.0:1787826186.069313:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5792 00000100:00100000:0.0:1787826186.069320:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049308672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826186.069361:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826186.069399:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049308672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826186.069406:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5792 00000100:00080000:0.0:1787826186.069430:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826186.069435:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826186.069795:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049308672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826186.070070:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049308416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1044us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826186.070079:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12679 00000100:00100000:2.0:1787826186.070877:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049308544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826186.070897:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049308416:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787826187.096013:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826187.096498:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826187.096539:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049308800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826187.096648:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826187.097675:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049308800 00000100:00100000:0.0:1787826187.097688:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049308800 00000100:00100000:2.0:1787826187.097729:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049308928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826187.097768:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5793 00000100:00100000:0.0:1787826187.097783:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049308800:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826187.097806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787826187.097813:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826187.097942:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049308928 00000100:00100000:1.0:1787826187.097947:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049308928 00000100:00100000:1.0:1787826187.097987:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5794 00000100:00100000:1.0:1787826187.097996:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049308928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826187.098008:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00080000:2.0:1787826187.098075:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826187.098082:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826187.098229:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049308800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 448us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826187.098237:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5793 00000100:00100000:2.0:1787826187.098368:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049308800:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787826187.098433:0:192354:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787826187.098457:0:192354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383682 is committed 00000004:00080000:2.0:1787826187.098461:0:192354:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787826187.098486:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.098498:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.098514:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.098521:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65800 already unused, calling callback (ffffffffc1a414f0) 00000100:00100000:0.0:1787826187.098764:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049309056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826187.098813:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826187.098874:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049309056 00000100:00100000:0.0:1787826187.098879:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049309056 00000100:00100000:0.0:1787826187.098935:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22556 00000100:00100000:0.0:1787826187.098944:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049309056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787826187.098967:0:177402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6242 count 1 00010000:00010000:0.0:1787826187.098999:0:177402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.099024:0:177402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.099033:0:177402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1862:0x0].0x0 since=78s v=(0 0) 00010000:00010000:0.0:1787826187.099039:0:177402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826187.099044:0:177402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.099075:0:177402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.099102:0:177402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 8353 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826187.099115:0:177402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:177402:1874663049309184:192.168.203.47@tcp:104: 00000100:00100000:0.0:1787826187.099194:0:177402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ec79f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787826187.099434:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.099449:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.099467:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:2.0:1787826187.099470:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826187.099475:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.099482:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced3cf lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826187.100790:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049308928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2785us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826187.100808:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5794 00000100:00100000:3.0:1787826187.102376:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049308928:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1787826187.104554:0:184693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738465 is committed 00000100:00100000:1.0:1787826187.105547:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826187.105829:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042980480 00000100:00100000:2.0:1787826187.105845:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042980480 00010000:00010000:2.0:1787826187.105913:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 8353 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826187.105964:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12222 00000100:00100000:2.0:1787826187.105976:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2391:x1874663042980480:12345-192.168.203.47@tcp:103:ldlm_bl.0 00000100:00080000:1.0:1787826187.105989:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787826187.105993:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826187.106001:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 8353 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.106016:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 8353 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.106042:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826187.106047:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826187.106053:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.106064:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826187.106085:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826187.106143:0:177402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00cecef1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f0e5 expref: 6 pid: 16985 timeout: 8353 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826187.106178:0:177402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:177402:1874663049309184:192.168.203.47@tcp:104: 00010000:00010000:0.0:1787826187.106211:0:177402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.106224:0:177402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.106233:0:177402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.106246:0:177402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.106254:0:177402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826187.106288:0:177402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826187.106707:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826187.106717:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826187.106727:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826187.106733:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826187.106743:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826187.106764:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826187.106770:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a364664a/0x878a5eea00ced407 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 177402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826187.106791:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826187.106793:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826187.106794:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826187.117460:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2391:x1874663042980480:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 11473us (11910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826187.117478:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12222 00000100:00100000:0.0:1787826187.119127:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049309056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20168us (20298us total) trans 34359738466 rc 0/0 00000100:00100000:0.0:1787826187.119149:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22556 00000004:00080000:1.0:1787826187.121946:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479b40700/2, rc 0, transno 34359738466 00000100:00100000:1.0:1787826187.121968:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049309056:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787826188.116517:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826188.354878:0:193202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 74: Ensure applications don't fail waiting for OST recovery ========================================================== 06:23:07 (1787826187) 00000100:00100000:3.0:1787826189.141090:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049309568:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141163:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826189.141195:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049310080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141217:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826189.141234:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049310592:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141254:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826189.141277:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826189.141282:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049309696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141304:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826189.141318:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049310208:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141359:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826189.141373:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049310720:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141391:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826189.141418:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049310080 00000100:00100000:3.0:1787826189.141425:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049310080 00000100:00100000:3.0:1787826189.141470:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049310592 00000100:00100000:3.0:1787826189.141473:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049310592 00000100:00100000:3.0:1787826189.141503:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049310208 00000100:00100000:3.0:1787826189.141506:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049310208 00000100:00100000:3.0:1787826189.141522:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049310720 00000100:00100000:3.0:1787826189.141525:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049310720 00000100:00100000:3.0:1787826189.141544:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7031 00000100:00100000:3.0:1787826189.141553:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049310080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141603:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049310080:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826189.141610:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7031 00000100:00100000:3.0:1787826189.141626:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7032 00000100:00100000:3.0:1787826189.141632:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049310592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141657:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049310592:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826189.141662:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7032 00000100:00100000:3.0:1787826189.141687:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7033 00000100:00100000:3.0:1787826189.141694:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049310208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141720:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049310208:12345-0@lo:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826189.141726:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7033 00000100:00100000:3.0:1787826189.141737:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7034 00000100:00100000:3.0:1787826189.141742:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049310720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141765:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049310720:12345-0@lo:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826189.141770:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7034 00000100:00100000:3.0:1787826189.141810:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049310208:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141820:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049310720:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141828:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049310080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.141836:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049310592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142082:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049309440:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142126:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826189.142151:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049309952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142174:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826189.142199:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049310464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142221:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826189.142239:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787826189.142245:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049309312:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142270:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826189.142289:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049309824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142315:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826189.142353:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049310336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142373:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826189.142388:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049310848:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142412:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826189.142437:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826189.142441:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826189.142451:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049309568 00000100:00100000:1.0:1787826189.142455:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049309568 00000100:00100000:1.0:1787826189.142495:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049309696 00000100:00100000:1.0:1787826189.142498:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049309696 00000100:00100000:1.0:1787826189.142512:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049309440 00000100:00100000:1.0:1787826189.142515:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049309440 00000100:00100000:1.0:1787826189.142527:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049309824 00000100:00100000:1.0:1787826189.142530:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049309824 00000100:00100000:1.0:1787826189.142541:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049310336 00000100:00100000:1.0:1787826189.142544:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049310336 00000100:00100000:1.0:1787826189.142552:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049310848 00000100:00100000:1.0:1787826189.142554:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049310848 00000100:00100000:1.0:1787826189.142566:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787826189.142572:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049309568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142612:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049309568:12345-0@lo:400:kworker.0 Request processed in 40us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826189.142620:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787826189.142634:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787826189.142640:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049309696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142666:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049309696:12345-0@lo:400:kworker.0 Request processed in 28us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826189.142671:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787826189.142681:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787826189.142687:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049309440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142715:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049309440:12345-0@lo:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826189.142720:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787826189.142730:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787826189.142736:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049309824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142765:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049309824:12345-0@lo:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826189.142770:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787826189.142782:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787826189.142788:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049310336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142812:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049310336:12345-0@lo:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826189.142817:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787826189.142827:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787826189.142833:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049310848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142857:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049310848:12345-0@lo:400:kworker.0 Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826189.142862:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:1.0:1787826189.142875:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826189.142878:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826189.142897:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049309824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142906:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049310336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142914:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049310848:0@lo:400:kworker.0 00000100:00100000:1.0:1787826189.142923:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049309440:0@lo:400:kworker.0 00010000:00010000:0.0:1787826189.143255:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826189.143276:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049309952 00000100:00100000:0.0:1787826189.143281:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049309952 00000100:00100000:0.0:1787826189.143342:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049310464 00000100:00100000:0.0:1787826189.143346:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049310464 00000100:00100000:0.0:1787826189.143366:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12680 00000100:00100000:0.0:1787826189.143374:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049309952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826189.143420:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049309952:12345-0@lo:400:kworker.0 Request processed in 46us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826189.143426:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12680 00000100:00100000:0.0:1787826189.143441:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12681 00000100:00100000:0.0:1787826189.143447:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049310464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826189.143474:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049310464:12345-0@lo:400:kworker.0 Request processed in 28us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826189.143480:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12681 00000100:00100000:0.0:1787826189.143507:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049309312 00000100:00100000:0.0:1787826189.143511:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049309312 00000100:00100000:0.0:1787826189.143545:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826189.143551:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049309312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826189.143579:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049309312:12345-0@lo:400:kworker.0 Request processed in 28us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826189.143584:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826189.143618:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049309312:0@lo:400:kworker.0 00000100:00100000:0.0:1787826189.143628:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049309952:0@lo:400:kworker.0 00000100:00100000:0.0:1787826189.143635:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049310464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.144579:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049309696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826189.144593:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049309568:0@lo:400:kworker.0 00000100:00100000:0.0:1787826189.145776:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049310976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826189.145835:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826189.145929:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049310976 00000100:00100000:1.0:1787826189.145937:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049310976 00000100:00100000:1.0:1787826189.145986:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12682 00000100:00100000:1.0:1787826189.145995:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049310976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826189.146024:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446047744 avail 1299808256 00000100:00100000:1.0:1787826189.146078:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049310976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826189.146084:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12682 00000100:00100000:0.0:1787826189.146272:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049310976:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826190.164835:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826190.586578:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826190.586633:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826190.586671:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826190.586698:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826190.586724:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826190.586753:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042980608 00000100:00100000:0.0:1787826190.586763:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042980608 00000100:00100000:0.0:1787826190.586826:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 85 00000100:00100000:0.0:1787826190.586837:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042980608:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826190.586900:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2392:x1874663042980608:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826190.586907:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 85 00000100:00100000:0.0:1787826190.586941:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042980992 00000100:00100000:0.0:1787826190.586945:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042980992 00000100:00100000:0.0:1787826190.586976:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042981120 00000100:00100000:0.0:1787826190.586979:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042981120 00000100:00100000:0.0:1787826190.587004:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7035 00000100:00100000:0.0:1787826190.587011:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042980992:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826190.587044:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042980992:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826190.587049:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7035 00000100:00100000:0.0:1787826190.587062:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7036 00000100:00100000:0.0:1787826190.587068:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042981120:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826190.587090:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2392:x1874663042981120:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826190.587096:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7036 00000100:00100000:0.0:1787826190.587221:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042980736 00000100:00100000:0.0:1787826190.587225:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042980736 00000100:00100000:0.0:1787826190.587250:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042980864 00000100:00100000:0.0:1787826190.587253:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042980864 00000100:00100000:0.0:1787826190.587272:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 232 00000100:00100000:0.0:1787826190.587278:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:2392:x1874663042980736:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826190.587311:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:2392:x1874663042980736:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 33us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826190.587317:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 232 00000100:00100000:0.0:1787826190.587373:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 233 00000100:00100000:0.0:1787826190.587380:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042980864:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826190.587405:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2392:x1874663042980864:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826190.587411:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 233 00000100:00080000:1.0:1787826190.588197:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826190.588202:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826190.588205:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826190.588207:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826191.066253:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826191.066377:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042981376 00000100:00100000:3.0:1787826191.066387:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042981376 00000100:00100000:3.0:1787826191.066440:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:3.0:1787826191.066450:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+11:159403:x1874663042981376:12345-192.168.203.47@tcp:35:umount.0 00000100:00100000:3.0:1787826191.066703:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:159403:x1874663042981376:12345-192.168.203.47@tcp:35:umount.0 Request processed in 253us (459us total) trans 343597383683 rc 0/0 00000100:00100000:3.0:1787826191.066710:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:0.0:1787826191.177215:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826191.177277:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826191.177423:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042981504 00000100:00100000:1.0:1787826191.177437:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042981504 00000100:00100000:1.0:1787826191.177512:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042981632 00000100:00100000:1.0:1787826191.177515:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042981632 00000100:00100000:1.0:1787826191.177561:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4218 00000100:00100000:1.0:1787826191.177573:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7528148b-9bee-4d31-b597-8aae3b0b4982+11:2389:x1874663042981504:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826191.177592:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826191.177617:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce2400/0x878a5eea00ced17c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f108 expref: 11 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826191.177638:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826191.177704:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7528148b-9bee-4d31-b597-8aae3b0b4982+10:2389:x1874663042981504:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 133us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826191.177713:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4218 00000100:00100000:1.0:1787826191.177738:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4219 00000100:00100000:1.0:1787826191.177746:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7528148b-9bee-4d31-b597-8aae3b0b4982+9:2389:x1874663042981632:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826191.177754:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826191.177764:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf38600/0x878a5eea00ced175 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f101 expref: 9 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826191.177774:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826191.177794:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7528148b-9bee-4d31-b597-8aae3b0b4982+8:2389:x1874663042981632:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 48us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826191.177800:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4219 00010000:00010000:3.0:1787826191.188645:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826191.189780:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826191.189812:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049311104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826191.189914:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826191.190076:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826191.190087:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049311232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826191.190131:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826191.191594:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049311104 00000100:00100000:2.0:1787826191.191611:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049311104 00000100:00100000:2.0:1787826191.191704:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049311232 00000100:00100000:2.0:1787826191.191709:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049311232 00000100:00100000:2.0:1787826191.191740:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5795 00000100:00100000:2.0:1787826191.191759:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049311104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826191.191809:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826191.191903:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049311104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826191.191911:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5795 00000100:00100000:2.0:1787826191.192230:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5796 00000100:00100000:2.0:1787826191.192250:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049311232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826191.192269:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826191.192314:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049311232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826191.192322:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5796 00000100:00100000:2.0:1787826191.192483:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049311104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826191.192534:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049311232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787826191.192940:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826191.192948:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826191.194737:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826191.194767:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049311360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826191.194852:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826191.198311:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049311360 00000100:00100000:1.0:1787826191.198400:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049311360 00000100:00100000:1.0:1787826191.198508:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12683 00000100:00100000:1.0:1787826191.198530:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049311360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826191.198593:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445629952 avail 1299390464 00000100:00100000:1.0:1787826191.198707:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049311360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 188us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826191.198715:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12683 00000100:00100000:0.0:1787826191.200415:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049311360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826191.213027:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826191.213107:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826191.214052:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042981888 00000100:00100000:0.0:1787826191.214068:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042981888 00000100:00100000:0.0:1787826191.214164:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22557 00000100:00100000:0.0:1787826191.214176:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2388:x1874663042981888:12345-192.168.203.47@tcp:9:umount.0 00000020:00000080:0.0:1787826191.214217:0:179222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced20f 00000100:00080000:0.0:1787826191.214230:0:179222:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa5c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787826191.214296:0:179222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975535 00000100:00100000:0.0:1787826191.214600:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:a9ce6693-0634-46c5-bf21-5ca7d026d44e+2:2388:x1874663042981888:12345-192.168.203.47@tcp:9:umount.0 Request processed in 424us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826191.214609:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22557 00010000:00010000:3.0:1787826191.215396:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826191.215487:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042981760 00000100:00100000:2.0:1787826191.215496:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042981760 00000100:00100000:2.0:1787826191.215579:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4220 00000100:00100000:2.0:1787826191.215589:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb450a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7528148b-9bee-4d31-b597-8aae3b0b4982+8:2392:x1874663042981760:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826191.215606:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826191.215633:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8e400/0x878a5eea00ced18a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f10f expref: 8 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826191.215662:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826191.215714:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb450a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7528148b-9bee-4d31-b597-8aae3b0b4982+7:2392:x1874663042981760:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 126us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826191.215721:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4220 00000100:00100000:1.0:1787826191.224278:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826191.225046:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042982016 00000100:00100000:0.0:1787826191.225061:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042982016 00000100:00100000:0.0:1787826191.225236:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22558 00000100:00100000:0.0:1787826191.225248:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+5:2388:x1874663042982016:12345-192.168.203.47@tcp:9:umount.0 00000020:00000080:0.0:1787826191.225291:0:179225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce9657 00000100:00080000:0.0:1787826191.225304:0:179225:0:(import.c:65:import_set_state_nolock()) ffff8eb46e2a0800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787826191.225743:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787826191.225819:0:179225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738466 00000100:00100000:0.0:1787826191.226045:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:a9ce6693-0634-46c5-bf21-5ca7d026d44e+2:2388:x1874663042982016:12345-192.168.203.47@tcp:9:umount.0 Request processed in 797us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826191.226057:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22558 00000100:00100000:3.0:1787826191.231972:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826191.234548:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042982528 00000100:00100000:1.0:1787826191.234571:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042982528 00000100:00100000:1.0:1787826191.234674:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 993 00000100:00100000:1.0:1787826191.234686:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+12:2388:x1874663042982528:12345-192.168.203.47@tcp:39:umount.0 00000020:00000080:1.0:1787826191.234740:0:188992:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecffb 00000020:00010000:1.0:1787826191.234760:0:188992:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb34b9e5000: total 0 00000100:00080000:1.0:1787826191.234766:0:188992:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787826191.234799:0:188992:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 80, last_transno is 343597383683 00000100:00100000:1.0:1787826191.235002:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a9ce6693-0634-46c5-bf21-5ca7d026d44e+10:2388:x1874663042982528:12345-192.168.203.47@tcp:39:umount.0 Request processed in 316us (3044us total) trans 343597383684 rc 0/0 00000100:00100000:1.0:1787826191.235011:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 993 00000020:00010000:3.0:1787826191.235256:0:66923:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb34b9e5000: total 0 00010000:00010000:3.0:1787826191.235384:0:66923:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb34b9e5000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1787826191.235426:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fd300) 00010000:00010000:3.0:1787826191.235430:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826191.235440:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced208 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f11d expref: 9 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826191.235468:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:3.0:1787826191.235481:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826191.235485:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715400/0x878a5eea00ced3e4 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f12b expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826191.235500:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1bd2:0x0].0x0 (ffff8eb47f8ff000) 00010000:00010000:3.0:1787826191.235502:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826191.235505:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ced3d6 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1bd2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f124 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826191.235534:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb472727c00) 00010000:00010000:3.0:1787826191.235536:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826191.235541:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00ced1f3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64bee expref: 6 pid: 192388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826191.235555:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x17e0:0x0].0x0 (ffff8eb472727c00) 00010000:00010000:3.0:1787826191.235558:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787826191.235561:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39000/0x878a5eea00ced1fa lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x17e0:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d64b3f expref: 5 pid: 192388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826191.235579:0:66923:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb34b9e5000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1787826191.235592:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826191.235594:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826191.235596:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826191.251624:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826191.251850:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042982656 00000100:00100000:1.0:1787826191.251863:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042982656 00000100:00100000:1.0:1787826191.252079:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 994 00000100:00100000:1.0:1787826191.252093:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+6:2388:x1874663042982656:12345-192.168.203.47@tcp:39:umount.0 00000020:00000080:1.0:1787826191.252149:0:187905:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7207 00000100:00080000:1.0:1787826191.252170:0:187905:0:(import.c:65:import_set_state_nolock()) ffff8eb3496ac000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787826191.252205:0:187905:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 4, last_transno is 17179869981 00000100:00100000:1.0:1787826191.252441:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9ce6693-0634-46c5-bf21-5ca7d026d44e+3:2388:x1874663042982656:12345-192.168.203.47@tcp:39:umount.0 Request processed in 351us (897us total) trans 17179869982 rc 0/0 00000100:00100000:1.0:1787826191.252451:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 994 00010000:00010000:3.0:1787826191.252577:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826191.333793:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826191.333905:0:192361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042982912 00000100:00100000:0.0:1787826191.333919:0:192361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042982912 00000100:00100000:0.0:1787826191.334007:0:192361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 86 00000100:00100000:0.0:1787826191.334021:0:192361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+7:2388:x1874663042982912:12345-192.168.203.47@tcp:251:umount.0 00000020:00000080:0.0:1787826191.334081:0:192361:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecf8b 00000020:00010000:0.0:1787826191.334091:0:192361:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb343641800: total 0 00000100:00080000:0.0:1787826191.334097:0:192361:0:(import.c:65:import_set_state_nolock()) ffff8eb343644800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787826191.334184:0:192361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7528148b-9bee-4d31-b597-8aae3b0b4982+3:2388:x1874663042982912:12345-192.168.203.47@tcp:251:umount.0 Request processed in 166us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826191.334193:0:192361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 86 00000020:00010000:2.0:1787826191.334662:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb343641800: total 0 00010000:00010000:2.0:1787826191.334754:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb343641800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787826191.334795:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8f200/0x878a5eea00ced198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f116 expref: 2 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826191.334817:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb343641800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787826191.334830:0:6478:0:(genops.c:885:class_export_put()) final put ffff8eb343641800/7528148b-9bee-4d31-b597-8aae3b0b4982 00010000:00010000:2.0:1787826191.334844:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826191.334847:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826191.334849:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826191.335060:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343641800/7528148b-9bee-4d31-b597-8aae3b0b4982 for MGS 00000020:00000080:2.0:1787826191.335160:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb343644800 for MGS 00010000:00010000:2.0:1787826192.213497:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826192.214694:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049311488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826192.214791:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826192.215543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049311616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826192.216125:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049311488 00000100:00100000:2.0:1787826192.216137:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049311488 00000100:00100000:2.0:1787826192.216227:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5797 00000100:00100000:2.0:1787826192.216242:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049311488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826192.216273:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00080000:1.0:1787826192.216551:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826192.232150:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826192.232278:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049311616 00000100:00100000:0.0:1787826192.232291:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049311616 00000100:00100000:0.0:1787826192.232670:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5798 00000100:00100000:0.0:1787826192.232684:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049311616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826192.232721:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826192.232791:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049311616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826192.232800:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5798 00000100:00080000:0.0:1787826192.232829:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826192.233101:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049311616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826192.234009:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049311488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 17768us (19213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826192.234025:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5797 00000100:00100000:2.0:1787826192.234085:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049311488:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826193.243583:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787826193.250875:0:184693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:1.0:1787826193.250888:0:184693:0:(genops.c:885:class_export_put()) final put ffff8eb46e2a6800/a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000001:00080000:1.0:1787826193.250929:0:184693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738466 is committed 00000020:00000080:3.0:1787826193.250939:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e2a6800/a9ce6693-0634-46c5-bf21-5ca7d026d44e for lustre-OST0000 00000020:00000080:3.0:1787826193.251038:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46e2a0800 for lustre-OST0000 00000020:01000004:0.0:1787826193.601448:0:193299:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787826193.601514:0:193299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826193.601530:0:193299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826193.601537:0:193299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826193.601544:0:193299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826193.601567:0:193299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787826193.601573:0:193299:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787826193.601600:0:193299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826193.601604:0:193299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787826193.601611:0:193299:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787826193.601635:0:193299:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787826193.602222:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826193.602230:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.602238:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1787826193.602242:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.602252:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826193.602259:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826193.602265:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826193.602267:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787826193.602270:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787826193.602298:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.602304:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826193.602351:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.602359:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3400/0x878a5eea00ced105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced10c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.602369:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826193.602371:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826193.602373:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826193.602388:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049311744:0@lo:39:umount.0 00000100:00100000:1.0:1787826193.602450:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826193.602505:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826193.602514:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049311872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826193.602542:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826193.602580:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049311744 00000100:00100000:1.0:1787826193.602586:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049311744 00000100:00100000:1.0:1787826193.602637:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1787826193.602645:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874663049311744:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826193.602667:0:188682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced1a6 00000100:00080000:1.0:1787826193.602675:0:188682:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa5f800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787826193.602740:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3616:x1874663049311744:12345-0@lo:39:umount.0 Request processed in 96us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826193.602747:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000020:00000080:1.0:1787826193.602759:0:188682:0:(genops.c:885:class_export_put()) final put ffff8eb46aa58800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:1.0:1787826193.602781:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049311872 00000100:00100000:1.0:1787826193.602785:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049311872 00000100:00100000:1.0:1787826193.602810:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4221 00000100:00100000:1.0:1787826193.602816:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049311872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826193.602824:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826193.602838:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64600/0x878a5eea00ced10c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced105 expref: 24 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.602849:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826193.602876:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3617:x1874663049311872:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826193.602883:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4221 00000100:00080000:1.0:1787826193.602899:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787826193.602910:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826193.602930:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049311872:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787826193.602957:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4727db000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826193.602964:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049311744:0@lo:39:umount.0 00000100:00080000:0.0:1787826193.603110:0:193299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826193.603114:0:193299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787826193.603117:0:193299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787826193.603919:0:193299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826193.603922:0:193299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787826193.603927:0:193299:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787826193.603944:0:193299:0:(import.c:65:import_set_state_nolock()) ffff8eb34c997000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787826193.605850:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049312000:0@lo:39:umount.0 00000100:00100000:1.0:1787826193.605915:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826193.606374:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049312000 00000100:00100000:0.0:1787826193.606382:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049312000 00000100:00100000:0.0:1787826193.606429:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1787826193.606439:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874663049312000:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787826193.606807:0:187904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7334 00000100:00080000:0.0:1787826193.606817:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb47f953800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787826193.606888:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+1:3616:x1874663049312000:12345-0@lo:39:umount.0 Request processed in 450us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826193.606896:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000020:00000080:0.0:1787826193.606907:0:187904:0:(genops.c:885:class_export_put()) final put ffff8eb47a4e8800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:2.0:1787826193.607022:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826193.607761:0:172937:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46aa58800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787826193.607812:0:172937:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a4e8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787826193.607838:0:172937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46aa5f800 for lustre-MDT0000 00000020:00000080:3.0:1787826193.607842:0:172937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f953800 for lustre-MDT0001 00000100:00080000:1.0:1787826193.607916:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826193.607953:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c997000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826193.607972:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049312000:0@lo:39:umount.0 00000100:00080000:3.0:1787826193.610010:0:193299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787826193.610018:0:193299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787826193.610025:0:193299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787826193.612419:0:193299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.612436:0:193299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.612443:0:193299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.612451:0:193299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.612479:0:193299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826193.612486:0:193299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.612493:0:193299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.612499:0:193299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.612505:0:193299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826193.612522:0:193299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787826193.612527:0:193299:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787826193.612587:0:193299:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787826193.612591:0:193299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:1.0:1787826193.612596:0:193299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787826193.612602:0:193299:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:3.0:1787826193.613549:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826193.613558:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613566:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826193.613569:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613577:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826193.613584:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826193.613590:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826193.613592:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787826193.613594:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787826193.613629:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613635:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826193.613667:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613673:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00ced113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced11a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613684:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826193.613687:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613692:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826193.613695:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613701:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826193.613707:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826193.613713:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787826193.613714:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787826193.613716:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787826193.613728:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613733:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826193.613738:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613744:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3200/0x878a5eea00ced121 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced128 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.613752:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826193.613754:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826193.613755:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826193.613771:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049312256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826193.613836:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826193.613882:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826193.613888:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049312128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826193.613910:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826193.613940:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049312256 00000100:00100000:3.0:1787826193.613946:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049312256 00000100:00100000:3.0:1787826193.613982:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049312128 00000100:00100000:3.0:1787826193.613985:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049312128 00000100:00100000:3.0:1787826193.614005:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4222 00000100:00100000:3.0:1787826193.614014:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049312256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826193.614026:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826193.614040:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64200/0x878a5eea00ced128 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced121 expref: 24 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826193.614051:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826193.614163:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4223 00000100:00100000:0.0:1787826193.614172:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3620:x1874663049312128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826193.614188:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826193.614198:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3e00/0x878a5eea00ced11a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced113 expref: 23 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826193.614206:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826193.614238:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3620:x1874663049312256:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826193.614245:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4222 00000100:00100000:3.0:1787826193.614285:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049312256:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826193.614801:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826193.615521:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3620:x1874663049312128:12345-0@lo:103:ldlm_bl.0 Request processed in 1348us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826193.615534:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4223 00000100:00100000:3.0:1787826193.615588:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049312128:0@lo:103:ldlm_bl.0 00002000:00000080:1.0:1787826193.618840:0:193299:0:(ofd_obd.c:1268:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:1.0:1787826193.618920:0:193299:0:(ofd_obd.c:1282:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:0.0:1787826193.621525:0:193299:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787826193.621537:0:193299:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8eb47a6a1000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 34359738466 stale:0 00000020:00080000:0.0:1787826193.621545:0:193299:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8eb3496af800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 34359738459 stale:0 00000020:00080000:0.0:1787826193.621549:0:193299:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8eb348ce0000) has exports, disconnecting them 00000020:00080000:0.0:1787826193.621553:0:193299:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8eb47a6a1000), last request at 1787826191 00000020:00000080:0.0:1787826193.621561:0:193299:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced056 00000100:00080000:0.0:1787826193.621573:0:193299:0:(import.c:65:import_set_state_nolock()) ffff8eb47a6a0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826193.621607:0:193299:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb47a6a1000): rc 0 00000020:00000080:0.0:1787826193.621609:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb47a6a1000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1787826193.621624:0:193299:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8eb3496af800), last request at 1787826192 00000020:00000080:0.0:1787826193.621627:0:193299:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7246 00000100:00080000:0.0:1787826193.621632:0:193299:0:(import.c:65:import_set_state_nolock()) ffff8eb3496a8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826193.621646:0:193299:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb3496af800): rc 0 00000020:00000080:0.0:1787826193.621648:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb3496af800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1787826193.621676:0:193299:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8eb348ce0000) has no exports 00010000:00010000:2.0:1787826193.622257:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826193.622298:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a6a1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787826193.622369:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3496af800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787826193.622389:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47a6a0800 for lustre-OST0000 00000020:00000080:3.0:1787826193.622393:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3496a8800 for lustre-OST0000 00010000:00010000:1.0:1787826193.623310:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787826193.629612:0:193299:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb477eeaea0 - data ffff8eb472244000/ffff8eb3435e3000 00000020:01000000:1.0:1787826193.630924:0:193299:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb47a5479c0 - data ffff8eb4479ba438/ffff8eb47a4ba000 00100000:10000000:2.0:1787826193.657317:0:193299:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787826193.670972:0:193299:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cb90d7 00000020:00000080:2.0:1787826193.670991:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb443ea6000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787826193.671019:0:193299:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb481220000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787826193.671023:0:193299:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb481220000 2 00000020:01000004:2.0:1787826193.671027:0:193299:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb481220000 from lustre-OST0000 00000020:00000080:2.0:1787826193.671059:0:193299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826193.671168:0:172937:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb443ea6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787826193.671207:0:193299:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787826193.671212:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb443ea2800/lustre-OST0000_UUID 00000020:00000080:2.0:1787826193.671215:0:193299:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb443ea2800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787826193.671223:0:193299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787826193.671354:0:193299:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1787826193.671360:0:193299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787826193.671364:0:193299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826193.671373:0:193299:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787826193.671382:0:193299:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8eb34c997800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826193.671389:0:193299:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8eb481d5b370) has exports, disconnecting them 00000020:00080000:2.0:1787826193.671396:0:193299:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8eb34c997800), last request at 1787825772 00000020:00000080:2.0:1787826193.671401:0:193299:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cb9116 00000020:00080000:2.0:1787826193.671412:0:193299:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb34c997800): rc 0 00000020:00000080:2.0:1787826193.671418:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb34c997800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787826193.682655:0:172937:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c997800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787826193.692725:0:193299:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787826193.692737:0:193299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826193.692743:0:193299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826193.692752:0:193299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826193.692973:0:193299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826193.692988:0:193299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787826193.692996:0:193299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787826193.693003:0:193299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826193.693009:0:193299:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826193.693019:0:193299:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8eb34c993000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826193.693026:0:193299:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8eb348ce19b8) has exports, disconnecting them 00000020:00080000:0.0:1787826193.693032:0:193299:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8eb34c993000), last request at 1787825772 00000020:00000080:0.0:1787826193.693037:0:193299:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cb912b 00000020:00080000:0.0:1787826193.693056:0:193299:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb34c993000): rc 0 00000020:00000080:0.0:1787826193.693063:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb34c993000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787826193.693980:0:172937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb4727db000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787826193.693992:0:172937:0:(genops.c:885:class_export_put()) final put ffff8eb4816ca800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787826193.693996:0:172937:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4816ca800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787826193.694012:0:172937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787826193.694147:0:172937:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c993000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787826193.694189:0:193299:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787826193.694193:0:193299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787826193.695477:0:193299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787826193.695495:0:193299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826193.695593:0:172937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb34c997000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787826193.697056:0:193299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826193.697078:0:193299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787826193.697085:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb34c994800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787826193.697089:0:193299:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c994800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787826193.697097:0:193299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787826193.697239:0:193299:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb481220000 1 00000020:00000080:1.0:1787826193.697247:0:193299:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cb90bb 00000020:00000080:1.0:1787826193.697256:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb349085800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787826193.697276:0:193299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787826193.697296:0:172937:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb349085800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787826193.697310:0:193299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826193.697316:0:193299:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787826193.697321:0:193299:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8eb4815f4d28) has no exports 00000020:00000080:0.0:1787826194.128586:0:193299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826194.128611:0:193299:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787826194.128618:0:193299:0:(genops.c:885:class_export_put()) final put ffff8eb481226000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787826194.128624:0:193299:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481226000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787826194.128638:0:193299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787826194.129897:0:193299:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8eb481223800 00000020:02000400:0.0:1787826194.130005:0:193299:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787826194.262738:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826194.262883:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826194.262909:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049312384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826194.262999:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826194.263069:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049312384 00000100:00100000:0.0:1787826194.263238:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049312384 00000100:00100000:0.0:1787826194.263315:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12684 00000100:00100000:0.0:1787826194.263348:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049312384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826194.263400:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826194.263470:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049312384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826194.263479:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12684 00000100:00100000:0.0:1787826194.263650:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049312384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826194.264830:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826194.264851:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049312640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.264922:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826194.264969:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049312640 00000100:00100000:1.0:1787826194.264977:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049312640 00000100:00100000:1.0:1787826194.265040:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787826194.265050:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049312640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265116:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049312640:12345-0@lo:400:kworker.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826194.265123:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1787826194.265180:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826194.265216:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049312640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265266:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049312768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265291:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826194.265320:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049312768 00000100:00100000:1.0:1787826194.265347:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049312768 00000100:00100000:1.0:1787826194.265379:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787826194.265386:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049312768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265425:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049312768:12345-0@lo:400:kworker.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826194.265432:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:1.0:1787826194.265459:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826194.265478:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049312768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265656:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826194.265664:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049313152:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826194.265738:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049313280:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265761:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826194.265815:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826194.265822:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049313664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826194.265869:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049313280 00000100:00100000:1.0:1787826194.265873:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049313280 00000100:00100000:1.0:1787826194.265897:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049313664 00000100:00100000:1.0:1787826194.265900:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049313664 00000100:00100000:1.0:1787826194.265918:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787826194.265925:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049313280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.265964:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049313280:12345-0@lo:400:kworker.0 Request processed in 40us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826194.265970:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787826194.265984:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787826194.265989:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049313664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.266016:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049313664:12345-0@lo:400:kworker.0 Request processed in 27us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826194.266021:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787826194.266053:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049313664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.266064:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049313280:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.266679:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049312896:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.266729:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826194.266769:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049313408:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.266795:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826194.266819:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787826194.266826:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049312512:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.266857:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826194.266879:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049313024:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.266901:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826194.266922:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049313536:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.266944:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826194.266977:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049312896 00000100:00100000:2.0:1787826194.266982:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049312896 00000100:00100000:2.0:1787826194.267032:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12685 00000100:00100000:2.0:1787826194.267041:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049312896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.267102:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049312896:12345-0@lo:400:kworker.0 Request processed in 63us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826194.267109:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12685 00000100:00100000:2.0:1787826194.267231:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049313152 00000100:00100000:2.0:1787826194.267236:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049313152 00000100:00100000:2.0:1787826194.267277:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049313408 00000100:00100000:2.0:1787826194.267280:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049313408 00000100:00100000:2.0:1787826194.267299:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049313024 00000100:00100000:2.0:1787826194.267302:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049313024 00000100:00100000:2.0:1787826194.267317:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049313536 00000100:00100000:2.0:1787826194.267320:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049313536 00000100:00100000:2.0:1787826194.267370:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7037 00000100:00100000:2.0:1787826194.267377:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049313152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.267420:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049313152:12345-0@lo:400:kworker.0 Request processed in 44us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826194.267430:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7037 00000100:00100000:2.0:1787826194.267443:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7038 00000100:00100000:2.0:1787826194.267459:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049313536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.267488:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049313536:12345-0@lo:400:kworker.0 Request processed in 39us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826194.267494:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7038 00000100:00100000:2.0:1787826194.267778:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22559 00000100:00100000:2.0:1787826194.267783:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3617:x1874663049313408:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787826194.267790:0:43905:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826194.267824:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3617:x1874663049313408:12345-0@lo:400:kworker.0 Request processed in 39us (1028us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826194.267830:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22559 00000100:00100000:2.0:1787826194.267841:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22560 00000100:00100000:2.0:1787826194.267845:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3617:x1874663049313024:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787826194.267849:0:43905:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826194.267871:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3617:x1874663049313024:12345-0@lo:400:kworker.0 Request processed in 25us (969us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826194.267877:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22560 00000100:00080000:2.0:1787826194.267947:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826194.267953:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826194.267957:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:2.0:1787826194.267972:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1787826194.267975:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826194.267979:0:3617:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8053 00000100:00080000:2.0:1787826194.267987:0:3617:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826194.268160:0:192365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049312512 00000100:00100000:0.0:1787826194.268166:0:192365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049312512 00000100:00100000:0.0:1787826194.268206:0:192365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787826194.268214:0:192365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3617:x1874663049312512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826194.268254:0:192365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3617:x1874663049312512:12345-0@lo:400:kworker.0 Request processed in 42us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826194.268260:0:192365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826194.269422:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f66300 x1874663049313792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826194.269467:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049313024:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.270669:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049313536:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.270704:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049312896:0@lo:400:kworker.0 00000100:00080000:2.0:1787826194.270719:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826194.270725:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb47754e000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826194.270728:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:2.0:1787826194.270746:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1787826194.270748:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb47754e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826194.270754:0:3617:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8219 00000100:00080000:2.0:1787826194.270762:0:3617:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb47754e000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826194.270800:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f64380 x1874663049313920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826194.270815:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049313408:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.270854:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049312512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826194.271706:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049313792:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1787826194.271792:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826194.271829:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049313920:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1787826194.271856:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826194.272426:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826194.272489:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049313152:0@lo:400:kworker.0 00000100:00100000:2.0:1787826194.273407:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049313792 00000100:00100000:2.0:1787826194.273419:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049313792 00000100:00100000:2.0:1787826194.273484:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049313920 00000100:00100000:2.0:1787826194.273488:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049313920 00000100:00100000:2.0:1787826194.273526:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22561 00000100:00100000:2.0:1787826194.273536:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3616:x1874663049313792:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:2.0:1787826194.273569:0:177402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826194.273666:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3616:x1874663049313792:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 129us (1872us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826194.273673:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22561 00000100:00100000:2.0:1787826194.273691:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22562 00000100:00100000:2.0:1787826194.273696:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3616:x1874663049313920:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:2.0:1787826194.273705:0:177402:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826194.273736:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3616:x1874663049313920:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 38us (1878us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826194.273741:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22562 00000100:00080000:2.0:1787826194.273795:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826194.273801:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826194.273805:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049313792:0@lo:8:ptlrpcd_00_00.0 00000100:00080000:2.0:1787826194.273816:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47754e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826194.273819:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826194.273822:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049313920:0@lo:8:ptlrpcd_00_00.0 00010000:00010000:2.0:1787826195.287900:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826196.312232:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826196.312263:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049314048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826196.312376:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826196.313681:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049314048 00000100:00100000:2.0:1787826196.313697:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049314048 00000100:00100000:2.0:1787826196.313781:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5799 00000100:00100000:2.0:1787826196.313796:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049314048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826196.313837:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826196.313924:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049314048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826196.313933:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5799 00000100:00100000:2.0:1787826196.313997:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049314048:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787826196.315735:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826196.315885:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826196.315911:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049314176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826196.315990:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826196.316062:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049314176 00000100:00100000:3.0:1787826196.316070:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049314176 00000100:00100000:3.0:1787826196.316122:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12686 00000100:00100000:3.0:1787826196.316132:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049314176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826196.316175:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445629952 avail 1299390464 00000100:00100000:3.0:1787826196.316228:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049314176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826196.316237:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12686 00000100:00100000:3.0:1787826196.316292:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049314176:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787826196.316449:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826197.332778:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049314304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826197.332884:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826197.333244:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049314304 00000100:00100000:2.0:1787826197.333256:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049314304 00010000:00010000:1.0:1787826197.333280:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826197.333384:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5800 00000100:00100000:2.0:1787826197.333400:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049314304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826197.333455:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826197.333534:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049314304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826197.333544:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5800 00000001:00100000:2.0:1787826197.334719:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000001:00080000:2.0:1787826197.334735:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869982 is committed 00000020:00000080:2.0:1787826197.334740:0:187942:0:(genops.c:885:class_export_put()) final put ffff8eb442c2e800/a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000100:00080000:0.0:1787826197.334998:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826197.335095:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049314304:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1787826197.337874:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb442c2e800/a9ce6693-0634-46c5-bf21-5ca7d026d44e for lustre-MDT0001 00000001:00100000:0.0:1787826197.338204:0:192354:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000001:00080000:0.0:1787826197.338219:0:192354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383684 is committed 00000020:00000080:0.0:1787826197.338227:0:192354:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e5000/a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:0.0:1787826197.338297:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3496ac000 for lustre-MDT0001 00000020:00000080:0.0:1787826197.338303:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e5000/a9ce6693-0634-46c5-bf21-5ca7d026d44e for lustre-MDT0000 00000020:00000080:0.0:1787826197.338366:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb45ec36000 for lustre-MDT0000 00000001:00100000:2.0:1787826197.339261:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:2.0:1787826197.339267:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb47a4ed000/a9ce6693-0634-46c5-bf21-5ca7d026d44e 00000020:00000080:1.0:1787826197.339359:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a4ed000/a9ce6693-0634-46c5-bf21-5ca7d026d44e for lustre-OST0001 00000020:00000080:1.0:1787826197.339427:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46aa5c000 for lustre-OST0001 00010000:00010000:3.0:1787826198.359590:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826198.760899:0:193501:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787826198.760948:0:193501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826198.760962:0:193501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826198.760970:0:193501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826198.760978:0:193501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826198.761007:0:193501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787826198.761013:0:193501:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787826198.761041:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787826198.761046:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787826198.761052:0:193501:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787826198.761075:0:193501:0:(import.c:65:import_set_state_nolock()) ffff8eb34df97000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787826198.761161:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826198.761169:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826198.761178:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ea00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1787826198.761183:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826198.761193:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826198.761202:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826198.761209:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826198.761212:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787826198.761215:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787826198.761243:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826198.761251:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826198.761282:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826198.761290:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8ea00/0x878a5eea00ced08e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced095 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826198.761309:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826198.761345:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826198.761347:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826198.761355:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826198.761373:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049314560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826198.761452:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826198.761515:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049314560 00000100:00100000:1.0:1787826198.761521:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049314560 00000100:00100000:1.0:1787826198.761568:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4224 00000100:00100000:1.0:1787826198.761579:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3620:x1874663049314560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826198.761591:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826198.761608:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced08e expref: 21 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826198.761621:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826198.761658:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:3620:x1874663049314560:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826198.761665:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4224 00000100:00100000:1.0:1787826198.761702:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049314560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826198.761869:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049314432:0@lo:39:umount.0 00000100:00100000:3.0:1787826198.761904:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826198.762135:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049314432 00000100:00100000:1.0:1787826198.762139:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049314432 00000100:00100000:1.0:1787826198.762181:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1787826198.762189:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049314432:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826198.762212:0:187905:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced1b4 00000100:00080000:1.0:1787826198.762221:0:187905:0:(import.c:65:import_set_state_nolock()) ffff8eb477e04000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787826198.762282:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1874663049314432:12345-0@lo:39:umount.0 Request processed in 94us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826198.762290:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000020:00000080:1.0:1787826198.762297:0:187905:0:(genops.c:885:class_export_put()) final put ffff8eb46aa59000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787826198.762491:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787826198.762769:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46aa59000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826198.762825:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb477e04000 for lustre-MDT0000 00000100:00080000:1.0:1787826198.762857:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34df97000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826198.762877:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049314432:0@lo:39:umount.0 00000100:00080000:3.0:1787826198.762938:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826198.762942:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787826198.762948:0:193501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787826198.763924:0:193501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.763940:0:193501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.763948:0:193501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.763956:0:193501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.763974:0:193501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826198.763980:0:193501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.763987:0:193501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.763993:0:193501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.763999:0:193501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764016:0:193501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787826198.764031:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826198.764037:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764046:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826198.764050:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764059:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826198.764067:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826198.764074:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826198.764077:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787826198.764104:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764111:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826198.764127:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764135:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e000/0x878a5eea00cecfae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecfb5 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764151:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826198.764155:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764162:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826198.764165:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764173:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826198.764180:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826198.764186:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826198.764188:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787826198.764191:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787826198.764205:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764211:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826198.764225:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764233:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2a00/0x878a5eea00ced0b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced0b8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764241:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826198.764244:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826198.764246:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826198.764258:0:193501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764266:0:193501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764273:0:193501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764286:0:193501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764297:0:193501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826198.764303:0:193501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764310:0:193501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764317:0:193501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764348:0:193501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764361:0:193501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787826198.764364:0:193501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787826198.764367:0:193501:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787826198.764393:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826198.764397:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764405:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826198.764408:0:9495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764415:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826198.764439:0:9495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826198.764445:0:9495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787826198.764447:0:9495:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787826198.764449:0:9495:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787826198.764463:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764469:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826198.764476:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764483:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00ced080 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced087 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764492:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826198.764495:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764502:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826198.764505:0:9495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764512:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826198.764519:0:9495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826198.764529:0:9495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826198.764531:0:9495:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787826198.764533:0:9495:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787826198.764544:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764550:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826198.764556:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764563:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f600/0x878a5eea00cecfa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cecfa7 expref: -99 pid: 192353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.764572:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826198.764574:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826198.764576:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787826198.764589:0:193501:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787826198.764594:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1787826198.764598:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1787826198.764603:0:193501:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1787826198.766716:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049315072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826198.766786:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826198.766839:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826198.766843:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049314816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826198.766849:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049314688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826198.766890:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826198.766922:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826198.766929:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049314944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826198.766954:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826198.767389:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826198.767413:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1787826198.775738:0:193501:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:2.0:1787826198.777054:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049315072 00000100:00100000:0.0:1787826198.777406:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049314816 00000100:00100000:0.0:1787826198.777414:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049314816 00000100:00100000:0.0:1787826198.777473:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049314944 00000100:00100000:0.0:1787826198.777476:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049314944 00000100:00100000:0.0:1787826198.777501:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225 00000100:00100000:0.0:1787826198.777511:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3617:x1874663049314816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826198.777526:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787826198.777687:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049315072 00000100:00100000:2.0:1787826198.777722:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4226 00000100:00100000:2.0:1787826198.777729:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3617:x1874663049314944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826198.777737:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826198.777747:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ced087 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced080 expref: 22 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826198.777763:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826198.777818:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3617:x1874663049314944:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (10863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826198.777825:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4226 00000100:00100000:2.0:1787826198.777844:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4227 00000100:00100000:2.0:1787826198.777851:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:3619:x1874663049315072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826198.777858:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826198.777868:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64400/0x878a5eea00cecfa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecfa0 expref: 20 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826198.777877:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826198.777900:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3619:x1874663049315072:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (11115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826198.777907:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4227 00000100:00100000:2.0:1787826198.778061:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826198.778104:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049315072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826198.778129:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049314688 00000100:00100000:2.0:1787826198.778133:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049314688 00000100:00100000:2.0:1787826198.778157:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4228 00000100:00100000:2.0:1787826198.778164:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb450a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3619:x1874663049314688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826198.778171:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826198.778179:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65e00/0x878a5eea00cecfb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cecfae expref: 19 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826198.778189:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826198.778223:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb450a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:3619:x1874663049314688:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826198.778229:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4228 00000100:00100000:2.0:1787826198.778254:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049314688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826198.778430:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced0b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced0b1 expref: 21 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826198.778443:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826198.778471:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:3617:x1874663049314816:12345-0@lo:103:ldlm_bl.0 Request processed in 961us (11582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826198.778480:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4225 00000100:00100000:0.0:1787826198.778543:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049314944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826198.778617:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049314816:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787826198.779217:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1787826198.779226:0:193501:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb46aa5b000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826198.779232:0:193501:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb349084800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826198.779238:0:193501:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb34b9e0800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 330712483740 stale:0 00000020:00080000:2.0:1787826198.779243:0:193501:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8eb343ea4d28) has exports, disconnecting them 00000020:00080000:2.0:1787826198.779248:0:193501:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb46aa5b000), last request at 1787826158 00000020:00000080:2.0:1787826198.779255:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced1ad 00000100:00080000:2.0:1787826198.779262:0:193501:0:(import.c:65:import_set_state_nolock()) ffff8eb46aa59800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826198.779290:0:193501:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb46aa5b000): rc 0 00000020:00000080:2.0:1787826198.779293:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb46aa5b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787826198.779311:0:193501:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb349084800), last request at 1787826194 00000020:00000080:2.0:1787826198.779315:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced19f 00000100:00080000:2.0:1787826198.779352:0:193501:0:(import.c:65:import_set_state_nolock()) ffff8eb47a6a7000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826198.779386:0:193501:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb349084800): rc 0 00000020:00000080:2.0:1787826198.779388:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb349084800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787826198.779391:0:193501:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb34b9e0800), last request at 1787826152 00000020:00000080:2.0:1787826198.779394:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced002 00000100:00080000:2.0:1787826198.779400:0:193501:0:(import.c:65:import_set_state_nolock()) ffff8eb477e03000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826198.779406:0:193501:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb34b9e0800): rc 0 00000020:00000080:2.0:1787826198.779407:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e0800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1787826198.779413:0:193501:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb65b81dd7ae0 00000100:00080000:2.0:1787826198.779441:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787826198.779444:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787826198.779479:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826198.779539:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787826198.779653:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46aa5b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826198.779705:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb349084800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826198.779726:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826198.779754:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46aa59800 for lustre-MDT0000 00000020:00000080:1.0:1787826198.779758:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47a6a7000 for lustre-MDT0000 00000020:00000080:1.0:1787826198.779762:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb477e03000 for lustre-MDT0000 00010000:00010000:1.0:1787826198.779772:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826198.781546:0:193501:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787826198.781574:0:193501:0:(import.c:65:import_set_state_nolock()) ffff8eb45a03b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787826198.781844:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787826198.781849:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738464 gen 3 00000100:00100000:2.0:1787826198.781862:0:193501:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb479b40700 x1874663049309056/t34359738466(34359738466) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787826203 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787826198.781872:0:193501:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479b40700, transno 34359738466 00000004:00080000:2.0:1787826198.781934:0:193501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826198.781968:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049315200:0@lo:39:umount.0 00000100:00080000:2.0:1787826198.781997:0:193501:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787826198.782002:0:193501:0:(import.c:65:import_set_state_nolock()) ffff8eb47754e000 lustre-OST0000_UUID: changing import state from DISCONN to CLOSED 00000004:00080000:2.0:1787826198.782007:0:193501:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787826198.782009:0:193501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787826198.782012:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787826198.782014:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975535 gen 3 00000004:00080000:2.0:1787826198.782024:0:193501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826198.782039:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826198.782083:0:193501:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787826198.782093:0:193501:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec37800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787826198.782108:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049315200 00000100:00100000:1.0:1787826198.782116:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049315200 00000020:00080000:2.0:1787826198.782137:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb343ea4d28) has no exports 00000100:00100000:1.0:1787826198.782165:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12687 00000100:00100000:1.0:1787826198.782175:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049315200:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826198.782200:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced041 00000100:00080000:1.0:1787826198.782215:0:8414:0:(import.c:65:import_set_state_nolock()) ffff8eb448c37000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787826198.782232:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 4, last_transno is 17179869982 00000100:00100000:1.0:1787826198.782400:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1874663049315200:12345-0@lo:39:umount.0 Request processed in 226us (361us total) trans 17179869983 rc 0/0 00000100:00100000:1.0:1787826198.782407:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12687 00010000:00010000:1.0:1787826198.782460:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826198.782470:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049315328:0@lo:9:umount.0 00000100:00100000:1.0:1787826198.782498:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826198.782536:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45a03b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826198.782542:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049315200:0@lo:39:umount.0 00000100:00100000:2.0:1787826198.782591:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049315328 00000100:00100000:2.0:1787826198.782596:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049315328 00000100:00100000:2.0:1787826198.782637:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22563 00000100:00100000:2.0:1787826198.782643:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049315328:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787826198.782659:0:43906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced06b 00000100:00080000:2.0:1787826198.782665:0:43906:0:(import.c:65:import_set_state_nolock()) ffff8eb47986d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826198.782699:0:43906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975535 00000100:00100000:2.0:1787826198.782797:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049315328:12345-0@lo:9:umount.0 Request processed in 153us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826198.782805:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22563 00000100:00080000:2.0:1787826198.782822:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826198.782832:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826198.785251:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec37800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787826198.785274:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787826198.785276:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826198.785282:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049315328:0@lo:9:umount.0 00000020:00080000:0.0:1787826198.785633:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb343ea4d28) has no exports 00000020:00000080:0.0:1787826198.823614:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced017 00000020:00000080:0.0:1787826198.823630:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb46e35c800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787826198.823649:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787826198.823688:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e35c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787826198.823758:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826198.823770:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787826198.823774:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8eb341a699b8) has no exports 00000020:00000080:1.0:1787826198.824214:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced010 00000020:00000080:1.0:1787826198.824220:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb47f7e7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787826198.824279:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826198.824286:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787826198.824290:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb34df94800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787826198.824292:0:193501:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34df94800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787826198.824302:0:193501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787826198.824558:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f7e7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787826198.824863:0:193501:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb477eeab40 - data ffff8eb4720965e8/ffff8eb47bfda000 00000020:01000000:1.0:1787826198.825034:0:193501:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb4815fe9c0 - data ffff8eb447a59bd0/ffff8eb341092c00 00000100:00080000:0.0:1787826198.888477:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826198.888486:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787826198.888499:0:193501:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb477f64a80 x1874663049315200/t17179869983(17179869983) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826208 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826198.888527:0:193501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787826198.894653:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787826198.894662:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738464 gen 4 00000004:00080000:0.0:1787826198.894732:0:193501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826198.894737:0:193501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787826198.895804:0:192373:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787826198.895810:0:192373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x140:0x0] index 2 count 2 00000040:00080000:1.0:1787826198.895833:0:192373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 80 count 2 00000100:00080000:0.0:1787826198.896206:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787826198.896211:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975535 gen 4 00000004:00080000:0.0:1787826198.896229:0:193501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826198.896231:0:193501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787826198.897045:0:192375:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787826198.897049:0:192375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x142:0x0] index 1 count 1 00000040:00080000:1.0:1787826198.897059:0:192375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 80 count 2 00000020:00000080:0.0:1787826198.899063:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecfc3 00000020:00000080:0.0:1787826198.899074:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb343647000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787826198.902713:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343647000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826198.905926:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecfd8 00000020:00000080:0.0:1787826198.905954:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb341afd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787826198.905973:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787826198.905980:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826198.905989:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826198.905994:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8eb343ea3370) has no exports 00000020:00000080:3.0:1787826198.906076:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb341afd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1787826198.906397:0:193501:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787826198.906408:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced064 00000020:00000080:0.0:1787826198.906416:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb47a6a4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787826198.906445:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787826198.906512:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826198.906519:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826198.906522:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8eb3449f19b8) has no exports 00000020:00000080:1.0:1787826198.906529:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced05d 00000020:00000080:1.0:1787826198.906534:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb481225800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787826198.906557:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a6a4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787826198.906565:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481225800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787826198.907384:0:193501:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787826198.907390:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787826198.907394:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975535 gen 5 00000004:00080000:1.0:1787826198.907400:0:193501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826198.907404:0:193501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826198.907501:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826198.907508:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826198.907514:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced048 00000020:00000080:1.0:1787826198.907520:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb47a6a7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826198.908310:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb45ec37800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787826198.908319:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb47a6a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826198.908321:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a6a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787826198.908352:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787826198.908563:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='F') 00000020:00000080:1.0:1787826198.908569:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826198.908577:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826198.908581:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8eb344e619b8) has no exports 00000020:00000080:1.0:1787826198.908587:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced03a 00000020:00000080:1.0:1787826198.908592:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb47754e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787826198.909090:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a6a7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787826198.909724:0:193501:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787826198.909728:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787826198.909731:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738464 gen 5 00000004:00080000:1.0:1787826198.909736:0:193501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826198.909738:0:193501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826198.910414:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47754e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787826198.910523:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826198.910533:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787826198.910548:0:193501:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787826198.910556:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced02c 00000020:00000080:1.0:1787826198.910564:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb469f61000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787826198.910568:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787826198.910572:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826198.910576:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826198.910580:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8eb46a874d28) has no exports 00000020:00000080:1.0:1787826198.910585:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced025 00000020:00000080:1.0:1787826198.910588:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb47f75f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787826198.911648:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47754e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787826198.911659:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb469f62000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826198.911662:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb469f62000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787826198.911667:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826198.912503:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb469f61000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787826198.912511:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f75f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787826198.917398:0:193501:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787826198.917407:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826198.917411:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826198.917429:0:193501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826198.917491:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826198.917504:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826198.917504:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb45a03b000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787826198.917516:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb343644000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826198.917519:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343644000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787826198.917527:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826198.917536:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826198.917540:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826198.917543:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb341ac8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826198.917546:0:193501:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb341ac8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787826198.917557:0:193501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826198.917673:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecfdf 00000020:00000080:0.0:1787826198.917680:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb341af8800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787826198.917697:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787826198.917701:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826198.917706:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826198.917710:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8eb343ea19b8) has no exports 00000020:00000080:0.0:1787826198.917736:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826198.917739:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787826198.917749:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecfe6 00000020:00000080:0.0:1787826198.917753:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb341aff800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787826198.917761:0:193501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb4727dc000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787826198.917764:0:193501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb4727dc000 3 00000020:01000004:0.0:1787826198.917767:0:193501:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb4727dc000 from lustre-MDT0000 00000020:00000080:3.0:1787826198.917772:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb341af8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787826198.917779:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb341afb000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787826198.917781:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb341afb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787826198.917786:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787826198.917789:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826198.917793:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787826198.917796:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb343643800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787826198.917798:0:193501:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343643800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787826198.917808:0:193501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1787826198.917856:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb341aff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1787826198.917859:0:193501:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787826198.917863:0:193501:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787826198.917877:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787826198.917880:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826198.917883:0:193501:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826198.917889:0:193501:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb46abe9800 205ad83e-e455-4070-92a2-f1e25b8f3f40 0@lo 15 (0 0 10) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826198.917894:0:193501:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8eb46a8719b8) has exports, disconnecting them 00000020:00080000:0.0:1787826198.917897:0:193501:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8eb46abe9800), last request at 1787826152 00000020:00000080:0.0:1787826198.917911:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecf92 00000020:00010000:0.0:1787826198.917915:0:193501:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb46abe9800: total 0 00000100:00080000:0.0:1787826198.917918:0:193501:0:(import.c:65:import_set_state_nolock()) ffff8eb46abef000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826198.917943:0:193501:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb46abe9800): rc 0 00000020:00080000:0.0:1787826198.917966:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8eb46a8719b8) has no exports 00000020:00010000:3.0:1787826198.918183:0:9495:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb46abe9800: total 0 00010000:00010000:3.0:1787826198.918225:0:9495:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb46abe9800, canceled 0 locks, left on hash table 10. 00010000:00010000:3.0:1787826198.918257:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3800/0x878a5eea00ced16e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced167 expref: 11 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918274:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce2800/0x878a5eea00ced0fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced0f7 expref: 10 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918291:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8e200/0x878a5eea00ced136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced12f expref: 9 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918306:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64000/0x878a5eea00ced0c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced0bf expref: 8 pid: 192365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918316:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8fa00/0x878a5eea00ced144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced13d expref: 7 pid: 192361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918347:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65000/0x878a5eea00ced0d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced0cd expref: 6 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918365:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ced160 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced159 expref: 5 pid: 192359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918379:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce2c00/0x878a5eea00ced0f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced0e9 expref: 4 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918392:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf39a00/0x878a5eea00ced152 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced14b expref: 3 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918409:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3c00/0x878a5eea00ced0e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced0db expref: 2 pid: 192360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826198.918437:0:9495:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb46abe9800, canceled 10 locks, left on hash table 0. 00000020:00000080:3.0:1787826198.918453:0:9495:0:(genops.c:885:class_export_put()) final put ffff8eb46abe9800/205ad83e-e455-4070-92a2-f1e25b8f3f40 00010000:00010000:3.0:1787826198.918471:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826198.918474:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826198.918476:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826198.918484:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46abe9800/205ad83e-e455-4070-92a2-f1e25b8f3f40 for MGS 00000020:00000080:3.0:1787826198.918511:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46abef000 for MGS 00000100:00100000:0.0:1787826198.918964:0:192361:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8eb341ae6400:192361] 2 exiting: rc = 0 00000100:00100000:0.0:1787826198.919359:0:192365:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8eb450e40000:192365] 3 exiting: rc = 0 00000100:00100000:0.0:1787826198.919441:0:192360:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8eb341ae6e00:192360] 1 exiting: rc = 0 00000100:00100000:0.0:1787826198.920404:0:192359:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8eb446998e00:192359] 0 exiting: rc = 1 00000100:00100000:3.0:1787826198.920665:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920675:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920682:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920691:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920700:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920705:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920717:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920723:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920729:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920735:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920741:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920748:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920755:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920763:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920770:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920778:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920785:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920792:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920799:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920806:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920813:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920818:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920824:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920829:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920835:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920840:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920846:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920852:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920857:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920862:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920868:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920873:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920877:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920884:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920889:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920895:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920900:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920905:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920910:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920916:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920922:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920927:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920933:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920954:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920960:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920970:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920975:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920981:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920988:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.920995:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921002:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921010:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921018:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921026:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921032:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921037:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921219:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921227:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921234:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921242:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921253:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921265:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921276:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787826198.921283:0:193501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1787826198.922786:0:193501:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb477eeaa20 - data ffff8eb447b13438/ffff8eb44f6afc00 00000020:01000000:3.0:1787826198.922929:0:193501:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb4815fe7e0 - data ffff8eb447979ca8/ffff8eb477dfe400 00000020:00000080:3.0:1787826198.930672:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecf84 00000020:00000080:3.0:1787826198.930685:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb448c99000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787826198.930697:0:193501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb4727dc000 from MGS, refs=2 00000020:01000004:3.0:1787826198.930700:0:193501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb4727dc000 2 00000020:01000004:3.0:1787826198.930703:0:193501:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb4727dc000 from MGS 00000020:00000080:3.0:1787826198.930724:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787826198.930731:0:193501:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787826198.930733:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb448c9a000/MGS 00000020:00000080:3.0:1787826198.930735:0:193501:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c9a000/MGS for MGS 00000020:01000000:3.0:1787826198.930741:0:193501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787826198.930804:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787826198.930807:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826198.930812:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787826198.930818:0:193501:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8eb481220800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787826198.930823:0:193501:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8eb341a6cd28) has exports, disconnecting them 00000020:00080000:3.0:1787826198.930828:0:193501:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8eb481220800), last request at 1787826153 00000020:00000080:3.0:1787826198.930832:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced0a3 00000020:00080000:3.0:1787826198.930839:0:193501:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb481220800): rc 0 00000020:00000080:3.0:1787826198.930843:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb481220800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787826198.932491:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c99000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826198.932510:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481220800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787826198.934434:0:193501:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787826198.934442:0:193501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826198.934446:0:193501:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826198.934452:0:193501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826198.934481:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb34df97000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787826198.934833:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826198.934842:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787826198.934847:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb341aff000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787826198.934851:0:193501:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb341aff000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787826198.934857:0:193501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787826198.936936:0:193501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb4727dc000 1 00000020:00000080:0.0:1787826198.936946:0:193501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cecf76 00000020:00000080:0.0:1787826198.936953:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb448c9e000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787826198.936970:0:193501:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787826198.936986:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c9e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826198.937003:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826198.937009:0:193501:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787826198.937014:0:193501:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8eb341a6b370) has no exports 00000020:00000080:0.0:1787826199.060083:0:193501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826199.060096:0:193501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787826199.060173:0:193501:0:(genops.c:885:class_export_put()) final put ffff8eb4727da800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826199.060180:0:193501:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4727da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787826199.060192:0:193501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787826199.060306:0:193501:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8eb4727d8800 00000020:02000400:0.0:1787826199.061249:0:193501:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:1.0:1787826199.382615:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826199.382622:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826199.382626:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826199.382634:0:185677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8261 00000100:00080000:1.0:1787826199.382640:0:185677:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826199.382647:0:185677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826199.382669:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476ca6a00 x1874663049315968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826199.382733:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049315456:0@lo:400:kworker.0 00000400:00000100:1.0:1787826199.382784:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049315456 offset 0 length 224: 4 00000100:00100000:1.0:1787826199.382831:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049316096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826199.382863:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826199.382890:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826199.382896:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049315840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826199.382922:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826199.382950:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049315584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826199.382976:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826199.382994:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049316224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826199.383014:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826199.383032:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826199.383050:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049315712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826199.383072:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826199.383100:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049315968:0@lo:8:kworker.0 00000100:00100000:1.0:1787826199.383123:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826199.383342:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049316096 00000100:00100000:1.0:1787826199.383351:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049316096 00000100:00100000:1.0:1787826199.383407:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049315968 00000100:00100000:1.0:1787826199.383411:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049315968 00000100:00100000:1.0:1787826199.383442:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7039 00000100:00100000:1.0:1787826199.383451:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049316096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826199.383558:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049316096:12345-0@lo:400:kworker.0 Request processed in 108us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826199.383567:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7039 00000100:00100000:1.0:1787826199.383587:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22564 00000100:00100000:1.0:1787826199.383591:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3616:x1874663049315968:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787826199.383607:0:43902:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826199.383639:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3616:x1874663049315968:12345-0@lo:8:kworker.0 Request processed in 47us (516us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826199.383645:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22564 00000100:00100000:1.0:1787826199.383663:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049315840 00000100:00100000:1.0:1787826199.383667:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049315840 00000100:00100000:1.0:1787826199.383687:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12688 00000100:00100000:1.0:1787826199.383692:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1874663049315840:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826199.383698:0:8415:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826199.383721:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1874663049315840:12345-0@lo:400:kworker.0 Request processed in 27us (798us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826199.383726:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12688 00000100:00100000:1.0:1787826199.383745:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049315584 00000100:00100000:1.0:1787826199.383749:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049315584 00000100:00100000:1.0:1787826199.383768:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049316224 00000100:00100000:1.0:1787826199.383771:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049316224 00000100:00100000:1.0:1787826199.383780:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049315712 00000100:00100000:1.0:1787826199.383782:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049315712 00000100:00100000:1.0:1787826199.383798:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787826199.383804:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049315712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826199.383836:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049315712:12345-0@lo:400:kworker.0 Request processed in 32us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826199.383841:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787826199.383852:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1787826199.383855:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1874663049315584:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826199.383859:0:188992:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826199.383878:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1874663049315584:12345-0@lo:400:kworker.0 Request processed in 21us (901us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826199.383883:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1787826199.383892:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1787826199.383896:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1874663049316224:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826199.383899:0:188992:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826199.383918:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1874663049316224:12345-0@lo:400:kworker.0 Request processed in 21us (904us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826199.383923:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00080000:1.0:1787826199.383946:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826199.383949:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826199.383995:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826199.384000:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826199.384003:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049315968:0@lo:8:kworker.0 00000100:00080000:0.0:1787826199.384343:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826199.384348:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826199.384352:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826199.384357:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826199.384362:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8225 00000100:00080000:0.0:1787826199.384368:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826199.384391:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4774f1180 x1874663049316352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826199.384410:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049315840:0@lo:400:kworker.0 00000100:00100000:0.0:1787826199.384438:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049316096:0@lo:400:kworker.0 00000100:00100000:0.0:1787826199.384485:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049316352:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787826199.384517:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826199.384548:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049316352 00000100:00100000:0.0:1787826199.384552:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049316352 00000100:00100000:0.0:1787826199.384574:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12689 00000100:00100000:0.0:1787826199.384579:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049316352:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1787826199.384593:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826199.384623:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049316352:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 42us (105us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826199.384629:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12689 00000100:00080000:0.0:1787826199.384657:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826199.384661:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826199.384663:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049316352:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1787826199.386384:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826199.387303:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049315712:0@lo:400:kworker.0 00000100:00080000:0.0:1787826199.387868:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826199.387874:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826199.387878:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826199.387884:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826199.387888:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8225 00000100:00080000:0.0:1787826199.387897:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826199.387932:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4774f1180 x1874663049316480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826199.387953:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049315584:0@lo:400:kworker.0 00000100:00080000:0.0:1787826199.387967:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826199.387970:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826199.387973:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826199.387976:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826199.387979:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8225 00000100:00080000:0.0:1787826199.387983:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826199.387994:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4774f0000 x1874663049316608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826199.388004:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049316224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826199.388142:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049316480:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787826199.388840:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826199.388885:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049316608:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787826199.388910:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826199.389117:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049316480 00000100:00100000:3.0:1787826199.389125:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049316480 00000100:00100000:3.0:1787826199.389163:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049316608 00000100:00100000:3.0:1787826199.389167:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049316608 00000100:00100000:3.0:1787826199.389186:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1787826199.389193:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049316480:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787826199.389212:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826199.389267:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049316480:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 72us (427us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826199.389275:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1787826199.389293:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1787826199.389298:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049316608:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787826199.389368:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826199.389397:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049316608:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 98us (486us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826199.389405:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00080000:1.0:1787826199.389580:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826199.389585:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826199.389589:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049316480:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1787826199.389598:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826199.389601:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826199.389604:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049316608:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1787826200.405547:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826201.429582:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826202.452564:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826202.452695:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049316736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826202.452796:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826202.453130:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049316736 00000100:00100000:3.0:1787826202.453142:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049316736 00000100:00100000:3.0:1787826202.453232:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5801 00000100:00100000:3.0:1787826202.453244:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049316736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826202.453284:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826202.453370:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049316736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826202.453378:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5801 00000100:00080000:1.0:1787826202.453873:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826202.453943:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049316736:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826203.477089:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787826203.999311:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826203.999352:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb47986c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826204.000055:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47986c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787826204.000133:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47986d800 for lustre-OST0001 00000001:00100000:2.0:1787826204.002288:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787826204.002312:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869983 is committed 00000020:00000080:2.0:1787826204.002319:0:187942:0:(genops.c:885:class_export_put()) final put ffff8eb448c38800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826204.002425:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c38800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787826204.002530:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb448c37000 for lustre-MDT0001 00000100:00080000:2.0:1787826204.500699:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826204.500709:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826204.500714:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826204.500728:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8266 00000100:00080000:2.0:1787826204.500736:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826204.500744:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826204.500774:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f65f80 x1874663049316992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826204.500811:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826204.500815:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826204.500817:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826204.500820:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8266 00000100:00080000:2.0:1787826204.500823:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826204.500827:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826204.500839:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f67b80 x1874663049317248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826204.500850:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826204.500855:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826204.500857:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826204.500861:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8266 00000100:00080000:2.0:1787826204.500864:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826204.500871:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826204.500881:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049316992:0@lo:38:kworker.0 00000100:00100000:2.0:1787826204.500891:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f64a80 x1874663049317376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826204.500941:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826204.500946:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826204.500949:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826204.500955:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8266 00000100:00080000:2.0:1787826204.500958:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826204.500963:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826204.500977:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826204.500982:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f67480 x1874663049317632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826204.501028:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049317504:0@lo:400:kworker.0 00000100:00100000:0.0:1787826204.501051:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049317248:0@lo:38:kworker.0 00000100:00100000:2.0:1787826204.501116:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826204.501117:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826204.501198:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826204.501218:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049317120:0@lo:400:kworker.0 00000100:00100000:3.0:1787826204.501419:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049316864:0@lo:400:kworker.0 00000100:00100000:0.0:1787826204.512002:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049317376:0@lo:8:kworker.0 00000100:00100000:0.0:1787826204.512072:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826204.512103:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049317632:0@lo:38:kworker.0 00000100:00100000:0.0:1787826204.512127:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826204.512176:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049317504 00000100:00100000:0.0:1787826204.512184:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049317504 00000100:00100000:0.0:1787826204.512239:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049317376 00000100:00100000:0.0:1787826204.512243:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049317376 00000100:00100000:1.0:1787826204.519365:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826204.519511:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049316992 00000100:00100000:1.0:1787826204.519524:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049316992 00000100:00100000:1.0:1787826204.519570:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049317632 00000100:00100000:1.0:1787826204.519574:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049317632 00000100:00100000:1.0:1787826204.519589:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049317120 00000100:00100000:1.0:1787826204.519592:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049317120 00000100:00100000:1.0:1787826204.519655:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787826204.519668:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049317120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826204.519750:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049317120:12345-0@lo:400:kworker.0 Request processed in 84us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826204.519758:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787826204.519783:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1787826204.519787:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049316992:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826204.519812:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826204.519861:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049316992:12345-0@lo:38:kworker.0 Request processed in 72us (18885us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826204.519868:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1787826204.519882:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1787826204.519887:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049317632:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826204.519896:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826204.519923:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049317632:12345-0@lo:38:kworker.0 Request processed in 35us (7795us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826204.519929:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1787826204.519951:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049317248 00000100:00100000:1.0:1787826204.519956:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049317248 00000100:00100000:1.0:1787826204.519978:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12690 00000100:00100000:1.0:1787826204.519983:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049317248:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826204.519993:0:8415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826204.520024:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049317248:12345-0@lo:38:kworker.0 Request processed in 39us (18922us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826204.520030:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12690 00000100:00080000:1.0:1787826204.520059:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826204.520064:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826204.520130:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049317120:0@lo:400:kworker.0 00000100:00100000:1.0:1787826204.520192:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7040 00000100:00100000:1.0:1787826204.520202:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049317504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826204.520242:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049317504:12345-0@lo:400:kworker.0 Request processed in 42us (19141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826204.520248:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7040 00000100:00100000:1.0:1787826204.520268:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22565 00000100:00100000:1.0:1787826204.520273:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:0+-99:3616:x1874663049317376:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787826204.520283:0:179222:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826204.520311:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:0+-99:3616:x1874663049317376:12345-0@lo:8:kworker.0 Request processed in 37us (8239us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826204.520318:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22565 00000100:00080000:1.0:1787826204.520504:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826204.520511:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826204.520515:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049317376:0@lo:8:kworker.0 00000100:00080000:1.0:1787826204.520528:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826204.520531:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826204.520535:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049317632:0@lo:38:kworker.0 00000100:00080000:1.0:1787826204.520546:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826204.520549:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826204.520553:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049316992:0@lo:38:kworker.0 00000100:00080000:1.0:1787826204.520562:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826204.520566:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826204.520569:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049317248:0@lo:38:kworker.0 00000100:00100000:2.0:1787826204.525395:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049317504:0@lo:400:kworker.0 00000400:00000100:3.0:1787826204.531522:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049316864 offset 0 length 224: 4 00010000:00010000:2.0:1787826205.530000:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826206.548675:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826207.573733:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049317760:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826207.573996:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826207.579782:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826207.581416:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049317760 00000100:00100000:2.0:1787826207.581435:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049317760 00000100:00100000:2.0:1787826207.581562:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5802 00000100:00100000:2.0:1787826207.581578:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049317760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826207.581621:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826207.582117:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049317760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826207.582244:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049317760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 671us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826207.582254:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5802 00000100:00080000:1.0:1787826207.582353:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826208.601219:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826209.621133:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826209.621140:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826209.621143:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826209.621151:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8271 00000100:00080000:3.0:1787826209.621157:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826209.621163:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826209.621185:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e54000 x1874663049318016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826209.621206:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826209.621210:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826209.621211:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826209.621214:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8271 00000100:00080000:3.0:1787826209.621217:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826209.621221:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826209.621233:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e57480 x1874663049318272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826209.621241:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826209.621245:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826209.621246:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826209.621249:0:185677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8271 00000100:00080000:3.0:1787826209.621251:0:185677:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826209.621254:0:185677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826209.621264:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e55500 x1874663049318400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826209.621289:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826209.621292:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826209.621293:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826209.621296:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8271 00000100:00080000:3.0:1787826209.621298:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826209.621301:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826209.621312:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e56680 x1874663049318656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826209.621362:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049318528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826209.621429:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826209.621908:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049318144:0@lo:400:kworker.0 00000100:00100000:0.0:1787826209.621943:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826209.621982:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826209.621989:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049317888:0@lo:400:kworker.0 00000400:00000100:0.0:1787826209.622006:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049317888 offset 0 length 224: 4 00010000:00010000:2.0:1787826209.622178:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826209.622247:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049318016:0@lo:38:kworker.0 00000100:00100000:1.0:1787826209.622291:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826209.622362:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049318272:0@lo:38:kworker.0 00000100:00100000:1.0:1787826209.622393:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826209.622413:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049318400:0@lo:8:kworker.0 00000100:00100000:1.0:1787826209.622434:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826209.622450:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049318656:0@lo:38:kworker.0 00000100:00100000:1.0:1787826209.622467:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826209.622498:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049318528 00000100:00100000:1.0:1787826209.622506:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049318528 00000100:00100000:1.0:1787826209.622554:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049318400 00000100:00100000:1.0:1787826209.622557:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049318400 00000100:00100000:1.0:1787826209.622574:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7041 00000100:00100000:1.0:1787826209.622583:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049318528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826209.622635:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049318528:12345-0@lo:400:kworker.0 Request processed in 53us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826209.622642:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7041 00000100:00100000:1.0:1787826209.622663:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22566 00000100:00100000:1.0:1787826209.622667:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3616:x1874663049318400:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787826209.622683:0:179224:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826209.622715:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3616:x1874663049318400:12345-0@lo:8:kworker.0 Request processed in 46us (279us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826209.622722:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22566 00000100:00100000:1.0:1787826209.622743:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049318144 00000100:00100000:1.0:1787826209.622746:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049318144 00000100:00100000:2.0:1787826209.622910:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049318272 00000100:00100000:2.0:1787826209.622916:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049318272 00000100:00100000:2.0:1787826209.622940:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12691 00000100:00100000:2.0:1787826209.622945:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049318272:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826209.622955:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826209.623000:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049318272:12345-0@lo:38:kworker.0 Request processed in 54us (607us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826209.623010:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12691 00000100:00080000:2.0:1787826209.623180:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826209.623214:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049318528:0@lo:400:kworker.0 00000100:00080000:2.0:1787826209.623259:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826209.623263:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826209.623267:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049318272:0@lo:38:kworker.0 00000100:00080000:2.0:1787826209.623274:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826209.623277:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826209.623280:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049318400:0@lo:8:kworker.0 00000100:00100000:1.0:1787826209.623397:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049318016 00000100:00100000:1.0:1787826209.623401:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049318016 00000100:00100000:1.0:1787826209.623412:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049318656 00000100:00100000:1.0:1787826209.623414:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049318656 00000100:00100000:1.0:1787826209.623423:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787826209.623430:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049318144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826209.623472:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049318144:12345-0@lo:400:kworker.0 Request processed in 43us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826209.623478:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787826209.623490:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1787826209.623494:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049318016:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826209.623504:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826209.623533:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049318016:12345-0@lo:38:kworker.0 Request processed in 37us (1242us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826209.623539:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1787826209.623550:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:1.0:1787826209.623553:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049318656:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826209.623562:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826209.623584:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049318656:12345-0@lo:38:kworker.0 Request processed in 29us (1115us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826209.623590:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00080000:1.0:1787826209.623619:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826209.623623:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826209.623626:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049318016:0@lo:38:kworker.0 00000100:00080000:1.0:1787826209.623634:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826209.623637:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826209.623640:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049318656:0@lo:38:kworker.0 00000100:00080000:2.0:1787826209.624297:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826209.624397:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049318144:0@lo:400:kworker.0 00010000:00010000:3.0:1787826210.644486:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826211.669878:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826212.693004:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049318784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826212.693073:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826212.693405:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049318784 00000100:00100000:0.0:1787826212.693423:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049318784 00000100:00100000:0.0:1787826212.693485:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5803 00000100:00100000:0.0:1787826212.693497:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049318784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826212.693525:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826212.693573:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049318784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826212.693581:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5803 00000100:00080000:2.0:1787826212.694078:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826212.695194:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826212.695499:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049318784:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826213.724803:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826214.740771:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826214.740879:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826214.740884:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826214.740888:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826214.740896:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8276 00000100:00080000:0.0:1787826214.740900:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826214.740906:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826214.740929:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4774f0000 x1874663049319040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826214.740963:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826214.740966:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826214.740968:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826214.740971:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8276 00000100:00080000:0.0:1787826214.740974:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826214.740977:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826214.740990:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb479bf6d80 x1874663049319296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826214.740998:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826214.741002:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787826214.741003:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826214.741006:0:185677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8276 00000100:00080000:0.0:1787826214.741008:0:185677:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826214.741011:0:185677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826214.741021:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb479bf6680 x1874663049319424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826214.741045:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826214.741049:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826214.741051:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826214.741054:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8276 00000100:00080000:0.0:1787826214.741056:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826214.741060:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826214.741072:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb479bf4380 x1874663049319680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826214.741096:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049319552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826214.741160:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826214.741235:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049319552 00000100:00100000:0.0:1787826214.741243:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049319552 00000100:00100000:0.0:1787826214.741295:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7042 00000100:00100000:0.0:1787826214.741305:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049319552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826214.741536:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049319552:12345-0@lo:400:kworker.0 Request processed in 232us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826214.741543:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7042 00000100:00080000:0.0:1787826214.741564:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826214.741592:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049319552:0@lo:400:kworker.0 00000100:00100000:1.0:1787826214.741710:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049319040:0@lo:38:kworker.0 00000100:00100000:1.0:1787826214.741745:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826214.741768:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049319296:0@lo:38:kworker.0 00000100:00100000:1.0:1787826214.741792:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826214.741814:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049319424:0@lo:8:kworker.0 00000100:00100000:1.0:1787826214.741835:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826214.741851:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049319680:0@lo:38:kworker.0 00000100:00100000:1.0:1787826214.741869:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826214.741898:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049319040 00000100:00100000:1.0:1787826214.741902:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049319040 00000100:00100000:1.0:1787826214.741924:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049319680 00000100:00100000:1.0:1787826214.741927:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049319680 00000100:00100000:1.0:1787826214.741957:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1787826214.741962:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049319040:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826214.741980:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826214.742012:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049319040:12345-0@lo:38:kworker.0 Request processed in 49us (266us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826214.742019:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1787826214.742032:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1787826214.742035:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049319680:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826214.742044:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826214.742065:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049319680:12345-0@lo:38:kworker.0 Request processed in 28us (195us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826214.742071:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1787826214.742086:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049319296 00000100:00100000:1.0:1787826214.742090:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049319296 00000100:00100000:1.0:1787826214.742109:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12692 00000100:00100000:1.0:1787826214.742115:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049319296:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826214.742123:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826214.742146:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049319296:12345-0@lo:38:kworker.0 Request processed in 30us (354us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826214.742152:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12692 00000100:00100000:1.0:1787826214.742168:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049319424 00000100:00100000:1.0:1787826214.742171:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049319424 00000100:00100000:1.0:1787826214.742189:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22567 00000100:00100000:1.0:1787826214.742193:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1874663049319424:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787826214.742202:0:8403:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826214.742227:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1874663049319424:12345-0@lo:8:kworker.0 Request processed in 32us (391us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826214.742232:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22567 00000100:00100000:1.0:1787826214.742265:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049319168:0@lo:400:kworker.0 00000100:00100000:1.0:1787826214.742287:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826214.742320:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826214.742346:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049318912:0@lo:400:kworker.0 00000400:00000100:1.0:1787826214.742386:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049318912 offset 0 length 224: 4 00000100:00100000:1.0:1787826214.742411:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049319168 00000100:00100000:1.0:1787826214.742415:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049319168 00000100:00100000:1.0:1787826214.742448:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787826214.742454:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049319168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826214.742489:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049319168:12345-0@lo:400:kworker.0 Request processed in 36us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826214.742495:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:1.0:1787826214.742512:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826214.742530:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049319168:0@lo:400:kworker.0 00000100:00080000:1.0:1787826214.742555:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826214.742560:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826214.742563:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049319040:0@lo:38:kworker.0 00000100:00080000:1.0:1787826214.742571:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826214.742575:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826214.742578:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049319296:0@lo:38:kworker.0 00000100:00080000:1.0:1787826214.742584:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826214.742587:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826214.742590:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049319424:0@lo:8:kworker.0 00000100:00080000:1.0:1787826214.742598:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826214.742601:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826214.745604:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049319680:0@lo:38:kworker.0 00000100:00000400:1.0:1787826215.764435:0:3620:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826199/real 1787826199] req@ffff8eb476ca5c00 x1874663049315456/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826215 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826215.764469:0:3620:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8eb476ca5c00 x1874663049315456/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826215 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826215.764478:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787826215.764482:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787826215.764486:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.147@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787826215.764488:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787826215.764492:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb476ca5c00 x1874663049315456/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826215 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826215.764506:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb477f66a00 x1874663049316864/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826220 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826215.764525:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb343e55f80 x1874663049317888/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826215.764534:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb4774f1180 x1874663049318912/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826230 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787826215.764542:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787826215.764545:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787826215.764546:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787826215.764548:0:3620:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1787826215.764590:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049316864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826215.764703:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049318912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826215.764715:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049317888:0@lo:400:kworker.0 00000100:00100000:1.0:1787826215.764720:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049315456:0@lo:400:kworker.0 00010000:00010000:0.0:1787826215.764756:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826215.764772:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826215.764777:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787826215.764780:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826215.764784:0:179516:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8219 00000100:00080000:2.0:1787826215.764792:0:179516:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826215.764834:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f67100 x1874663049319808/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826215.764863:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826215.764867:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826215.764868:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826215.764871:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8281 00000100:00080000:2.0:1787826215.764882:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826215.764886:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826215.764901:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f66a00 x1874663049319936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826215.764938:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826215.764942:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826215.764944:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826215.764947:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8281 00000100:00080000:2.0:1787826215.764949:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826215.764953:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826215.764965:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f65f80 x1874663049320192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826215.764973:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826215.764976:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826215.764977:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826215.764980:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8281 00000100:00080000:2.0:1787826215.764982:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826215.764985:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826215.764993:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f67480 x1874663049320320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826215.765011:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826215.765015:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826215.765016:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826215.765019:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8281 00000100:00080000:2.0:1787826215.765021:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826215.765025:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826215.765035:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f66d80 x1874663049320576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826215.765264:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049319808:0@lo:250:kworker.0 00000400:00000100:1.0:1787826215.765318:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049319808 offset 0 length 520: 4 00000100:00100000:1.0:1787826215.765380:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049319936:0@lo:38:kworker.0 00000100:00100000:1.0:1787826215.765412:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826215.765430:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049320192:0@lo:38:kworker.0 00000100:00100000:1.0:1787826215.765460:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826215.765479:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049320320:0@lo:8:kworker.0 00000100:00100000:1.0:1787826215.765501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826215.765501:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049320448:0@lo:400:kworker.0 00000100:00100000:1.0:1787826215.765518:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049320576:0@lo:38:kworker.0 00000100:00100000:3.0:1787826215.765529:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826215.765535:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826215.765563:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049320192 00000100:00100000:3.0:1787826215.765563:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049320320 00000100:00100000:1.0:1787826215.765569:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049320192 00000100:00100000:3.0:1787826215.765570:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049320320 00000100:00100000:3.0:1787826215.765592:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049320448 00000100:00100000:3.0:1787826215.765595:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049320448 00000100:00100000:1.0:1787826215.765597:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12693 00000100:00100000:1.0:1787826215.765604:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049320192:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826215.765620:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7043 00010000:00020000:1.0:1787826215.765622:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826215.765625:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049320448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826215.765657:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049320192:12345-0@lo:38:kworker.0 Request processed in 52us (195us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826215.765659:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049320448:12345-0@lo:400:kworker.0 Request processed in 34us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826215.765664:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12693 00000100:00100000:3.0:1787826215.765664:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7043 00000100:00100000:3.0:1787826215.765678:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22568 00000100:00100000:3.0:1787826215.765682:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3616:x1874663049320320:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787826215.765690:0:43895:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826215.765711:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3616:x1874663049320320:12345-0@lo:8:kworker.0 Request processed in 27us (209us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826215.765716:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22568 00000100:00100000:3.0:1787826215.765750:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049320448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826215.765801:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049319936 00000100:00100000:2.0:1787826215.765805:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049319936 00000100:00100000:2.0:1787826215.765835:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049320576 00000100:00100000:2.0:1787826215.765838:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049320576 00000100:00100000:2.0:1787826215.765855:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1787826215.765860:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049319936:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826215.765869:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826215.765910:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049319936:12345-0@lo:38:kworker.0 Request processed in 49us (498us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826215.765917:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1787826215.765939:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1787826215.765943:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049320576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826215.765953:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826215.765976:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049320576:12345-0@lo:38:kworker.0 Request processed in 32us (440us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826215.765981:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1787826215.766090:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049320064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826215.766129:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826215.766190:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049320064 00000100:00100000:0.0:1787826215.766193:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049320064 00000100:00100000:0.0:1787826215.766218:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787826215.766223:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049320064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826215.766254:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049320064:12345-0@lo:400:kworker.0 Request processed in 31us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826215.766260:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787826215.766286:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049320064:0@lo:400:kworker.0 00000100:00080000:0.0:1787826215.766347:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826215.766351:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826215.766354:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049319936:0@lo:38:kworker.0 00000100:00080000:0.0:1787826215.766361:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826215.766364:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826215.766367:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049320192:0@lo:38:kworker.0 00000100:00080000:0.0:1787826215.766373:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826215.766376:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826215.766378:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049320320:0@lo:8:kworker.0 00000100:00080000:0.0:1787826215.766384:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826215.766387:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826215.766599:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049320576:0@lo:38:kworker.0 00010000:00010000:2.0:1787826216.790562:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826217.812605:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049320704:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826217.812631:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826217.812679:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826217.813648:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049320704 00000100:00100000:2.0:1787826217.813659:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049320704 00000100:00100000:2.0:1787826217.813723:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5804 00000100:00100000:2.0:1787826217.813737:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049320704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826217.813765:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00080000:1.0:1787826217.813814:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826217.813835:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049320704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826217.813844:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5804 00000100:00100000:0.0:1787826217.813906:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049320704:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826218.836465:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787826219.569465:0:193925:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787826219.569471:0:193925:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787826219.569473:0:193925:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787826219.569586:0:193925:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8eb477f6b800 00000020:01000004:0.0:1787826219.569601:0:193925:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787826219.569614:0:193925:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787826219.569627:0:193925:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8eb46a8719b8) 00000020:00000080:0.0:1787826219.569647:0:193925:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787826219.646703:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787826219.651630:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.653685:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787826219.654343:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787826219.654632:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787826219.655146:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787826219.655444:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787826219.655755:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787826219.656034:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787826219.656434:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787826219.656711:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787826219.657045:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787826219.657361:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787826219.657701:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787826219.664793:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787826219.667875:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.668520:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.668855:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.669096:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.669451:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.669831:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.670062:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.670669:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.671010:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.671359:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.671623:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.671994:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.672632:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.672968:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.673531:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.673782:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787826219.674030:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787826219.674283:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787826219.675214:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787826219.676058:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787826219.676881:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787826219.677446:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787826219.677738:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787826219.678620:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787826219.678921:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787826219.679262:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787826219.679585:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787826219.679868:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787826219.680137:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787826219.680473:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787826219.680861:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787826219.681196:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787826219.682800:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787826219.683439:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787826219.683733:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787826219.684493:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787826219.684798:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787826219.684998:0:193925:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1787826219.686261:0:193925:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787826219.686603:0:193925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787826219.686611:0:193925:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787826219.686624:0:193925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced415 00000020:01000004:2.0:1787826219.686630:0:193925:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787826219.686643:0:193925:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787826219.686647:0:193925:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb477f6b800 from MGS 00000020:01000004:2.0:1787826219.686652:0:193925:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787826219.686661:0:193925:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8eb341a68000) 00000020:00000080:2.0:1787826219.686672:0:193925:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787826219.686728:0:193925:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb477f6b800 from MGS, refs=2 00080000:01000000:2.0:1787826219.686809:0:193925:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787826219.686816:0:193925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced423 00010000:00010000:2.0:1787826219.686950:0:193925:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:2.0:1787826219.711992:0:193925:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787826219.717496:0:193930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787826219.717578:0:193925:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787826219.717638:0:193925:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787826219.718472:0:193925:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787826219.718708:0:193925:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787826219.718871:0:193925:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787826219.718876:0:193925:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787826219.720005:0:193925:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787826219.720014:0:193925:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787826219.720616:0:193925:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787826219.720623:0:193925:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787826219.721493:0:193925:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787826219.721521:0:193925:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1787826219.721523:0:193925:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1787826219.721528:0:193925:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1787826219.721534:0:193925:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 365, was 0): CONNECTING 00000100:00100000:1.0:1787826219.721540:0:193925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:0.0:1787826219.860935:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826220.884438:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826220.884448:0:179516:0:(pinger.c:247:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787826220.884451:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826220.884454:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826220.884458:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826220.884467:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8282 00000100:00080000:2.0:1787826220.884471:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826220.884478:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826220.884519:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f66d80 x1874663049320832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826220.884566:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826220.884570:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826220.884572:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826220.884576:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8282 00000100:00080000:2.0:1787826220.884578:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826220.884582:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00010000:00010000:3.0:1787826220.884584:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826220.884594:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f65f80 x1874663049321088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826220.884604:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826220.884607:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826220.884609:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826220.884612:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8282 00000100:00080000:2.0:1787826220.884614:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826220.884618:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826220.884629:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f66a00 x1874663049321216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826220.884642:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826220.884645:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826220.884646:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826220.884649:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8282 00000100:00080000:2.0:1787826220.884651:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826220.884654:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826220.884664:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f65500 x1874663049321472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826220.884835:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049321344:0@lo:400:kworker.0 00000100:00100000:0.0:1787826220.884912:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826220.884978:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826220.884984:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049320960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826220.885010:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826220.885041:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049320832:0@lo:38:kworker.0 00000100:00100000:0.0:1787826220.885066:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826220.885084:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049321088:0@lo:38:kworker.0 00000100:00100000:0.0:1787826220.885154:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826220.885178:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049321216:0@lo:8:kworker.0 00000100:00100000:0.0:1787826220.885203:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826220.885216:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049321472:0@lo:38:kworker.0 00000100:00100000:0.0:1787826220.885235:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826220.885277:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049320960 00000100:00100000:0.0:1787826220.885284:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049320960 00000100:00100000:0.0:1787826220.885353:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049320832 00000100:00100000:0.0:1787826220.885357:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049320832 00000100:00100000:0.0:1787826220.885371:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049321472 00000100:00100000:0.0:1787826220.885374:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049321472 00000100:00100000:0.0:1787826220.885385:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787826220.885394:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049320960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826220.885440:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049320960:12345-0@lo:400:kworker.0 Request processed in 47us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826220.885448:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787826220.885467:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1787826220.885471:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049320832:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826220.885489:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826220.885536:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049320832:12345-0@lo:38:kworker.0 Request processed in 63us (469us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826220.885543:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1787826220.885556:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1787826220.885560:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049321472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826220.885569:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826220.885593:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049321472:12345-0@lo:38:kworker.0 Request processed in 31us (357us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826220.885599:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1787826220.885647:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049320960:0@lo:400:kworker.0 00000100:00080000:0.0:1787826220.885673:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826220.885677:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826220.885680:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049320832:0@lo:38:kworker.0 00000100:00080000:0.0:1787826220.885688:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826220.885691:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826220.885694:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049321472:0@lo:38:kworker.0 00000100:00100000:2.0:1787826220.886085:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049321344 00000100:00100000:2.0:1787826220.886090:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049321344 00000100:00100000:2.0:1787826220.886131:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049321216 00000100:00100000:2.0:1787826220.886134:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049321216 00000100:00100000:2.0:1787826220.886152:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7044 00000100:00100000:2.0:1787826220.886160:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049321344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826220.886205:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049321344:12345-0@lo:400:kworker.0 Request processed in 47us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826220.886211:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7044 00000100:00100000:2.0:1787826220.886224:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22569 00000100:00100000:2.0:1787826220.886228:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3616:x1874663049321216:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787826220.886239:0:43896:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826220.886275:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3616:x1874663049321216:12345-0@lo:8:kworker.0 Request processed in 37us (1063us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826220.886281:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22569 00000100:00100000:2.0:1787826220.886313:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049321344:0@lo:400:kworker.0 00000100:00080000:0.0:1787826220.886622:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826220.886627:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826220.886631:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049321216:0@lo:8:kworker.0 00000100:00100000:1.0:1787826220.886863:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049321088 00000100:00100000:1.0:1787826220.886868:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049321088 00000100:00100000:1.0:1787826220.886901:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12694 00000100:00100000:1.0:1787826220.886906:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049321088:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826220.886918:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826220.886968:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049321088:12345-0@lo:38:kworker.0 Request processed in 60us (1812us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826220.886974:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12694 00000100:00080000:1.0:1787826220.886994:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826220.886998:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826220.887123:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826220.887128:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826220.887132:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049321088:0@lo:38:kworker.0 00010000:00010000:2.0:1787826221.909120:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826222.933483:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049321600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826222.933558:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826222.933639:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826222.933698:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049321600 00000100:00100000:0.0:1787826222.933706:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049321600 00000100:00100000:0.0:1787826222.933768:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5805 00000100:00100000:0.0:1787826222.933777:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049321600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826222.933806:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826222.933853:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049321600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826222.933860:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5805 00000100:00080000:3.0:1787826222.933946:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826222.933986:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049321600:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826223.956634:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826224.980712:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826226.004513:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826215/real 1787826215] req@ffff8eb477f67100 x1874663049319808/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826226.004559:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8eb477f67100 x1874663049319808/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826226.004581:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826226.004601:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787826226.004618:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049319808:0@lo:250:kworker.0 10000000:01000000:1.0:1787826226.004713:0:193925:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1787826226.004731:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced160 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004740:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced160 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.004747:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1787826226.004763:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.004773:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00ced159 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced160 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.004792:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced0c6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004800:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced0c6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.004806:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826226.004810:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.004814:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2000/0x878a5eea00ced0bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced0c6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.004824:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced0e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004829:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced0e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.004834:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826226.004837:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.004841:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8f000/0x878a5eea00ced0db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced0e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.004850:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced136 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004856:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced136 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.004861:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826226.004865:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.004868:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00ced12f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced136 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.004875:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced144 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004885:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced144 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.004890:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826226.004893:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.004895:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38e00/0x878a5eea00ced13d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced144 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.004903:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced16e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004910:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced16e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.004915:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826226.004918:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.004921:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39800/0x878a5eea00ced167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced16e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.004932:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced0d4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004938:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced0d4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.004943:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826226.004946:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.004949:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ced0cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced0d4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.004964:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced0f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004970:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced0f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.004976:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826226.004979:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.004982:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d64e00/0x878a5eea00ced0e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced0f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.004992:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced0fe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.004998:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced0fe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.005002:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826226.005009:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.005012:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced0f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced0fe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.005033:0:193925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced152 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826226.005040:0:193925:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced152 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826226.005044:0:193925:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826226.005056:0:193925:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826226.005060:0:193925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39c00/0x878a5eea00ced14b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced152 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787826226.005083:0:193925:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 365, was 0): DISCONN 00000100:00080000:1.0:1787826226.005089:0:193925:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826226.005094:0:193925:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8282 00000100:00080000:1.0:1787826226.005099:0:193925:0:(import.c:589:import_select_connection()) MGC192.168.203.147@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826226.005104:0:193925:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826226.005134:0:193925:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46ea69f80 x1874663049321728/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826226.005157:0:193925:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1787826226.005450:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049321728:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787826226.005522:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826226.005709:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826226.005714:0:185677:0:(pinger.c:247:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787826226.005717:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826226.005721:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826226.005723:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826226.005727:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8287 00000100:00080000:2.0:1787826226.005730:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826226.005734:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826226.005755:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f65f80 x1874663049321856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826226.005787:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826226.005791:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826226.005793:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826226.005797:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8287 00000100:00080000:2.0:1787826226.005800:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826226.005803:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826226.005815:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f64700 x1874663049322112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826226.005824:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826226.005827:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787826226.005828:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826226.005831:0:185677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8287 00000100:00080000:2.0:1787826226.005833:0:185677:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826226.005836:0:185677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826226.005849:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f64000 x1874663049322240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826226.005871:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826226.005874:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826226.005876:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826226.005879:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8287 00000100:00080000:2.0:1787826226.005881:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826226.005884:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826226.005894:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f67800 x1874663049322496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1787826226.005922:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826226.005940:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049321728 00000100:00100000:2.0:1787826226.005947:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049321728 00000100:00100000:2.0:1787826226.005979:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826226.005987:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1874663049321728:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787826226.006008:0:193931:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 205ad83e-e455-4070-92a2-f1e25b8f3f40@0@lo t0 exp 0000000000000000 cur 8292 last 0 00000020:00000080:2.0:1787826226.006047:0:193931:0:(genops.c:1385:class_connect()) connect: client 205ad83e-e455-4070-92a2-f1e25b8f3f40, cookie 0x878a5eea00ced42a 00000100:00080000:2.0:1787826226.006298:0:193931:0:(import.c:65:import_set_state_nolock()) ffff8eb3426a9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826226.006466:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+5:3616:x1874663049321728:12345-0@lo:250:mount.lustre.0 Request processed in 478us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826226.006474:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787826226.006645:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826226.006657:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049321984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826226.006690:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826226.006728:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049321984 00000100:00100000:3.0:1787826226.006732:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049321984 00000100:00100000:3.0:1787826226.006775:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787826226.006783:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049321984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826226.006823:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049321984:12345-0@lo:400:kworker.0 Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826226.006829:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1787826226.006846:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826226.006879:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049321984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826226.006911:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049322368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826226.006937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826226.006998:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049322368 00000100:00100000:3.0:1787826226.007002:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049322368 00000100:00100000:3.0:1787826226.007056:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7045 00000100:00100000:3.0:1787826226.007063:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049322368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826226.007295:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049322368:12345-0@lo:400:kworker.0 Request processed in 156us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826226.007302:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7045 00000100:00080000:3.0:1787826226.007319:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826226.007359:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049322368:0@lo:400:kworker.0 00000100:00100000:1.0:1787826226.009213:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049321856:0@lo:38:kworker.0 00000100:00100000:1.0:1787826226.009295:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.009358:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049322112:0@lo:38:kworker.0 00000100:00100000:1.0:1787826226.009389:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.009407:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049322240:0@lo:8:kworker.0 00000100:00100000:1.0:1787826226.009428:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.009446:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049322496:0@lo:38:kworker.0 00000100:00100000:1.0:1787826226.009466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.009507:0:3616:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.147@tcp: committing for last_committed 0 gen 81 00000100:00080000:1.0:1787826226.009518:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.147@tcp: connect to target with instance 0 00000100:00080000:1.0:1787826226.009702:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787826226.009709:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787826226.009713:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787826226.009715:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787826226.009736:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787826226.009746:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049321728:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787826226.009788:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049322240 00000100:00100000:1.0:1787826226.009795:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049322240 00000100:00100000:1.0:1787826226.009823:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22570 00000100:00100000:1.0:1787826226.009830:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3616:x1874663049322240:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787826226.009847:0:43903:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826226.009886:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3616:x1874663049322240:12345-0@lo:8:kworker.0 Request processed in 56us (457us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826226.009893:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22570 00000100:00100000:1.0:1787826226.009917:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049321856 00000100:00100000:1.0:1787826226.009921:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049321856 00000100:00100000:1.0:1787826226.009942:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049322496 00000100:00100000:1.0:1787826226.009945:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049322496 00000100:00100000:1.0:1787826226.009959:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:1.0:1787826226.009963:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049321856:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826226.009973:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826226.009998:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049321856:12345-0@lo:38:kworker.0 Request processed in 34us (704us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826226.010004:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:1.0:1787826226.010015:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1787826226.010019:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049322496:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826226.010027:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826226.010048:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049322496:12345-0@lo:38:kworker.0 Request processed in 28us (581us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826226.010053:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1787826226.010316:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049322112 00000100:00100000:0.0:1787826226.010320:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049322112 00000100:00100000:0.0:1787826226.010363:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12695 00000100:00100000:0.0:1787826226.010368:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049322112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826226.010379:0:8415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826226.010409:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049322112:12345-0@lo:38:kworker.0 Request processed in 40us (1019us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826226.010414:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12695 00000100:00080000:3.0:1787826226.010561:0:193925:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1787826226.010573:0:193925:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787826226.010604:0:193925:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787826226.010609:0:193925:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787826226.010703:0:193925:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787826226.010742:0:193925:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787826226.010745:0:193925:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787826226.010747:0:193925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787826226.010748:0:193925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826226.010749:0:193925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826226.010750:0:193925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826226.010751:0:193925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826226.010753:0:193925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826226.010754:0:193925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787826226.010756:0:193925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826226.010757:0:193925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787826226.010759:0:193925:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787826226.010761:0:193925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787826226.010762:0:193925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787826226.010763:0:193925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826226.010764:0:193925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826226.010765:0:193925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826226.010766:0:193925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826226.010766:0:193925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826226.010767:0:193925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787826226.010769:0:193925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826226.010770:0:193925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787826226.010787:0:193925:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787826226.010801:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049322624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787826226.010839:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826226.010867:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34556a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826226.010888:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049322624 00000100:00100000:3.0:1787826226.010892:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049322624 00000100:00100000:3.0:1787826226.010920:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787826226.010927:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+5:193925:x1874663049322624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787826226.010960:0:193933:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787826226.010963:0:193933:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787826226.010965:0:193933:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00080000:3.0:1787826226.011021:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.011026:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826226.011030:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049321856:0@lo:38:kworker.0 00000100:00080000:3.0:1787826226.011040:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.011043:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826226.011045:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049322112:0@lo:38:kworker.0 00000100:00080000:3.0:1787826226.011053:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.011056:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826226.011059:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049322240:0@lo:8:kworker.0 00000100:00080000:3.0:1787826226.011069:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.011087:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826226.011091:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049322496:0@lo:38:kworker.0 10000000:01000000:0.0:1787826226.015854:0:193935:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000000:1.0:1787826226.019724:0:179516:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.147@tcp 10000000:01000000:1.0:1787826226.019751:0:179516:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1787826226.019754:0:179516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787826226.019756:0:179516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787826226.019757:0:179516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826226.019758:0:179516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826226.019759:0:179516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826226.019761:0:179516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826226.019762:0:179516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826226.019764:0:179516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826226.019765:0:179516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787826226.019838:0:179516:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787826226.019844:0:179516:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1787826226.019846:0:179516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787826226.019847:0:179516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826226.019848:0:179516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826226.019849:0:179516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826226.019850:0:179516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826226.019851:0:179516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826226.019853:0:179516:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826226.019854:0:179516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826226.019855:0:179516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787826226.019885:0:179516:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1787826226.019911:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826226.019931:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049322880:0@lo:253:kworker.0 00000100:00100000:1.0:1787826226.019998:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.020364:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826226.020375:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049322752:0@lo:253:kworker.0 00000100:00100000:0.0:1787826226.020410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.021204:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049322880 00000100:00100000:1.0:1787826226.021213:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049322880 00000100:00100000:1.0:1787826226.021267:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049322752 00000100:00100000:1.0:1787826226.021270:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049322752 00000100:00100000:1.0:1787826226.021284:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787826226.021292:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3620:x1874663049322880:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1787826226.021320:0:193932:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787826226.028128:0:193933:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 331 20000000:01000000:3.0:1787826226.036877:0:193936:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787826226.036886:0:193936:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787826226.036889:0:193936:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787826226.036893:0:193936:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787826226.037636:0:193936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787826226.043666:0:193933:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787826226.043727:0:193932:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787826226.043861:0:193933:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787826226.048368:0:193932:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787826226.048383:0:193932:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787826226.048465:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:193925:x1874663049322624:12345-0@lo:253:mount.lustre.0 Request processed in 37533us (37618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.048482:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 20000000:01000000:2.0:1787826226.048514:0:193935:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826226.048520:0:193935:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1787826226.048523:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826226.048535:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+6:3617:x1874663049322752:12345-0@lo:253:kworker.0 00010000:00010000:2.0:1787826226.048555:0:193935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787826226.048560:0:193933:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00010000:2.0:1787826226.048572:0:193935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787826226.048574:0:193933:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826226.048586:0:193935:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000066527s 00010000:00010000:2.0:1787826226.048591:0:193935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048598:0:193935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048605:0:193935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048613:0:193935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048619:0:193935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826226.048625:0:193935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048633:0:193935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048644:0:193935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048652:0:193935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048658:0:193935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714000/0x878a5eea00ced431 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826226.048806:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049322624:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787826226.048819:0:193925:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787826226.048823:0:193925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787826226.048825:0:193925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787826226.048826:0:193925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826226.048827:0:193925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826226.048829:0:193925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826226.048830:0:193925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826226.048831:0:193925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826226.048833:0:193925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787826226.048835:0:193925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826226.048836:0:193925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787826226.048902:0:193925:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb477f6b800 from lustre-MDT0000 10000000:01000000:2.0:1787826226.048933:0:193925:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787826226.048936:0:193925:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787826226.048944:0:193925:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8eb477f6b800 10000000:01000000:2.0:1787826226.048948:0:193925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787826226.048952:0:193925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8eb477f6b800 10000000:01000000:2.0:1787826226.048955:0:193925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787826226.048958:0:193925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb477f6b800 from 1 10000000:01000000:2.0:1787826226.048961:0:193925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787826226.048987:0:193925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.048996:0:193925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.049006:0:193925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826226.049039:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049323008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826226.049074:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826226.049108:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4728cfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.049124:0:193931:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1787826226.049140:0:193931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1787826226.049475:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049323008 00000100:00100000:0.0:1787826226.049483:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049323008 00000100:00100000:1.0:1787826226.049543:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3620:x1874663049322880:12345-0@lo:253:kworker.0 Request processed in 28249us (29542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.049552:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787826226.049586:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787826226.049596:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+6:193925:x1874663049323008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826226.049605:0:193932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826226.049618:0:193932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3a00/0x878a5eea00ced43f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced438 expref: -99 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.049634:0:193932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3a00/0x878a5eea00ced43f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced438 expref: 7 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.049642:0:193932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3a00/0x878a5eea00ced43f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced438 expref: 7 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.049649:0:193932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3a00, rc 0) 00000100:00100000:1.0:1787826226.049686:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:193925:x1874663049323008:12345-0@lo:101:mount.lustre.0 Request processed in 93us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.049692:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787826226.052609:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049323008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826226.052638:0:193925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.052651:0:193925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826226.052670:0:193925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787826226.052680:0:193925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.052688:0:193925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826226.052696:0:193925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787826226.052710:0:193925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787826226.052716:0:193925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8eb477f6b800 10000000:01000000:3.0:1787826226.052720:0:193925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787826226.052724:0:193925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787826226.052726:0:193925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787826226.052757:0:193925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.052769:0:193925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.052778:0:193925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826226.052796:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049323136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826226.052853:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826226.052889:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34556ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.052952:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049323136 00000100:00100000:0.0:1787826226.052959:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049323136 00000100:00100000:0.0:1787826226.053004:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787826226.053012:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:193925:x1874663049323136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826226.053024:0:193931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826226.053039:0:193931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64a00/0x878a5eea00ced44d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced446 expref: -99 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.053058:0:193931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64a00/0x878a5eea00ced44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced446 expref: 8 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.053067:0:193931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64a00/0x878a5eea00ced44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced446 expref: 8 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.053076:0:193931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64a00, rc 0) 00000100:00100000:0.0:1787826226.053109:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:193925:x1874663049323136:12345-0@lo:101:mount.lustre.0 Request processed in 98us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.053116:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787826226.053302:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049323136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826226.053315:0:193925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.053345:0:193925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826226.053398:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049323264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826226.053424:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826226.053444:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34556ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826226.053457:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049323264 00000100:00100000:3.0:1787826226.053460:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049323264 00000100:00100000:3.0:1787826226.053482:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787826226.053489:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:193925:x1874663049323264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826226.053624:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:193925:x1874663049323264:12345-0@lo:501:mount.lustre.0 Request processed in 135us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826226.053631:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787826226.053751:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049323264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826226.053780:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049323392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826226.053818:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.053842:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb345267cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.053893:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049323392 00000100:00100000:0.0:1787826226.053898:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049323392 00000100:00100000:0.0:1787826226.053924:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787826226.053930:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:193925:x1874663049323392:12345-0@lo:503:mount.lustre.0 00000020:01000004:2.0:1787826226.057856:0:3620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1787826226.057863:0:3620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787826226.057864:0:3620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826226.057865:0:3620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826226.057866:0:3620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826226.057868:0:3620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826226.057869:0:3620:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826226.057871:0:3620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826226.057872:0:3620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787826226.057879:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049322880:0@lo:253:kworker.0 00000100:00100000:0.0:1787826226.064812:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:193925:x1874663049323392:12345-0@lo:503:mount.lustre.0 Request processed in 10872us (10984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.064827:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787826226.064970:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049323392:0@lo:503:mount.lustre.0 20000000:01000000:0.0:1787826226.065168:0:193933:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826226.065187:0:193933:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787826226.065386:0:193935:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826226.065392:0:193935:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826226.065416:0:193935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065434:0:193935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826226.065445:0:193935:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000066527s 00010000:00010000:3.0:1787826226.065450:0:193935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065457:0:193935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065465:0:193935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065472:0:193935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065478:0:193935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826226.065483:0:193935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065491:0:193935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065503:0:193935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065511:0:193935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826226.065519:0:193935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced454 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826226.065547:0:193938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193938:1874663049323520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826226.065599:0:193938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.065640:0:193938:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3452679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.065654:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3617:x1874663049322752:12345-0@lo:253:kworker.0 Request processed in 17120us (45241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.065663:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826226.065687:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049323520 00000100:00100000:0.0:1787826226.065693:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049323520 00000100:00100000:0.0:1787826226.065741:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787826226.065751:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:193938:x1874663049323520:12345-0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787826226.065979:0:3617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787826226.065982:0:3617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787826226.065983:0:3617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826226.065984:0:3617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826226.065986:0:3617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826226.065987:0:3617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826226.065988:0:3617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826226.065990:0:3617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826226.065992:0:3617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787826226.065995:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049322752:0@lo:253:kworker.0 00000100:00100000:0.0:1787826226.066404:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:193938:x1874663049323520:12345-0@lo:502:llog_process_th.0 Request processed in 654us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.066413:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787826226.066453:0:193938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193938:1874663049323520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787826226.066508:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826226.066519:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826226.066521:0:193938:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787826226.066526:0:193938:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787826226.066529:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826226.066542:0:193938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8eb3449f0000) 00000020:00000080:1.0:1787826226.066561:0:193938:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1787826226.066567:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787826226.066637:0:193938:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787826226.066643:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced462 00000020:00000080:1.0:1787826226.066840:0:193938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787826226.066845:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826226.066849:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826226.066850:0:193938:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787826226.066853:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826226.066855:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826226.066857:0:193938:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787826226.066860:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826226.066868:0:193938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8eb3449f3370) 00000020:00000080:1.0:1787826226.066879:0:193938:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1787826226.066883:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787826226.066885:0:193938:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787826226.066888:0:193938:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787826226.066893:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826226.066936:0:193938:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb477f6b800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787826226.066948:0:193938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8eb3449f19b8) 00000020:00000080:1.0:1787826226.066957:0:193938:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1787826226.067004:0:193938:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787826226.067010:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced477 00000020:00000080:1.0:1787826226.067116:0:193938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787826226.067123:0:193938:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787826226.067128:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x878a5eea00ced47e 00080000:01000000:1.0:1787826226.067141:0:193938:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787826226.067145:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced485 00010000:00010000:3.0:1787826226.188161:0:193938:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:3.0:1787826226.193851:0:193938:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 330712483740 srv lr: 343597383683 lx: 0 gen 21 00000001:00000004:3.0:1787826226.193911:0:193938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 81, last_transno is 343597383683 00000001:00080000:3.0:1787826226.194742:0:193938:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1787826226.194808:0:193938:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34556a180: xid 1874663048748160, transno 330712483739, client gen 21, slot idx 3 00000001:00080000:3.0:1787826226.194820:0:193938:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34556ac00: xid 1874663048748416, transno 330712483740, client gen 21, slot idx 4 00000020:00000080:3.0:1787826226.195358:0:193938:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8eb344e619b8) 00000020:00000080:3.0:1787826226.195379:0:193938:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:3.0:1787826226.195459:0:193938:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787826226.195466:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced49a 00000020:00000080:2.0:1787826226.201815:0:193938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787826226.223414:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x878a5eea00ced4a1 00000020:00000080:3.0:1787826226.233263:0:193938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787826226.233278:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826226.233290:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826226.233292:0:193938:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787826226.233296:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787826226.233299:0:193938:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787826226.233302:0:193938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826226.233303:0:193938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826226.233305:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787826226.233307:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826226.233309:0:193938:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787826226.233340:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826226.233347:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826226.233348:0:193938:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787826226.233354:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787826226.233407:0:193938:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787826226.233425:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826226.233429:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826226.233430:0:193938:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787826226.233433:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826226.233436:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826226.233448:0:193938:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787826226.233452:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787826226.233458:0:193938:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:3.0:1787826226.233481:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826226.235044:0:193938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8eb344e60000) 00000020:00000080:3.0:1787826226.235078:0:193938:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787826226.235093:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787826226.235169:0:193938:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787826226.235174:0:193938:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787826226.235179:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced4af 00010000:00080000:3.0:1787826226.235205:0:193938:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb47f953800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1787826226.241120:0:193938:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-7 is initialized 00000020:00000080:0.0:1787826226.242128:0:193938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826226.242143:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787826226.242176:0:193938:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787826226.242197:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced4b6 00000100:00080000:0.0:1787826226.242207:0:193938:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826226.242213:0:193938:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb47f953800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826226.242261:0:193938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb479bf6d80 x1874663049323648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826226.242346:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049323648:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826226.242412:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826226.242506:0:193938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787826226.242575:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826226.242579:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.242581:0:193938:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787826226.242584:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787826226.242587:0:193938:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787826226.242589:0:193938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826226.242590:0:193938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826226.242592:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787826226.242594:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.242596:0:193938:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787826226.242598:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787826226.242603:0:193938:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787826226.242605:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.242607:0:193938:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787826226.242609:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787826226.242613:0:193938:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:0.0:1787826226.242634:0:193938:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787826226.242637:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787826226.242649:0:193938:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8eb46a874d28) 00000020:00000080:0.0:1787826226.242666:0:193938:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787826226.242671:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787826226.242731:0:193938:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787826226.242737:0:193938:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787826226.242744:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced4c4 00010000:00080000:0.0:1787826226.242772:0:193938:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb343732000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1787826226.242951:0:193938:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1787826226.243200:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049323648 00000100:00100000:0.0:1787826226.243209:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049323648 00000100:00100000:0.0:1787826226.243249:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12696 00000100:00100000:0.0:1787826226.243256:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049323648:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787826226.243282:0:8414:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8293 last 0 00000020:00000080:0.0:1787826226.243313:0:8414:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced4cb 00000004:00100000:0.0:1787826226.243349:0:8414:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826226.243463:0:8414:0:(import.c:65:import_set_state_nolock()) ffff8eb343734800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787826226.243659:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826226.243665:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826226.243667:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826226.243672:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8292 00000100:00080000:1.0:1787826226.243676:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826226.243680:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826226.243696:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46ea69880 x1874663049323904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826226.243854:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049323904:0@lo:38:kworker.0 00000100:00100000:3.0:1787826226.243891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.243945:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049323648:12345-0@lo:38:llog_process_th.0 Request processed in 687us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.243953:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12696 00000100:00100000:0.0:1787826226.244118:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049323776:0@lo:400:kworker.0 00000100:00100000:0.0:1787826226.244148:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.244189:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049323776 00000100:00100000:0.0:1787826226.244194:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049323776 00000100:00100000:0.0:1787826226.244221:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826226.244239:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3620:x1874663049323776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826226.244278:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3620:x1874663049323776:12345-0@lo:400:kworker.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.244284:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826226.244317:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049323776:0@lo:400:kworker.0 00000100:00100000:2.0:1787826226.244581:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049323904 00000100:00100000:2.0:1787826226.244587:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049323904 00000100:00100000:2.0:1787826226.244638:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1787826226.244643:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049323904:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787826226.244684:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049323904:12345-0@lo:38:kworker.0 Request processed in 40us (794us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787826226.244690:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000040:01000000:0.0:1787826226.247649:0:193938:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787826226.248044:0:193938:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:1.0:1787826226.248284:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826226.248288:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826226.248292:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826226.248299:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8292 00000100:00080000:1.0:1787826226.248304:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826226.248310:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826226.248349:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46ea69f80 x1874663049324160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826226.248361:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826226.248364:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826226.248365:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826226.248368:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8292 00000100:00080000:1.0:1787826226.248370:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787826226.248373:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826226.248383:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46ea6a680 x1874663049324288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826226.248398:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826226.248401:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826226.248403:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826226.248405:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8292 00000100:00080000:1.0:1787826226.248409:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826226.248411:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826226.248421:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477dd6300 x1874663049324544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826226.248459:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049324416:0@lo:400:kworker.0 00000100:00100000:0.0:1787826226.248587:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049324032:0@lo:400:kworker.0 00000100:00100000:3.0:1787826226.248681:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826226.248691:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 4 00000100:00080000:3.0:1787826226.248699:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787826226.248703:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787826226.248706:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f953800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826226.248716:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049323648:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826226.248739:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049324160:0@lo:38:kworker.0 00000100:00100000:0.0:1787826226.248998:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787826226.249464:0:193938:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 79, last_idx 80 00000100:00100000:1.0:1787826226.250116:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.250180:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049324032 00000100:00100000:1.0:1787826226.250187:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049324032 00000100:00100000:1.0:1787826226.250248:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787826226.250258:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049324032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826226.250319:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049324032:12345-0@lo:400:kworker.0 Request processed in 63us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.250339:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787826226.250367:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049324416 00000100:00100000:1.0:1787826226.250370:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049324416 00000100:00100000:1.0:1787826226.250394:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7046 00000100:00100000:1.0:1787826226.250401:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049324416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826226.250438:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049324416:12345-0@lo:400:kworker.0 Request processed in 38us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.250445:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7046 00000040:00080000:0.0:1787826226.251021:0:193938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826226.251341:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049324416:0@lo:400:kworker.0 00000100:00100000:1.0:1787826226.251389:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049324032:0@lo:400:kworker.0 00000100:00100000:2.0:1787826226.251504:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826226.251518:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049324672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826226.251577:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.251616:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049324672 00000100:00100000:1.0:1787826226.251622:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049324672 00000100:00100000:1.0:1787826226.251667:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12697 00000100:00100000:1.0:1787826226.251676:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049324672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826226.251705:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446047744 avail 1299808256 00000100:00100000:1.0:1787826226.251746:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049324672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.251753:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12697 00000100:00100000:1.0:1787826226.251790:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049324672:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787826226.251966:0:193938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].81, 64 off13376 00000040:00080000:0.0:1787826226.252129:0:193938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x144:0x0].1, 64 off8256 00000100:00100000:3.0:1787826226.252345:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826226.252373:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049324288:0@lo:8:kworker.0 00000100:00100000:3.0:1787826226.252398:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826226.252415:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049324544:0@lo:38:kworker.0 00000100:00100000:3.0:1787826226.252437:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826226.252465:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.252470:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826226.252473:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049323904:0@lo:38:kworker.0 00000100:00100000:1.0:1787826226.252624:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049324288 00000100:00100000:1.0:1787826226.252630:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049324288 00000100:00100000:1.0:1787826226.252653:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22571 00000100:00100000:1.0:1787826226.252659:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3616:x1874663049324288:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787826226.252677:0:43897:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826226.252711:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3616:x1874663049324288:12345-0@lo:8:kworker.0 Request processed in 51us (312us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826226.252718:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22571 00000100:00080000:3.0:1787826226.252787:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.252792:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826226.252795:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049324288:0@lo:8:kworker.0 00000100:00100000:3.0:1787826226.252817:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049324544 00000100:00100000:3.0:1787826226.252820:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049324544 00000100:00100000:3.0:1787826226.252848:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1787826226.253759:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049324160 00000100:00100000:2.0:1787826226.253766:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049324160 00000100:00100000:2.0:1787826226.253794:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12698 00000100:00100000:2.0:1787826226.253800:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049324160:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826226.254059:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049324544:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787826226.254100:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049324160:12345-0@lo:38:kworker.0 Request processed in 298us (1774us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787826226.254107:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12698 00000100:00100000:3.0:1787826226.254962:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049324544:12345-0@lo:38:kworker.0 Request processed in 901us (2522us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787826226.254971:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00080000:3.0:1787826226.255015:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.255020:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826226.255024:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049324160:0@lo:38:kworker.0 00000100:00080000:3.0:1787826226.255034:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.255038:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826226.255040:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049324544:0@lo:38:kworker.0 00000040:00080000:1.0:1787826226.255407:0:193944:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 81 synced_idx: 0 lgh_last_idx: 81 00000040:00080000:1.0:1787826226.255413:0:193944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787826226.258462:0:193938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826226.258476:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787826226.258741:0:193938:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787826226.258763:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced4d2 00000100:00080000:0.0:1787826226.258773:0:193938:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826226.258779:0:193938:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb343732000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826226.258813:0:193938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477df5c00 x1874663049324800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826226.258874:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049324800:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787826226.258941:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826226.260619:0:193938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787826226.260717:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826226.260723:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.260725:0:193938:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787826226.260728:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787826226.260731:0:193938:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787826226.260732:0:193938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826226.260733:0:193938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787826226.260735:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787826226.260737:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.260738:0:193938:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787826226.260740:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787826226.260744:0:193938:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787826226.260747:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.260749:0:193938:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787826226.260752:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787826226.260755:0:193938:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:0.0:1787826226.260777:0:193938:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787826226.260779:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787826226.260793:0:193938:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8eb46a870000) 00000020:00000080:0.0:1787826226.260815:0:193938:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1787826226.260821:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787826226.260890:0:193938:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787826226.260895:0:193938:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787826226.260902:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ced4e0 00010000:00080000:0.0:1787826226.260935:0:193938:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb343217800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1787826226.261121:0:193938:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-9 is initialized 00000040:01000000:0.0:1787826226.261187:0:193938:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787826226.261202:0:193938:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787826226.261845:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049324800 00000100:00100000:1.0:1787826226.261860:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049324800 00000100:00100000:1.0:1787826226.261900:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22572 00000100:00100000:1.0:1787826226.261908:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3616:x1874663049324800:12345-0@lo:8:llog_process_th.0 00010000:00020000:1.0:1787826226.261929:0:43901:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:0.0:1787826226.263578:0:193938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826226.263840:0:193938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].81, 64 off13376 00000040:00080000:0.0:1787826226.263968:0:193938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x146:0x0].1, 64 off8256 00000100:00100000:1.0:1787826226.266207:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3616:x1874663049324800:12345-0@lo:8:llog_process_th.0 Request processed in 4288us (7254us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826226.266222:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22572 00000040:00080000:3.0:1787826226.267821:0:193946:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 81 synced_idx: 81 lgh_last_idx: 81 00000040:00080000:3.0:1787826226.267828:0:193946:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x146:0x0] at index 81 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787826226.268298:0:193938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826226.268310:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000100:00080000:2.0:1787826226.268483:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826226.268503:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826226.268507:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049324800:0@lo:8:llog_process_th.0 00000004:01000000:0.0:1787826226.268715:0:193938:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787826226.268736:0:193938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced4e7 00000100:00080000:0.0:1787826226.268743:0:193938:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826226.268748:0:193938:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8eb343217800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826226.268776:0:193938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477df6d80 x1874663049324928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826226.268801:0:193938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787826226.268904:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826226.268909:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.268911:0:193938:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787826226.268913:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826226.268917:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.268918:0:193938:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787826226.268920:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787826226.268922:0:193938:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787826226.268925:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826226.268927:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.268928:0:193938:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787826226.268929:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826226.268931:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.268932:0:193938:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787826226.268936:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787826226.268965:0:193938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193938:1874663049325056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826226.269037:0:193938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.269068:0:193938:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826226.269180:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049325056 00000100:00100000:1.0:1787826226.269186:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049325056 00000100:00100000:1.0:1787826226.269239:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826226.269248:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:193938:x1874663049325056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826226.269390:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:193938:x1874663049325056:12345-0@lo:502:llog_process_th.0 Request processed in 142us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.269398:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787826226.269505:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049324928:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787826226.269540:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.269612:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049324928 00000100:00100000:1.0:1787826226.269617:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049324928 00000100:00100000:1.0:1787826226.269642:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22573 00000100:00100000:1.0:1787826226.269646:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3616:x1874663049324928:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1787826226.269667:0:12319:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8293 last 0 00000020:00000080:1.0:1787826226.269692:0:12319:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00ced4ee 00002000:00100000:1.0:1787826226.269704:0:12319:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8eb343211000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787826226.269708:0:12319:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787826226.269711:0:12319:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787826226.269774:0:12319:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787826226.269795:0:12319:0:(import.c:65:import_set_state_nolock()) ffff8eb47a6a0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826226.269831:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049324928:12345-0@lo:8:llog_process_th.0 Request processed in 183us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.269838:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22573 00000100:00100000:2.0:1787826226.270070:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826226.270078:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787826226.270084:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787826226.270088:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787826226.270090:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343217800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787826226.270113:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787826226.270119:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049324928:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787826226.270206:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826226.270216:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049325184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826226.270266:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787826226.270354:0:193946:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787826226.270405:0:193946:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8293097080123ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787826226.270412:0:193946:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787826226.270481:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049325184 00000100:00100000:0.0:1787826226.270501:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049325184 00000100:00100000:0.0:1787826226.270537:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5806 00000100:00100000:0.0:1787826226.270544:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049325184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826226.270562:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826226.270599:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049325184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.270604:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5806 00000100:00100000:0.0:1787826226.270639:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049325184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826226.270666:0:193938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193938:1874663049325056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787826226.270697:0:193938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826226.270703:0:193938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.270705:0:193938:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787826226.270709:0:193938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787826226.270776:0:193925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787826226.270800:0:193925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787826226.270816:0:193925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.270828:0:193925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826226.270836:0:193925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb477f6b800 from 1 10000000:01000000:0.0:1787826226.270839:0:193925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826226.270875:0:193925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.270882:0:193925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.270891:0:193925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826226.270905:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826226.270933:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.270955:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.270975:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049325312 00000100:00100000:0.0:1787826226.270979:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049325312 00000100:00100000:0.0:1787826226.271004:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826226.271011:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:193925:x1874663049325312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826226.271019:0:193932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826226.271031:0:193932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced4f5 expref: -99 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.271050:0:193932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 9 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.271060:0:193932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 9 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.271068:0:193932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64400, rc 0) 00000100:00100000:0.0:1787826226.271096:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:193925:x1874663049325312:12345-0@lo:101:mount.lustre.0 Request processed in 85us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.271102:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826226.271137:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826226.271148:0:193925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.271157:0:193925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826226.271741:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325440:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787826226.271776:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.271798:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826226.272369:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049325440 00000100:00100000:1.0:1787826226.272377:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049325440 00000100:00100000:1.0:1787826226.272419:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826226.272427:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:193925:x1874663049325440:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787826226.272443:0:193937:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787826226.272463:0:193937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787826226.272466:0:193937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787826226.272468:0:193937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 333 00000100:00100000:1.0:1787826226.272567:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:193925:x1874663049325440:12345-0@lo:256:mount.lustre.0 Request processed in 140us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.272574:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787826226.272756:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325440:0@lo:256:mount.lustre.0 00000100:00080000:3.0:1787826226.273694:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1787826226.273894:0:193925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826226.273918:0:193925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.273929:0:193925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826226.273937:0:193925:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb477f6b800 from 1 10000000:01000000:0.0:1787826226.273939:0:193925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826226.273972:0:193925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.273980:0:193925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.273990:0:193925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826226.274009:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826226.274056:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.274085:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.274105:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049325568 00000100:00100000:0.0:1787826226.274111:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049325568 00000100:00100000:0.0:1787826226.274151:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787826226.274159:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:193925:x1874663049325568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826226.274171:0:193932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826226.274182:0:193932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64000/0x878a5eea00ced50a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced503 expref: -99 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.274202:0:193932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64000/0x878a5eea00ced50a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced503 expref: 10 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.274212:0:193932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64000/0x878a5eea00ced50a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced503 expref: 10 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.274220:0:193932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64000, rc 0) 00000100:00100000:0.0:1787826226.274264:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193925:x1874663049325568:12345-0@lo:101:mount.lustre.0 Request processed in 105us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.274270:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787826226.274309:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826226.274321:0:193925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.274368:0:193925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826226.274421:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826226.274446:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.274462:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826226.274677:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049325696 00000100:00100000:2.0:1787826226.274683:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049325696 00000100:00100000:2.0:1787826226.274712:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787826226.274719:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193925:x1874663049325696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826226.274842:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193925:x1874663049325696:12345-0@lo:501:mount.lustre.0 Request processed in 124us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826226.274859:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787826226.275023:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826226.275050:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826226.275092:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.275115:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826226.275160:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049325824 00000100:00100000:1.0:1787826226.275164:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049325824 00000100:00100000:1.0:1787826226.275197:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787826226.275204:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193925:x1874663049325824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826226.275301:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193925:x1874663049325824:12345-0@lo:503:mount.lustre.0 Request processed in 97us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.275307:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787826226.275456:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049325824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826226.276866:0:193948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193948:1874663049325952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826226.276931:0:193948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.276970:0:193948:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458856300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826226.277068:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049325952 00000100:00100000:1.0:1787826226.277074:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049325952 00000100:00100000:1.0:1787826226.277116:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787826226.277123:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193948:x1874663049325952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826226.277686:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193948:x1874663049325952:12345-0@lo:502:llog_process_th.0 Request processed in 562us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.277701:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787826226.277791:0:193948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193948:1874663049325952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826226.277821:0:193948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826226.277829:0:193948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826226.277831:0:193948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787826226.277838:0:193948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb477f6b800 00000020:00000080:2.0:1787826226.277840:0:193948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787826226.277848:0:193948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826226.277850:0:193948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826226.277862:0:193948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787826226.277864:0:193948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826226.277867:0:193948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826226.277868:0:193948:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787826226.277871:0:193948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb477f6b800 00000020:00000080:2.0:1787826226.277873:0:193948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787826226.277947:0:193948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193948:1874663049326080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826226.277986:0:193948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826226.278009:0:193948:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4725b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.279774:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049326080 00000100:00100000:0.0:1787826226.279785:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049326080 00000100:00100000:0.0:1787826226.279837:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787826226.279925:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193948:x1874663049326080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826226.280945:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193948:x1874663049326080:12345-0@lo:502:llog_process_th.0 Request processed in 1096us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.280955:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1787826226.285076:0:193926:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787826226.285259:0:193948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193948:1874663049326080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787826226.285403:0:193948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826226.285411:0:193948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826226.285414:0:193948:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787826226.285417:0:193948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787826226.285636:0:193925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787826226.285660:0:193925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826226.285683:0:193925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.285695:0:193925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826226.285748:0:193925:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787826226.285751:0:193925:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8eb477f6b800 10000000:01000000:2.0:1787826226.285754:0:193925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8eb477f6b800 10000000:01000000:2.0:1787826226.285758:0:193925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826226.285764:0:193925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb477f6b800 from 1 10000000:01000000:2.0:1787826226.285767:0:193925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826226.285797:0:193925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.285807:0:193925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.285816:0:193925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826226.285836:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049326208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826226.285990:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826226.286031:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4725b1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.286089:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049326208 00000100:00100000:0.0:1787826226.286096:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049326208 00000100:00100000:0.0:1787826226.286140:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787826226.286151:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:193925:x1874663049326208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826226.286163:0:193937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826226.286176:0:193937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65000/0x878a5eea00ced518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced511 expref: -99 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.286195:0:193937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65000/0x878a5eea00ced518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced511 expref: 11 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.286204:0:193937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65000/0x878a5eea00ced518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced511 expref: 11 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.286213:0:193937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65000, rc 0) 00000100:00100000:0.0:1787826226.286265:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193925:x1874663049326208:12345-0@lo:101:mount.lustre.0 Request processed in 116us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.286272:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787826226.286313:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049326208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826226.286351:0:193925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.286360:0:193925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826226.286406:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049326336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826226.286429:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.286447:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458856e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.286470:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049326336 00000100:00100000:0.0:1787826226.286473:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049326336 00000100:00100000:0.0:1787826226.286509:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787826226.286515:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193925:x1874663049326336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826226.286617:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193925:x1874663049326336:12345-0@lo:501:mount.lustre.0 Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.286626:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787826226.286660:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049326336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826226.286684:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049326464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826226.286723:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.286735:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458856e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.286749:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049326464 00000100:00100000:0.0:1787826226.286752:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049326464 00000100:00100000:0.0:1787826226.286771:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787826226.286777:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193925:x1874663049326464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826226.286845:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193925:x1874663049326464:12345-0@lo:503:mount.lustre.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.286864:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787826226.286904:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049326464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826226.295083:0:193950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193950:1874663049326592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826226.295163:0:193950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.295207:0:193950:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458856e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826226.295266:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049326592 00000100:00100000:1.0:1787826226.295272:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049326592 00000100:00100000:1.0:1787826226.295318:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826226.295350:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193950:x1874663049326592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826226.295470:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193950:x1874663049326592:12345-0@lo:502:llog_process_th.0 Request processed in 144us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.295478:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826226.296451:0:193950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193950:1874663049326592:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787826226.296638:0:193950:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787826226.296653:0:193950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8eb481d9b370) 00000020:00000080:1.0:1787826226.296676:0:193950:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787826226.296762:0:193950:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb477f6b800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787826226.296766:0:193950:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb477f6b800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787826226.296768:0:193950:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb477f6b800 4 00010000:00080000:1.0:1787826226.296796:0:193950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb47984c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:1.0:1787826226.300379:0:193950:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-10 is initialized 00000020:00000080:1.0:1787826226.301127:0:193950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787826226.301170:0:193950:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787826226.301182:0:193950:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x878a5eea00ced526 00000100:00080000:1.0:1787826226.301192:0:193950:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787826226.301199:0:193950:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb47984c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826226.301244:0:193950:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481b74e00 x1874663049326720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826226.301272:0:193950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787826226.301390:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049326720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826226.301461:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.301692:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049326720 00000100:00100000:1.0:1787826226.301700:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049326720 00000100:00100000:1.0:1787826226.301730:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1787826226.301738:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049326720:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826226.301800:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049326720:12345-0@lo:38:llog_process_th.0 Request processed in 61us (338us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826226.301807:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1787826226.303003:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826226.303013:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47984c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826226.303018:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826226.303022:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049326720:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787826226.304077:0:193950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193950:1874663049326848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826226.304142:0:193950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.304173:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049326848 00000100:00100000:0.0:1787826226.304179:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049326848 00000100:00100000:1.0:1787826226.304181:0:193950:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826226.304220:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787826226.305240:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193950:x1874663049326848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826226.305394:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193950:x1874663049326848:12345-0@lo:502:llog_process_th.0 Request processed in 1165us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826226.305402:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787826226.306743:0:193950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193950:1874663049326848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826226.306812:0:193950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193950:1874663049326976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826226.306879:0:193950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826226.306914:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049326976 00000100:00100000:1.0:1787826226.306920:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049326976 00000100:00100000:1.0:1787826226.306960:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787826226.306968:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193950:x1874663049326976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826226.307053:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193950:x1874663049326976:12345-0@lo:502:llog_process_th.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.307061:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787826226.307109:0:193950:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826226.307121:0:193950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:193950:1874663049326976:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787826226.307138:0:193950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787826226.307213:0:193925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787826226.307248:0:193925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787826226.307263:0:193925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.307273:0:193925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826226.307347:0:193925:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787826226.307350:0:193925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826226.307351:0:193925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826226.307353:0:193925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826226.307354:0:193925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826226.307355:0:193925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826226.307356:0:193925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826226.307358:0:193925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826226.307360:0:193925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826226.307361:0:193925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787826226.307367:0:193925:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787826226.307369:0:193925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826226.307370:0:193925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826226.307371:0:193925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826226.307372:0:193925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826226.307373:0:193925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826226.307374:0:193925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826226.307375:0:193925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826226.307376:0:193925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826226.307378:0:193925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826226.307378:0:193925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787826226.307393:0:193925:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787826226.307401:0:193925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049327104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787826226.307434:0:193925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.307469:0:193925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458856cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826226.308046:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049327104 00000100:00100000:2.0:1787826226.308052:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049327104 00000100:00100000:2.0:1787826226.308085:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787826226.308093:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193925:x1874663049327104:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826226.308115:0:193931:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787826226.308127:0:193931:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826226.314431:0:193931:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826226.314447:0:193931:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787826226.314748:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:193925:x1874663049327104:12345-0@lo:253:mount.lustre.0 Request processed in 6651us (7308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826226.314759:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:0.0:1787826226.316256:0:193935:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787826226.316264:0:193935:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787826226.316283:0:193935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.316300:0:193935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 10 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.316308:0:193935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.316372:0:193935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 10 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826226.316386:0:193935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 10 pid: 193932 timeout: 8393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826226.316400:0:193935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193935:1874663049327232:0@lo:104: 00000100:00100000:0.0:1787826226.316466:0:193935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.316506:0:193935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458856e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826226.317010:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049327232 00000100:00100000:2.0:1787826226.317018:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049327232 00000100:00100000:2.0:1787826226.317063:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4769 00000100:00100000:2.0:1787826226.317072:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:193935:x1874663049327232:12345-0@lo:104: 00010000:00010000:2.0:1787826226.317086:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826226.317107:0:193925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:193925:1874663049327104:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787826226.317119:0:193925:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787826226.317122:0:193925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826226.317124:0:193925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826226.317125:0:193925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826226.317126:0:193925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826226.317127:0:193925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826226.317129:0:193925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826226.317130:0:193925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826226.317131:0:193925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826226.317133:0:193925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826226.317134:0:193925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1787826226.317141:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826226.317146:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:193935:x1874663049327232:12345-0@lo:104: Request processed in 76us (681us total) trans 0 rc 0/0 00000020:02000000:0.0:1787826226.317148:0:193925:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787826226.317153:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4769 00010000:00010000:2.0:1787826226.317172:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826226.317177:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.317183:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826226.317187:0:9495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.317194:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826226.317201:0:9495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826226.317206:0:9495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826226.317244:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.317249:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826226.317268:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.317275:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced4f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced4fc expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.317288:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826226.317290:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826226.317291:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826226.317301:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049327360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826226.317348:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826226.317386:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049327360 00000100:00100000:2.0:1787826226.317390:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049327360 00010000:00010000:2.0:1787826226.317406:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 11 pid: 193932 timeout: 8393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826226.317427:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12223 00000100:00100000:2.0:1787826226.317432:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:3617:x1874663049327360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826226.317442:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826226.317447:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 11 pid: 193932 timeout: 8393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.317457:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 11 pid: 193932 timeout: 8393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.317472:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.317480:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.318342:0:193935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64400/0x878a5eea00ced4fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ced4f5 expref: 11 pid: 193932 timeout: 8393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826226.318361:0:193935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193935:1874663049327232:0@lo:104: 00010000:00010000:1.0:1787826226.318379:0:193935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.318389:0:193935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.318397:0:193935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826226.318404:0:193935:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826226.318408:0:193935:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826226.318421:0:193935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.318431:0:193935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.318450:0:193935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.318465:0:193935:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.318474:0:193935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826226.318940:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000532450s 00010000:00010000:2.0:1787826226.318949:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.318961:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.318968:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.318975:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.318981:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826226.318984:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.318991:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.319004:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.319011:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826226.319021:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000614588s 00010000:00010000:2.0:1787826226.319024:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.319030:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.319037:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.319043:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.319048:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826226.319051:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.319057:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.328465:0:193935:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826226.328481:0:193935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.331594:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.331612:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce2200/0x878a5eea00ced534 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.331637:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.331644:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65600/0x878a5eea00ced52d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826226.331659:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826226.331752:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:3617:x1874663049327360:12345-0@lo:103:ldlm_bl.0 Request processed in 14315us (14399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826226.331761:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12223 00000100:00100000:1.0:1787826226.331990:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049327360:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787826226.341138:0:193925:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 330712484068 00000040:01000000:0.0:1787826226.342480:0:193925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787826226.342592:0:193956:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 330712484068 00000020:00080000:3.0:1787826226.342596:0:193956:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484068 00000040:01000000:0.0:1787826226.343640:0:193957:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787826226.343971:0:193925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1787826226.344423:0:193958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193958:1874663049327488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826226.344508:0:193958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.344540:0:193958:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480d706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826226.344653:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049327488 00000100:00100000:1.0:1787826226.344661:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049327488 00000100:00100000:1.0:1787826226.344713:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12699 00000100:00100000:1.0:1787826226.344723:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193958:x1874663049327488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826226.344803:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193958:x1874663049327488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.344810:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12699 00000040:01000000:3.0:1787826226.345245:0:193925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787826226.345286:0:193925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787826226.345938:0:193925:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787826226.345947:0:193925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787826226.345986:0:193925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826226.347365:0:193958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193958:1874663049327488:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787826226.347404:0:193958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787826226.347445:0:193958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193958:1874663049327616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826226.347711:0:193958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.347737:0:193958:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480d706c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826226.348626:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049327616 00000100:00100000:2.0:1787826226.348636:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049327616 00000100:00100000:2.0:1787826226.348687:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12700 00000100:00100000:2.0:1787826226.348697:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193958:x1874663049327616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826226.348835:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193958:x1874663049327616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 140us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826226.348843:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12700 00000040:00080000:3.0:1787826226.349161:0:193925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1787826226.349445:0:193958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193958:1874663049327616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826226.349977:0:193958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193958:1874663049327744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826226.350021:0:193958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.350048:0:193958:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480d706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826226.350104:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049327744 00000100:00100000:1.0:1787826226.350110:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049327744 00000100:00100000:1.0:1787826226.350150:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12701 00000100:00100000:1.0:1787826226.350158:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193958:x1874663049327744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826226.350239:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193958:x1874663049327744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826226.350246:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12701 00000100:00100000:0.0:1787826226.350385:0:193958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193958:1874663049327744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826226.350451:0:193958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193958:1874663049327872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826226.350519:0:193958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826226.350534:0:193958:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480d70180 going to sleep for 11 seconds 00000040:00080000:3.0:1787826226.351139:0:193925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787826226.351198:0:193925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:2.0:1787826226.351524:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049327872 00000100:00100000:2.0:1787826226.351531:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049327872 00000100:00100000:2.0:1787826226.351573:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12702 00000100:00100000:2.0:1787826226.351581:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193958:x1874663049327872:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826226.351801:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193958:x1874663049327872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 221us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826226.351809:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12702 00000100:00100000:0.0:1787826226.352045:0:193958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193958:1874663049327872:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787826226.354044:0:193925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826226.358755:0:193958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787826226.358842:0:193958:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00080000:10000000:3.0:1787826226.359131:0:193925:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x84:0x0] (8/32) registered 00000040:00080000:2.0:1787826226.364157:0:193957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787826226.364267:0:193957:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787826226.364272:0:193957:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1787826226.366616:0:193925:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 343597383683 00010000:00080000:3.0:1787826226.367434:0:193959:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 193959 00010000:02000000:3.0:1787826226.367446:0:193959:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1787826226.367450:0:193959:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:3.0:1787826226.367453:0:193959:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00000020:01000004:0.0:1787826226.367636:0:193925:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787826226.367651:0:193925:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787826226.367668:0:193925:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787826226.367683:0:193925:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787826226.369202:0:193925:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826226.370845:0:193925:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787826227.029284:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787826227.668483:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826227.668495:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb477f6b800 from 334 10000000:01000000:0.0:1787826227.668502:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826227.668570:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.668585:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.668599:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.668634:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.668731:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.668793:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.668895:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049328000 00000100:00100000:1.0:1787826227.668908:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049328000 00000100:00100000:1.0:1787826227.669059:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787826227.669071:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:6488:x1874663049328000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826227.669087:0:193937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826227.669104:0:193937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced53b expref: -99 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.669137:0:193937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced53b expref: 11 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.669148:0:193937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced53b expref: 11 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.669158:0:193937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3600, rc 0) 00000100:00100000:1.0:1787826227.669318:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049328000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.669355:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826227.671456:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826227.671500:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.671514:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.671629:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.671713:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.671800:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.672204:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049328128 00000100:00100000:1.0:1787826227.672214:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049328128 00000100:00100000:1.0:1787826227.672280:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787826227.672292:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049328128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826227.672340:0:193932:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826227.672364:0:193932:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826227.672368:0:193932:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 334 00000100:00100000:1.0:1787826227.673667:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049328128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1369us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.673682:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787826227.677194:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787826227.677344:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826227.677359:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.677373:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826227.677386:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787826227.677389:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb34df96000 from 52 10000000:01000000:0.0:1787826227.677393:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826227.677439:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.677447:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.677458:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.677482:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.677559:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.677617:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826227.677735:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049328256 00000100:00100000:2.0:1787826227.677744:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049328256 00000100:00100000:2.0:1787826227.677813:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787826227.677824:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049328256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826227.677841:0:193933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826227.677868:0:193933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481714400/0x878a5eea00ced550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced549 expref: -99 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.677897:0:193933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481714400/0x878a5eea00ced550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced549 expref: 12 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.677910:0:193933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481714400/0x878a5eea00ced550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced549 expref: 12 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.677935:0:193933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714400, rc 0) 00000100:00100000:2.0:1787826227.677986:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049328256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826227.677993:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787826227.678129:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826227.678144:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced550 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.678154:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced550 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.678232:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.678259:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.678281:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826227.678353:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049328384 00000100:00100000:2.0:1787826227.678358:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049328384 00000100:00100000:2.0:1787826227.678390:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787826227.678398:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049328384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.678589:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049328384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826227.678596:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787826227.678647:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.678677:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.678731:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.678761:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.679289:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049328512 00000100:00100000:1.0:1787826227.679297:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049328512 00000100:00100000:1.0:1787826227.679375:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787826227.679384:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049328512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826227.679521:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049328512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.679532:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787826227.679690:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826227.681364:0:194019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1787826227.681624:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1787826227.681653:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826227.681666:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced550 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.681678:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced550 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826227.681691:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787826227.681694:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb34df96000 from 332 10000000:01000000:2.0:1787826227.681697:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826227.681745:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.681754:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.681771:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826227.681802:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.681957:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.682060:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.682109:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049328640 00000100:00100000:1.0:1787826227.682117:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049328640 00000100:00100000:1.0:1787826227.682211:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826227.682230:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049328640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826227.682245:0:193932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826227.682260:0:193932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced557 expref: -99 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.682288:0:193932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced557 expref: 13 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.682301:0:193932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced557 expref: 13 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.682311:0:193932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2600, rc 0) 00000100:00100000:1.0:1787826227.682556:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049328640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 335us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.682563:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787826227.682674:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826227.682694:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.682706:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.682779:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.682819:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.682950:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.682980:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049328768 00000100:00100000:1.0:1787826227.682985:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049328768 00000100:00100000:1.0:1787826227.683058:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787826227.683067:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049328768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826227.683086:0:193932:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826227.683109:0:193932:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826227.683114:0:193932:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787826227.683117:0:193932:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787826227.683120:0:193932:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 334 00000100:00100000:1.0:1787826227.683213:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049328768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.683230:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787826227.683286:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787826227.683396:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826227.683404:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.683413:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826227.683422:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787826227.683426:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1787826227.683429:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787826227.683452:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.683459:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.683467:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.683481:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.683514:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.683673:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826227.683754:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049328896 00000100:00100000:3.0:1787826227.683759:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049328896 00000100:00100000:3.0:1787826227.683787:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787826227.683795:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049328896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826227.683806:0:193933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826227.683820:0:193933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8e000/0x878a5eea00ced56c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced565 expref: -99 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.683839:0:193933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8e000/0x878a5eea00ced56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced565 expref: 14 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.683860:0:193933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8e000/0x878a5eea00ced56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced565 expref: 14 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.683869:0:193933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8e000, rc 0) 00000100:00100000:3.0:1787826227.683914:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049328896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.683921:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787826227.684069:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049328896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826227.684082:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced56c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.684091:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced56c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.684152:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.684182:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.684204:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826227.684253:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049329024 00000100:00100000:3.0:1787826227.684257:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049329024 00000100:00100000:3.0:1787826227.684288:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787826227.684294:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049329024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826227.684484:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049329024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.684492:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787826227.684601:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.684633:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.684692:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.684713:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826227.684791:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049329152 00000100:00100000:3.0:1787826227.684796:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049329152 00000100:00100000:3.0:1787826227.684830:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787826227.684838:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049329152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826227.687227:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049329152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2371us (2516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.687246:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787826227.687287:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826227.690469:0:194020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1787826227.691014:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1787826227.691039:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787826227.691050:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced56c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.691151:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced56c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826227.691162:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1787826227.691164:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb34df96000 from 1 10000000:01000000:0.0:1787826227.691167:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787826227.691203:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.691211:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.691231:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.691256:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.691392:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.691430:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826227.692007:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049329280 00000100:00100000:3.0:1787826227.692015:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049329280 00000100:00100000:3.0:1787826227.692081:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787826227.692090:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049329280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826227.692102:0:193931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826227.692114:0:193931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced57a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced573 expref: -99 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.692135:0:193931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced573 expref: 15 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.692145:0:193931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced573 expref: 15 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.692153:0:193931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8f600, rc 0) 00000100:00100000:3.0:1787826227.692214:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049329280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.692230:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787826227.695423:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826227.695452:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced57a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.695465:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced57a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826227.695486:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787826227.695490:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced57a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.695496:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced57a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826227.695504:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787826227.695506:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb34df96000 from 7 10000000:01000000:2.0:1787826227.695509:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826227.695541:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.695548:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.695561:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826227.695579:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.695636:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.695678:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.697153:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049329408 00000100:00100000:1.0:1787826227.697164:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049329408 00000100:00100000:1.0:1787826227.697232:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787826227.697242:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049329408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826227.697259:0:193937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826227.697274:0:193937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3400/0x878a5eea00ced588 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced581 expref: -99 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.697298:0:193937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3400/0x878a5eea00ced588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced581 expref: 16 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.697309:0:193937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3400/0x878a5eea00ced588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced581 expref: 16 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.697317:0:193937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3400, rc 0) 00000100:00100000:1.0:1787826227.697400:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049329408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.697406:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826227.697724:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826227.697743:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced588 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.697753:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced588 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826227.697821:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.697873:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.697908:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826227.698070:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049329536 00000100:00100000:0.0:1787826227.698076:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049329536 00000100:00100000:0.0:1787826227.698102:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787826227.698109:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049329536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.698233:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049329536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826227.698241:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826227.698488:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.698520:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.698566:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.698597:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826227.698643:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049329664 00000100:00100000:3.0:1787826227.698648:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049329664 00000100:00100000:3.0:1787826227.698681:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787826227.698689:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049329664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826227.698777:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049329664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.698784:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826227.699004:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787826227.701762:0:194021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787826227.702067:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787826227.702092:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787826227.702102:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced588 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.702115:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced588 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826227.702125:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787826227.702128:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb47bfd6800 from 52 10000000:01000000:0.0:1787826227.702131:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826227.702169:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.702178:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.702188:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.702212:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.702288:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.702347:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb349386a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826227.702613:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049329792 00000100:00100000:3.0:1787826227.702620:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049329792 00000100:00100000:3.0:1787826227.702671:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787826227.702681:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049329792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826227.702693:0:193933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826227.702704:0:193933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8e800/0x878a5eea00ced596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced58f expref: -99 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.702726:0:193933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8e800/0x878a5eea00ced596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced58f expref: 17 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.702736:0:193933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8e800/0x878a5eea00ced596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced58f expref: 17 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.702745:0:193933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8e800, rc 0) 00000100:00100000:3.0:1787826227.702798:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049329792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.702804:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787826227.703468:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826227.703485:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced596 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.703495:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced596 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826227.703553:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.703585:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.703612:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826227.703692:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049329920 00000100:00100000:0.0:1787826227.703697:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049329920 00000100:00100000:0.0:1787826227.703738:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787826227.703745:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049329920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.704414:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049329920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 666us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826227.704424:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787826227.707018:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049329920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.707087:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.707167:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.707210:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826227.707568:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049330048 00000100:00100000:2.0:1787826227.707577:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049330048 00000100:00100000:2.0:1787826227.707618:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787826227.707627:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049330048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.707744:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049330048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826227.707752:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787826227.707860:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826227.715519:0:194022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1787826227.719974:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1787826227.720026:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826227.720038:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced596 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.720051:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced596 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826227.720067:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787826227.720069:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1787826227.720072:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787826227.720109:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.720118:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.720127:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826227.720153:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.720216:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.720268:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.720355:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049330176 00000100:00100000:1.0:1787826227.720363:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049330176 00000100:00100000:1.0:1787826227.720413:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787826227.720422:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049330176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826227.720434:0:193932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826227.720447:0:193932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3e00/0x878a5eea00ced5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced59d expref: -99 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.720468:0:193932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3e00/0x878a5eea00ced5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced59d expref: 18 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.720478:0:193932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3e00/0x878a5eea00ced5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced59d expref: 18 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.720486:0:193932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3e00, rc 0) 00000100:00100000:1.0:1787826227.720523:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049330176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.720529:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787826227.720643:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826227.720657:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5a4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.720665:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced5a4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826227.720714:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.720737:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.720762:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826227.720800:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049330304 00000100:00100000:0.0:1787826227.720805:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049330304 00000100:00100000:0.0:1787826227.720848:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787826227.720856:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049330304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.720984:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049330304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826227.720990:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787826227.721104:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.721133:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.721179:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826227.721202:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826227.721248:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049330432 00000100:00100000:0.0:1787826227.721253:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049330432 00000100:00100000:0.0:1787826227.721284:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787826227.721291:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049330432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.722574:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049330432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1279us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826227.722585:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787826227.722672:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787826227.723529:0:194023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1787826227.723687:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1787826227.723720:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787826227.723729:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5a4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.723739:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5a4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826227.723747:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787826227.723750:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb47bfd6800 from 7 10000000:01000000:0.0:1787826227.723752:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826227.723781:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.723789:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.723799:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.723819:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.723874:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.723901:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.724042:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049330560 00000100:00100000:1.0:1787826227.724049:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049330560 00000100:00100000:1.0:1787826227.724090:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787826227.724100:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049330560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826227.724112:0:193937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826227.724125:0:193937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3200/0x878a5eea00ced5b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced5ab expref: -99 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.724145:0:193937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3200/0x878a5eea00ced5b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced5ab expref: 19 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.724155:0:193937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3200/0x878a5eea00ced5b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced5ab expref: 19 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.724164:0:193937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3200, rc 0) 00000100:00100000:1.0:1787826227.724198:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049330560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.724208:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826227.725240:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826227.725261:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5b2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826227.725271:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced5b2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826227.725375:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.725423:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.725453:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049330688 00000100:00100000:0.0:1787826227.725458:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049330688 00000100:00100000:0.0:1787826227.725486:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826227.725494:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049330688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.725596:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049330688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826227.725603:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826227.725630:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826227.725642:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.725666:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826227.725711:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826227.725724:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3493869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826227.726595:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049330816 00000100:00100000:1.0:1787826227.726602:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049330816 00000100:00100000:1.0:1787826227.726639:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787826227.726647:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049330816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826227.726758:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049330816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826227.726765:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787826227.731916:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826227.733522:0:194024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787826227.734951:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787826227.734982:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826227.734993:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5b2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.735006:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5b2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826227.735017:0:6488:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1787826227.735019:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8eb46a873370 from 1 10000000:01000000:1.0:1787826227.735022:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787826227.735061:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.735070:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826227.735081:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826227.735106:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826227.735167:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826227.735227:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348d23e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826227.735283:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049330944 00000100:00100000:2.0:1787826227.735291:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049330944 00000100:00100000:2.0:1787826227.735365:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787826227.735376:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049330944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826227.735389:0:193931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826227.735403:0:193931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481714e00/0x878a5eea00ced5c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced5b9 expref: -99 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.735422:0:193931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481714e00/0x878a5eea00ced5c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced5b9 expref: 20 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.735433:0:193931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481714e00/0x878a5eea00ced5c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced5b9 expref: 20 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.735441:0:193931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714e00, rc 0) 00000100:00100000:2.0:1787826227.735487:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049330944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826227.735494:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787826227.735589:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049330944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826227.735604:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5c0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.735617:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced5c0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826227.735634:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787826227.735638:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5c0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.735643:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5c0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826227.735650:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787826227.735651:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8eb46a873370 from 1 10000000:01000000:3.0:1787826227.735654:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787826227.735668:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.735674:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.735681:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826227.735693:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049331072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826227.735722:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826227.735754:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3489f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826227.735795:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049331072 00000100:00100000:2.0:1787826227.735800:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049331072 00000100:00100000:2.0:1787826227.735833:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787826227.735854:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049331072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826227.735862:0:193937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826227.735872:0:193937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481715400/0x878a5eea00ced5ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced5c7 expref: -99 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.735887:0:193937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481715400/0x878a5eea00ced5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced5c7 expref: 21 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.735896:0:193937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481715400/0x878a5eea00ced5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced5c7 expref: 21 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826227.735903:0:193937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715400, rc 0) 00000100:00100000:2.0:1787826227.735933:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049331072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826227.735938:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787826227.736073:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049331072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826227.736084:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.736096:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826227.736153:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049331200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826227.736179:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826227.736201:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3489f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826227.736254:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049331200 00000100:00100000:2.0:1787826227.736259:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049331200 00000100:00100000:2.0:1787826227.736288:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787826227.736295:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049331200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826227.736384:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049331200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (204us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826227.736391:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787826227.736465:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049331200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787826227.736487:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787826227.736493:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826227.736500:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826228.052687:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826228.052747:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049331328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826228.052812:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826228.052972:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049331328 00000100:00100000:3.0:1787826228.052981:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049331328 00000100:00100000:3.0:1787826228.053047:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5807 00000100:00080000:2.0:1787826228.053137:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826228.053186:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049331328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826228.053211:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826228.053279:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049331328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 223us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826228.053288:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5807 00000100:00100000:2.0:1787826228.053394:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049331328:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787826229.079384:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826230.113481:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.127673:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826231.636461:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826231.636468:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826231.636472:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826231.636483:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826231.636503:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e55880 x1874663049331584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826231.636529:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826231.636532:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826231.636533:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826231.636537:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826231.636548:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e57b80 x1874663049331840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826231.636557:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826231.636560:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826231.636562:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826231.636565:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8293 00000100:00080000:3.0:1787826231.636569:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826231.636572:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826231.636583:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e54e00 x1874663049331968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826231.636605:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826231.636609:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826231.636611:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826231.636615:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826231.636626:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e55180 x1874663049332224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826231.636648:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787826231.636651:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826231.636653:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826231.636656:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8293 00000100:00080000:3.0:1787826231.636658:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826231.636661:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb343732000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826231.636671:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb472584000 x1874663049332480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826231.636684:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787826231.636686:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826231.636688:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb47984c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826231.636691:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb47984c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826231.636701:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb472584e00 x1874663049332736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826231.636725:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049331584:0@lo:38:kworker.0 00000100:00100000:3.0:1787826231.636785:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826231.636829:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049331840:0@lo:38:kworker.0 00000100:00100000:3.0:1787826231.636852:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826231.636871:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049331968:0@lo:8:kworker.0 00000100:00100000:3.0:1787826231.636889:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826231.636900:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049332224:0@lo:38:kworker.0 00000100:00100000:3.0:1787826231.636915:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826231.636934:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049332480:0@lo:8:kworker.0 00000100:00100000:3.0:1787826231.636953:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826231.636964:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049332736:0@lo:38:kworker.0 00000100:00100000:3.0:1787826231.636979:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826231.636980:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049331584 00000100:00100000:1.0:1787826231.636987:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049331584 00000100:00100000:3.0:1787826231.637009:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049332096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826231.637016:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049332224 00000100:00100000:1.0:1787826231.637018:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049332224 00000100:00100000:1.0:1787826231.637031:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049332736 00000100:00100000:3.0:1787826231.637031:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826231.637033:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049332736 00000100:00100000:1.0:1787826231.637045:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1787826231.637046:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826231.637050:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049332352:0@lo:400:kworker.0 00000100:00100000:1.0:1787826231.637052:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049331584:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826231.637069:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787826231.637074:0:188682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8298 last 0 00000100:00100000:3.0:1787826231.637097:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1787826231.637101:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049332224:12345-0@lo:38:kworker.0 00000020:00000080:1.0:1787826231.637110:0:188682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x878a5eea00ced5d5 00010000:00080000:3.0:1787826231.637112:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8298 last 0 00000004:00100000:1.0:1787826231.637124:0:188682:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:3.0:1787826231.637132:0:187906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x878a5eea00ced5dc 00000004:00100000:3.0:1787826231.637137:0:187906:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787826231.637158:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb3423ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826231.637210:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874663049332224:12345-0@lo:38:kworker.0 Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826231.637218:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1787826231.637240:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1787826231.637244:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049332736:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1787826231.637253:0:188682:0:(import.c:65:import_set_state_nolock()) ffff8eb47984d800 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1787826231.637254:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8298 last 0 00000020:00000080:3.0:1787826231.637274:0:187906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x878a5eea00ced5e3 00000100:00100000:1.0:1787826231.637281:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874663049331584:12345-0@lo:38:kworker.0 Request processed in 229us (497us total) trans 0 rc 0/0 00000004:00100000:3.0:1787826231.637281:0:187906:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787826231.637288:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00080000:3.0:1787826231.637294:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb3423ec000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826231.637319:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049332736:12345-0@lo:38:kworker.0 Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826231.637350:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1787826231.637367:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049331840 00000100:00100000:3.0:1787826231.637371:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049331840 00000100:00100000:3.0:1787826231.637387:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049332352 00000100:00100000:3.0:1787826231.637389:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049332352 00000100:00100000:3.0:1787826231.637408:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12703 00000100:00100000:3.0:1787826231.637412:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049331840:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787826231.637424:0:8415:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8eb448c98000, cookie 0x878a5eea00ced48c 00010000:00080000:3.0:1787826231.637427:0:8415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8eb448c98000 cur 8298 last 1787826226 00010000:02000400:3.0:1787826231.637434:0:8415:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00010000:00080000:3.0:1787826231.637439:0:8415:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1787826231.637445:0:8415:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787826231.637458:0:8415:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826231.637488:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049331840:12345-0@lo:38:kworker.0 Request processed in 74us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826231.637494:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12703 00000100:00100000:3.0:1787826231.637505:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12704 00000100:00100000:3.0:1787826231.637510:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049332352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826231.637540:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049332352:12345-0@lo:400:kworker.0 Request processed in 31us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826231.637546:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12704 00010000:00080000:3.0:1787826231.637576:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb343e55880 x1874663049331584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826231.637590:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 81 00000100:00080000:3.0:1787826231.638597:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8eb343e55880 x1874663049331584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826246 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826231.638609:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1787826231.638613:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1787826231.638618:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787826231.638624:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049331584:0@lo:38:kworker.0 00000100:00080000:3.0:1787826231.638650:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 81 00000100:00080000:3.0:1787826231.638659:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1787826231.638663:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1787826231.638665:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 330712483740 gen 2 00000100:00080000:3.0:1787826231.638669:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff8eb48165c000 from lustre-MDT0000_UUID committed 330712483740 last 0 00000100:00080000:3.0:1787826231.638673:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:3.0:1787826231.638709:0:193959:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:3.0:1787826231.638714:0:193959:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 343597383684 00000020:00080000:3.0:1787826231.638718:0:193959:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826231.638722:0:193959:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 343597383684 00000020:00080000:3.0:1787826231.638726:0:193959:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826231.638728:0:193959:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 343597383684 00000100:00100000:3.0:1787826231.638751:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049332352:0@lo:400:kworker.0 00000100:00100000:3.0:1787826231.638885:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049331840:0@lo:38:kworker.0 00010000:00080000:3.0:1787826231.638900:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb343e55180 x1874663049332224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826231.638909:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 81 00000100:00100000:0.0:1787826231.639306:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049331456:0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.639373:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826231.639408:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049332608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.639433:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826231.639457:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826231.639464:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049331712:0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.639487:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826231.639517:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049331968 00000100:00100000:0.0:1787826231.639523:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049331968 00000100:00100000:0.0:1787826231.639548:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049332480 00000100:00100000:0.0:1787826231.639551:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049332480 00000100:00100000:0.0:1787826231.639566:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22574 00000100:00100000:0.0:1787826231.639572:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:0+-99:3616:x1874663049331968:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787826231.639590:0:179225:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826231.639624:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:0+-99:3616:x1874663049331968:12345-0@lo:8:kworker.0 Request processed in 51us (2733us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826231.639631:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22574 00000100:00100000:0.0:1787826231.639645:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049332096 00000100:00100000:0.0:1787826231.639648:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049332096 00000100:00100000:0.0:1787826231.639683:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049332608 00000100:00100000:0.0:1787826231.639687:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049332608 00000100:00100000:0.0:1787826231.639708:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7047 00000100:00100000:0.0:1787826231.639714:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049332096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.639754:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049332096:12345-0@lo:400:kworker.0 Request processed in 40us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826231.639760:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7047 00000100:00100000:0.0:1787826231.639772:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7048 00000100:00100000:0.0:1787826231.639778:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049332608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.639807:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049332608:12345-0@lo:400:kworker.0 Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826231.639813:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7048 00000100:00100000:0.0:1787826231.639826:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22575 00000100:00100000:0.0:1787826231.639830:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:0+-99:3616:x1874663049332480:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787826231.639840:0:179225:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826231.639863:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:0+-99:3616:x1874663049332480:12345-0@lo:8:kworker.0 Request processed in 32us (2908us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826231.639870:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22575 00000100:00100000:0.0:1787826231.639896:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049331456 00000100:00100000:0.0:1787826231.639900:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049331456 00000100:00100000:0.0:1787826231.639925:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787826231.639932:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3619:x1874663049331456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.639959:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3619:x1874663049331456:12345-0@lo:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826231.639966:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787826231.639994:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049331712 00000100:00100000:0.0:1787826231.639998:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049331712 00000100:00100000:0.0:1787826231.640025:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787826231.640031:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049331712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.640060:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049331712:12345-0@lo:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826231.640066:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787826231.640088:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826231.640092:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826231.640119:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049332096:0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.640151:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049331712:0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.640159:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049331456:0@lo:400:kworker.0 00000100:00100000:0.0:1787826231.640168:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049332608:0@lo:400:kworker.0 00000100:00100000:2.0:1787826231.640308:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826231.640317:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049332864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826231.640367:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826231.640393:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049332864 00000100:00100000:2.0:1787826231.640397:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049332864 00000100:00100000:2.0:1787826231.640424:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12705 00000100:00100000:2.0:1787826231.640430:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049332864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826231.640454:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446047744 avail 1299808256 00000100:00100000:2.0:1787826231.640488:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049332864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826231.640495:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12705 00000100:00100000:2.0:1787826231.640526:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049332864:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1787826231.641165:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8eb343e55180 x1874663049332224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826246 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826231.641182:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1787826231.641186:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1787826231.641201:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787826231.641206:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049332224:0@lo:38:kworker.0 00000100:00080000:3.0:1787826231.641222:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826231.641226:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826231.641229:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049332480:0@lo:8:kworker.0 00010000:00080000:3.0:1787826231.641239:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb472584e00 x1874663049332736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826231.641249:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 81 00000100:00080000:3.0:1787826231.641255:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787826231.641259:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787826231.641261:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47984c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826231.641265:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049332736:0@lo:38:kworker.0 00000100:00080000:3.0:1787826231.641288:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826231.641291:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826231.641294:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049331968:0@lo:8:kworker.0 00010000:00080000:3.0:1787826231.641319:0:194174:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1787826231.641396:0:194174:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1787826231.641401:0:194174:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1787826231.641808:0:194174:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1787826231.641967:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049332992:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787826231.642013:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826231.642075:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049332992 00000100:00100000:0.0:1787826231.642081:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049332992 00000100:00100000:0.0:1787826231.642110:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12706 00000100:00100000:0.0:1787826231.642118:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049332992:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787826231.642135:0:177390:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb476d32680 x1874663049332992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:587/0 lens 224/0 e 0 to 0 dl 1787826242 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826231.642150:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049332992:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (138us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826231.642156:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12706 00000020:00080000:3.0:1787826231.642291:0:193959:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826231.642296:0:193959:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383684 00010000:00080000:3.0:1787826231.642299:0:193959:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1787826231.642302:0:193959:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826231.642307:0:193959:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826231.642310:0:193959:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1787826231.642626:0:193959:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 81, last_transno is 347892350976 00000001:00100000:1.0:1787826231.653975:0:193926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1787826231.672355:0:193959:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1787826231.672402:0:193959:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1787826231.672416:0:193959:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8eb476d32680 x1874663049332992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:587/0 lens 224/0 e 0 to 0 dl 1787826242 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1787826231.672518:0:193959:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000100:00080000:2.0:1787826231.683485:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787826231.683502:0:3616:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8eb477f66a00 x1874663049332992/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826247 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826231.683513:0:3616:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8eb477f66a00 x1874663049332992/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826247 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826231.683521:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787826231.683543:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787826231.683548:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049332992:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787826231.683652:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826231.683665:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049333120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826231.683722:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826231.683762:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049333120 00000100:00100000:0.0:1787826231.683769:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049333120 00000100:00100000:0.0:1787826231.683809:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12707 00000100:00100000:0.0:1787826231.683818:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049333120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826231.683849:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445617664 avail 1299378176 00000100:00100000:0.0:1787826231.683892:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049333120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826231.683899:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12707 00000100:00100000:0.0:1787826231.683935:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049333120:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1787826231.694842:0:193959:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb65b85e0be10 00100000:10000000:2.0:1787826231.694855:0:193959:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1787826231.704954:0:193947:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x17e7:0x0] 00000100:00100000:0.0:1787826231.705000:0:193947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:193947:1874663049333248:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787826231.705064:0:193947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826231.705091:0:193947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3497f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826231.705110:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049333248 00000100:00100000:0.0:1787826231.705116:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049333248 00000100:00100000:0.0:1787826231.705165:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22576 00000100:00100000:0.0:1787826231.705174:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:193947:x1874663049333248:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787826231.705211:0:179226:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6241 -> diff = -122 00002000:02000040:0.0:1787826231.705217:0:179226:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6120 to 0x2c0000401:6241) 00002000:00010000:0.0:1787826231.711157:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1861:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.711171:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.711187:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1861:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.711974:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1861:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.711984:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.712007:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.712018:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.712026:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.712525:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826231.712633:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1860:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.712639:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.712649:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1860:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.712653:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1860:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.712657:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.712666:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.712674:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.712687:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713703:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826231.713712:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713721:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826231.713725:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713734:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713750:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713756:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058975277/0x878a5eea00ced5ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713773:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826231.713777:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713783:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826231.713786:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713794:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713804:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.713818:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.713820:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.713822:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787826231.714305:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787826231.714417:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.714424:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a16e03/0x878a5eea00ced5f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.714511:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x185f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.714516:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.714526:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185f:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.714530:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.714535:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.714546:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.714554:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.714562:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714599:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826231.714605:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714612:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826231.714615:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714622:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714634:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714642:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.714644:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.714646:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.714716:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.714721:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb3b4b91/0x878a5eea00ced5f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.714772:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x185e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.714777:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.714785:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185e:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.714788:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.714792:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.714800:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.714807:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.714814:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714842:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826231.714847:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714854:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826231.714857:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714865:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714875:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.714882:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.714883:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.714884:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.714939:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.714944:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b1dcf44/0x878a5eea00ced5ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.714991:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x185d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.714996:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715003:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185d:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.715006:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.715010:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715018:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715025:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715032:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715059:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826231.715064:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715072:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826231.715075:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715083:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715093:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715101:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.715102:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.715104:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.715155:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.715160:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cee1c85f/0x878a5eea00ced606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.715214:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x185c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.715219:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715231:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185c:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.715233:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.715237:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715245:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715253:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715260:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715287:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826231.715292:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715298:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826231.715301:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715308:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715352:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.715361:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.715362:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.715364:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.715582:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.715587:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003738c5e0/0x878a5eea00ced60d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.715634:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x185b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.715639:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715647:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185b:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.715650:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.715654:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715663:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715671:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715678:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715708:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826231.715712:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715719:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826231.715722:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715730:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715742:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715751:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.715753:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.715755:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.715822:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.715828:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00ced614 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.715874:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x185a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.715880:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715888:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185a:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.715891:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.715896:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715905:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715917:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.715924:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715953:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826231.715958:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715965:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826231.715968:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715976:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715986:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.715994:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.715995:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.715997:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.716061:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.716066:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00ced61b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.716113:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1859:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.716118:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716126:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1859:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.716128:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.716132:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716140:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716147:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716159:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716197:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826231.716203:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716209:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826231.716212:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716220:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716230:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716238:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.716239:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.716240:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.716293:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.716297:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b0236c7/0x878a5eea00ced622 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.716373:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1858:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.716379:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716387:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1858:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.716390:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1858:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.716394:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716403:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716411:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716418:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716502:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826231.716507:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716520:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826231.716523:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716531:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716541:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.716549:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.716551:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.716553:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.716620:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.716625:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00ced629 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.716673:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1857:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.716678:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716686:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1857:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.716689:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.716693:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716701:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716709:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716715:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.716739:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826231.716744:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.716756:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826231.716760:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.716767:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.716777:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.716786:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.716788:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.716789:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.716854:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.716859:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f86338e/0x878a5eea00ced630 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.716912:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1856:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.716917:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716925:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1856:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.716928:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.716932:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716941:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716948:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.716955:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.716980:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826231.716985:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.716992:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826231.716995:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.717002:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.717013:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826231.717021:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.717023:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.717025:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.717081:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.717086:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00ced637 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.717130:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1855:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.717136:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.717148:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1855:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.717151:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.717155:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.717164:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.717173:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.717180:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.717213:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826231.717218:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.717225:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826231.717229:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.717236:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.717246:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.717255:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.717257:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.717258:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.717311:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.717316:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00ced63e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.717386:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1854:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.717391:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.717399:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1854:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.717403:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1854:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.717407:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.717416:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.717424:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.717431:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.721249:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826231.721264:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.721278:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826231.721283:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.721294:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.721314:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826231.721335:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.721337:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.721340:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.721413:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826231.721421:0:179226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064d450b8/0x878a5eea00ced645 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.721533:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1853:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.721540:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721551:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1853:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.721556:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.721562:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721575:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721589:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721597:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721617:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826231.721652:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1852:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.721657:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721665:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1852:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.721668:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.721673:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721681:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721689:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721696:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721713:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787826231.721749:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1851:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.721754:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721762:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1851:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.721765:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1851:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.721769:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721777:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721785:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721792:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721802:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787826231.721833:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1850:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.721838:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721845:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1850:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.721848:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1850:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.721852:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721861:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721869:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721876:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721883:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787826231.721913:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x184f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.721918:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721925:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184f:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.721928:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.721931:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721939:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721946:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721954:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.721961:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787826231.721990:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x184e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.721995:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722002:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184e:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722004:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.722008:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722017:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722023:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722030:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722037:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1787826231.722069:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x184d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.722074:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722075:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787826231.722081:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184d:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:2.0:1787826231.722081:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722084:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826231.722088:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826231.722089:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722093:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722097:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722101:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722105:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722111:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722114:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722119:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1787826231.722121:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00ced64c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722136:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787826231.722139:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722145:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc0e34230) 00002000:00010000:0.0:1787826231.722148:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x184c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722149:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722153:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722156:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722160:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184c:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722163:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826231.722166:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722167:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722174:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c90d7b0/0x878a5eea00ced653 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722176:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722184:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722186:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787826231.722201:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722204:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722207:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722211:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722213:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1787826231.722218:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722227:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722234:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00ced65a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722243:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x184b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722246:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787826231.722248:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722249:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722255:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184b:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:2.0:1787826231.722256:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826231.722259:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826231.722260:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722263:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722272:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722273:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722280:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722283:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722288:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722290:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00ced661 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722301:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787826231.722302:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787826231.722303:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722309:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722312:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722319:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722348:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x184a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722350:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722352:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722358:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eef5dfe2/0x878a5eea00ced668 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722360:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184a:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722363:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x184a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.722368:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722376:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722376:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787826231.722379:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722384:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722386:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722389:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722391:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722397:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722399:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787826231.722405:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722412:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002363fcde/0x878a5eea00ced66f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722422:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787826231.722425:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722431:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1849:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722431:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722434:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722435:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722443:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1849:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722446:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826231.722447:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722451:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722457:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722459:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722465:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00ced676 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722467:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722474:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722476:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826231.722479:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722481:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787826231.722485:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722488:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722495:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722504:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722507:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1848:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.722512:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722512:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00ced67d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722520:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1848:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722523:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.722527:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722528:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826231.722532:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722536:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722538:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722541:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722544:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722548:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722552:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722557:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722559:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787826231.722564:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cb2dc7f/0x878a5eea00ced684 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722575:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826231.722578:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722585:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1847:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722585:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722588:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722589:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722597:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1847:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722600:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826231.722601:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722604:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722611:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722613:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722619:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00ced68b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722621:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722628:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722630:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826231.722633:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722636:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787826231.722639:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722642:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722649:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722657:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722662:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1846:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722665:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00ced692 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722666:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722675:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1846:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722678:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.722682:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722682:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826231.722685:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722690:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722691:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722694:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722698:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722702:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722705:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722710:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722712:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787826231.722717:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000473504b/0x878a5eea00ced699 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722727:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826231.722731:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722737:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569600 already unused, calling callback (ffffffffc0e34230) 00002000:00010000:0.0:1787826231.722738:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1845:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722740:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722742:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722749:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1845:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722752:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826231.722754:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722756:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722764:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722765:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722772:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccbf1318/0x878a5eea00ced6a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722773:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722781:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722782:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826231.722785:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722788:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826231.722791:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722794:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722801:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722809:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722813:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1844:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722817:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00ced6a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722818:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722825:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1844:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722828:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.722832:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722833:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826231.722836:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722841:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722843:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722846:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722849:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722853:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722856:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722862:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722869:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826231.722869:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00ced6ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722878:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826231.722881:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722887:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722890:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722894:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1843:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826231.722898:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722903:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722906:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1843:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722909:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1843:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826231.722912:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722913:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722921:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00ced6b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722922:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722930:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722932:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826231.722934:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826231.722936:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.722937:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722946:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826231.722951:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826231.722954:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722961:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.722964:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.722970:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826231.722976:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1842:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826231.722980:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722981:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722989:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1842:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:0.0:1787826231.722992:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826231.722992:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00ced6bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.722996:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.723004:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.723004:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826231.723005:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826231.723007:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826231.723012:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.723019:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826231.723035:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787826231.723584:0:179226:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6119 00000100:00100000:0.0:1787826231.723671:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:193947:x1874663049333248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18494us (18603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826231.723681:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22576 00000100:00100000:0.0:1787826231.723734:0:193947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:193947:1874663049333248:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787826231.723748:0:193947:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1861:0x0] from OST, last_created [0x2c0000401:0x1861:0x0]last_used is [0x2c0000401:0x17e7:0x0] 00000100:00100000:0.0:1787826231.723806:0:193947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:193947:1874663049333504:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787826231.723838:0:193947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826231.723859:0:193947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f630540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826231.723873:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826231.723883:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049333376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826231.723906:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826231.723935:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049333504 00000100:00100000:0.0:1787826231.723942:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049333504 00000100:00100000:0.0:1787826231.723977:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22577 00000100:00100000:0.0:1787826231.723985:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:193947:x1874663049333504:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787826231.724020:0:43906:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6242 00010000:00010000:2.0:1787826231.724092:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826231.724098:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.724108:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826231.724111:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.724120:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.724134:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.724142:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9872244/0x878a5eea00ced6c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826231.724159:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826231.724161:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826231.724164:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.724341:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826231.724348:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826231.728267:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826231.731707:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:193947:x1874663049333504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7714us (7860us total) trans 4294975536 rc 0/0 00000100:00100000:0.0:1787826231.731721:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22577 00000100:00100000:0.0:1787826231.731757:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049333376 00000100:00100000:0.0:1787826231.731765:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049333376 00000100:00100000:0.0:1787826231.731801:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5808 00000100:00100000:0.0:1787826231.731809:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049333376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826231.731829:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826231.731878:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049333376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (7971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826231.731885:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5808 00000100:00100000:0.0:1787826231.731939:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049333376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826231.732136:0:193947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:193947:1874663049333504:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787826231.732151:0:193947:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1861:0x0]-[0x2c0000401:0x1881:0x0] 00000001:02000400:0.0:1787826231.842081:0:194208:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787826232.151046:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826232.152821:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787826233.172675:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049333632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826233.172776:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826233.172932:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049333632 00000100:00100000:3.0:1787826233.172941:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049333632 00000100:00100000:3.0:1787826233.173006:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5809 00000100:00100000:3.0:1787826233.173017:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049333632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826233.173047:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826233.173097:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049333632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826233.173105:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5809 00000100:00080000:3.0:1787826233.173128:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826233.173205:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826233.173655:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049333632:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1787826233.375215:0:194261:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826233.375472:0:194261:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787826234.196576:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787826234.341697:0:194311:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826234.341924:0:194311:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826234.611888:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.612101:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042983040 00000100:00100000:3.0:1787826234.612112:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042983040 00000100:00100000:3.0:1787826234.612164:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:3.0:1787826234.612182:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2388:x1874663042983040:12345-192.168.203.47@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787826234.612208:0:193937:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f40147eb-9b53-47d4-b77c-99ceedd9664c@192.168.203.47@tcp t0 exp 0000000000000000 cur 8301 last 0 00000020:00000080:3.0:1787826234.612243:0:193937:0:(genops.c:1385:class_connect()) connect: client f40147eb-9b53-47d4-b77c-99ceedd9664c, cookie 0x878a5eea00ced6ca 00000100:00080000:3.0:1787826234.612426:0:193937:0:(import.c:65:import_set_state_nolock()) ffff8eb47bfd1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826234.612496:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+5:2388:x1874663042983040:12345-192.168.203.47@tcp:250:mount.lustre.0 Request processed in 322us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.612504:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:0.0:1787826234.621214:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.621386:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042983168 00000100:00100000:3.0:1787826234.621396:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042983168 00000100:00100000:3.0:1787826234.621455:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:3.0:1787826234.621465:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+5:159721:x1874663042983168:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787826234.621482:0:193933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826234.621500:0:193933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced6d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f147 expref: -99 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.621525:0:193933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f147 expref: 6 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.621535:0:193933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f147 expref: 6 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.621543:0:193933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8ec00, rc 0) 00000100:00100000:3.0:1787826234.621605:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+6:159721:x1874663042983168:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 142us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.621612:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:0.0:1787826234.628060:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.628473:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042983296 00000100:00100000:3.0:1787826234.628484:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042983296 00000100:00100000:3.0:1787826234.628541:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:3.0:1787826234.628551:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+6:159721:x1874663042983296:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787826234.628670:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+6:159721:x1874663042983296:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 120us (619us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826234.628681:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:1.0:1787826234.633906:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.634007:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042983424 00000100:00100000:3.0:1787826234.634017:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042983424 00000100:00100000:3.0:1787826234.634075:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:3.0:1787826234.634086:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb344b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+6:159721:x1874663042983424:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787826234.634101:0:193933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826234.634314:0:193933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8f000/0x878a5eea00ced6d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f14e expref: -99 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.634379:0:193933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8f000/0x878a5eea00ced6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f14e expref: 7 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.634392:0:193933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8f000/0x878a5eea00ced6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f14e expref: 7 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.634401:0:193933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8f000, rc 0) 00000100:00100000:3.0:1787826234.634459:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb344b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+7:159721:x1874663042983424:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 375us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.634466:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:0.0:1787826234.640810:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.645020:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042983552 00000100:00100000:3.0:1787826234.645035:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042983552 00000100:00100000:3.0:1787826234.645110:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:3.0:1787826234.645191:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb442b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+7:159721:x1874663042983552:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787826234.645749:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb442b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159721:x1874663042983552:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 627us (4954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.645758:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:0.0:1787826234.654924:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826234.656356:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042983680 00000100:00100000:2.0:1787826234.656429:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042983680 00000100:00100000:2.0:1787826234.656551:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:2.0:1787826234.656562:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3423e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159721:x1874663042983680:12345-192.168.203.47@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787826234.656718:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3423e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159721:x1874663042983680:12345-192.168.203.47@tcp:503:mount.lustre.0 Request processed in 158us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826234.656728:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:1.0:1787826234.671741:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826234.672070:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042983808 00000100:00100000:0.0:1787826234.672084:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042983808 00000100:00100000:0.0:1787826234.672158:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:0.0:1787826234.672184:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159739:x1874663042983808:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787826234.672458:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159739:x1874663042983808:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 287us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826234.672469:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:0.0:1787826234.697749:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.697922:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042983936 00000100:00100000:3.0:1787826234.697937:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042983936 00000100:00100000:3.0:1787826234.698021:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:3.0:1787826234.698034:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3432fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159739:x1874663042983936:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787826234.698563:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3432fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159739:x1874663042983936:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 528us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.698576:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:1.0:1787826234.709983:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826234.710264:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042984064 00000100:00100000:0.0:1787826234.710285:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042984064 00000100:00100000:0.0:1787826234.710411:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:0.0:1787826234.710425:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159739:x1874663042984064:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787826234.710652:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159739:x1874663042984064:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 228us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826234.710661:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:1.0:1787826234.716123:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826234.717423:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042984192 00000100:00100000:2.0:1787826234.717443:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042984192 00000100:00100000:2.0:1787826234.717537:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:2.0:1787826234.717550:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159721:x1874663042984192:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787826234.717573:0:193931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826234.717598:0:193931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f17f expref: -99 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826234.717638:0:193931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 9 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826234.717652:0:193931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 9 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826234.717662:0:193931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714800, rc 0) 00000100:00100000:2.0:1787826234.717760:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159721:x1874663042984192:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 212us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826234.717768:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:1.0:1787826234.736925:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826234.737194:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042984320 00000100:00100000:0.0:1787826234.737208:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042984320 00000100:00100000:0.0:1787826234.738271:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:0.0:1787826234.738286:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159721:x1874663042984320:12345-192.168.203.47@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787826234.738321:0:193932:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787826234.738393:0:193932:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787826234.738398:0:193932:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787826234.738401:0:193932:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787826234.738403:0:193932:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 334 00000100:00100000:0.0:1787826234.741992:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159721:x1874663042984320:12345-192.168.203.47@tcp:256:mount.lustre.0 Request processed in 3691us (5183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826234.742013:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:1.0:1787826234.745983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.746120:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042984448 00000100:00100000:3.0:1787826234.746134:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042984448 00000100:00100000:3.0:1787826234.746581:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:3.0:1787826234.746596:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159721:x1874663042984448:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787826234.746619:0:193933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826234.746644:0:193933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8f400/0x878a5eea00ced6e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f186 expref: -99 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.746677:0:193933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8f400/0x878a5eea00ced6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f186 expref: 10 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.746690:0:193933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb47fa8f400/0x878a5eea00ced6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f186 expref: 10 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826234.746702:0:193933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8f400, rc 0) 00000100:00100000:3.0:1787826234.751240:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159721:x1874663042984448:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 4615us (5240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.751258:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:1.0:1787826234.754605:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.754717:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042984576 00000100:00100000:3.0:1787826234.754730:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042984576 00000100:00100000:3.0:1787826234.754964:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:3.0:1787826234.754978:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159721:x1874663042984576:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787826234.755190:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159721:x1874663042984576:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 215us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.755199:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:1.0:1787826234.761179:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826234.761429:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042984704 00000100:00100000:2.0:1787826234.761442:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042984704 00000100:00100000:2.0:1787826234.761544:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:2.0:1787826234.761556:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159721:x1874663042984704:12345-192.168.203.47@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787826234.761755:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159721:x1874663042984704:12345-192.168.203.47@tcp:503:mount.lustre.0 Request processed in 200us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826234.761765:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:1.0:1787826234.766128:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826234.766257:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042984832 00000100:00100000:0.0:1787826234.766271:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042984832 00000100:00100000:0.0:1787826234.766368:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:0.0:1787826234.766382:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159745:x1874663042984832:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787826234.766592:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159745:x1874663042984832:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 211us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826234.766601:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:1.0:1787826234.770530:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.770639:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042984960 00000100:00100000:3.0:1787826234.770653:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042984960 00000100:00100000:3.0:1787826234.770724:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:3.0:1787826234.770737:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159745:x1874663042984960:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787826234.771117:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159745:x1874663042984960:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 381us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.771127:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:1.0:1787826234.784680:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826234.784806:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826234.785422:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042985088 00000100:00100000:2.0:1787826234.785438:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042985088 00000100:00100000:2.0:1787826234.785508:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042985344 00000100:00100000:2.0:1787826234.785511:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042985344 00000100:00100000:2.0:1787826234.785539:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1020 00000100:00100000:2.0:1787826234.785551:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042985088:12345-192.168.203.47@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787826234.785592:0:187905:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp t0 exp 0000000000000000 cur 8301 last 0 00000020:00000080:2.0:1787826234.785665:0:187905:0:(genops.c:1385:class_connect()) connect: client c0d7758a-4501-4a89-8ec1-407fef4f0c7f, cookie 0x878a5eea00ced6ed 00000004:00100000:2.0:1787826234.785700:0:187905:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787826234.786393:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1021 00000100:00100000:0.0:1787826234.786402:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042985344:12345-192.168.203.47@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787826234.786432:0:188682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp t0 exp 0000000000000000 cur 8301 last 0 00000020:00000080:0.0:1787826234.786483:0:188682:0:(genops.c:1385:class_connect()) connect: client c0d7758a-4501-4a89-8ec1-407fef4f0c7f, cookie 0x878a5eea00ced6f4 00000004:00100000:0.0:1787826234.786503:0:188682:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787826234.786602:0:188682:0:(import.c:65:import_set_state_nolock()) ffff8eb46e35d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826234.786693:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663042985344:12345-192.168.203.47@tcp:38:mount.lustre.0 Request processed in 290us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826234.786701:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1021 00000100:00080000:2.0:1787826234.799421:0:187905:0:(import.c:65:import_set_state_nolock()) ffff8eb472755000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826234.802813:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663042985088:12345-192.168.203.47@tcp:38:mount.lustre.0 Request processed in 17236us (18122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826234.802835:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1020 00000100:00100000:1.0:1787826234.811195:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826234.814689:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042985472 00000100:00100000:0.0:1787826234.814712:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042985472 00000100:00100000:0.0:1787826234.814946:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1022 00000100:00100000:0.0:1787826234.814959:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:0:x1874663042985472:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787826234.815023:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826234.815184:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:0:x1874663042985472:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 226us (4017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826234.815191:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1022 00000100:00080000:3.0:1787826234.816745:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826234.824496:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.824550:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826234.824719:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042985216 00000100:00100000:1.0:1787826234.824733:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042985216 00000100:00100000:1.0:1787826234.824818:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042985600 00000100:00100000:1.0:1787826234.824822:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042985600 00000100:00100000:1.0:1787826234.824864:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1023 00000100:00100000:1.0:1787826234.824876:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:0:x1874663042985216:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787826234.824927:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445617664 avail 1299378176 00000100:00100000:1.0:1787826234.825040:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:0:x1874663042985216:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 165us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826234.825048:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1023 00000100:00100000:1.0:1787826234.825071:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1024 00000100:00100000:1.0:1787826234.825078:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159721:x1874663042985600:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787826234.825090:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445617664 avail 1299378176 00000100:00100000:1.0:1787826234.825115:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159721:x1874663042985600:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 37us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826234.825123:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1024 00000100:00080000:3.0:1787826234.826841:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826234.829978:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826234.830153:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042985728 00000100:00100000:1.0:1787826234.830166:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042985728 00000100:00100000:1.0:1787826234.830268:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1025 00000100:00100000:1.0:1787826234.830282:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159721:x1874663042985728:12345-192.168.203.47@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787826234.830451:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159721:x1874663042985728:12345-192.168.203.47@tcp:40:mount.lustre.0 Request processed in 172us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826234.830459:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1025 00000100:00100000:1.0:1787826234.836736:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826234.836783:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826234.836820:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826234.836943:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042985856 00000100:00100000:0.0:1787826234.836959:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042985856 00000100:00100000:0.0:1787826234.837007:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042985984 00000100:00100000:0.0:1787826234.837010:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042985984 00000100:00100000:0.0:1787826234.837034:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22578 00000100:00100000:0.0:1787826234.837045:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1874663042985856:12345-192.168.203.47@tcp:8:mount.lustre.0 00010000:00020000:0.0:1787826234.837077:0:8405:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826234.837159:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1874663042985856:12345-192.168.203.47@tcp:8:mount.lustre.0 Request processed in 115us (440us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826234.837167:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22578 00000100:00100000:0.0:1787826234.837202:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22579 00000100:00100000:0.0:1787826234.837219:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1874663042985984:12345-192.168.203.47@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787826234.837251:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp t0 exp 0000000000000000 cur 8301 last 0 00000020:00000080:0.0:1787826234.837297:0:8405:0:(genops.c:1385:class_connect()) connect: client c0d7758a-4501-4a89-8ec1-407fef4f0c7f, cookie 0x878a5eea00ced6fb 00002000:00100000:0.0:1787826234.837314:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c0d7758a-4501-4a89-8ec1-407fef4f0c7f/ffff8eb46e35b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787826234.837541:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787826234.837625:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787826234.837659:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8eb3423e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826234.837701:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663042985984:12345-192.168.203.47@tcp:8:mount.lustre.0 Request processed in 492us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826234.837709:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22579 00000100:00100000:2.0:1787826234.838115:0:187916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042986112 00000100:00100000:2.0:1787826234.838123:0:187916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042986112 00000100:00100000:2.0:1787826234.838185:0:187916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:2.0:1787826234.838196:0:187916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159721:x1874663042986112:12345-192.168.203.47@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787826234.838265:0:187916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159721:x1874663042986112:12345-192.168.203.47@tcp:900:mount.lustre.0 Request processed in 71us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826234.838274:0:187916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:0.0:1787826234.841109:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826234.841465:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042986240 00000100:00100000:3.0:1787826234.841480:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042986240 00000100:00100000:3.0:1787826234.841583:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:3.0:1787826234.841596:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159721:x1874663042986240:12345-192.168.203.47@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787826234.846502:0:187907:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4788us 00000004:00200000:2.0:1787826234.860091:0:187907:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000100:00100000:2.0:1787826234.860431:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159721:x1874663042986240:12345-192.168.203.47@tcp:33:mount.lustre.0 Request processed in 18827us (19326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826234.860450:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 3 00010000:00010000:3.0:1787826235.220890:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826236.245868:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826236.756480:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826236.756502:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049333760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826236.756581:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826236.756737:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049333760 00000100:00100000:2.0:1787826236.756744:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049333760 00000100:00100000:2.0:1787826236.756790:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12708 00000100:00100000:2.0:1787826236.756799:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049333760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826236.756843:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446047744 avail 1299808256 00000100:00100000:2.0:1787826236.756895:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049333760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826236.756903:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12708 00000100:00100000:2.0:1787826236.756952:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049333760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826236.758212:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049333888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826236.758279:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826236.758344:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049333888 00000100:00100000:0.0:1787826236.758350:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049333888 00000100:00100000:0.0:1787826236.758386:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12709 00000100:00100000:0.0:1787826236.758394:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049333888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826236.758426:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445617664 avail 1299378176 00000100:00100000:0.0:1787826236.758468:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049333888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826236.758475:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12709 00000100:00100000:0.0:1787826236.758518:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049333888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826236.760449:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826236.760467:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049334016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826236.760523:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826236.760564:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049334016 00000100:00100000:0.0:1787826236.760571:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049334016 00000100:00100000:0.0:1787826236.760644:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5810 00000100:00100000:0.0:1787826236.760656:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049334016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826236.760685:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826236.760730:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049334016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826236.760736:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5810 00000100:00080000:0.0:1787826236.760756:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826236.760791:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049334016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826236.762143:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049334144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826236.762211:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826236.762304:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049334144 00000100:00100000:0.0:1787826236.762310:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049334144 00000100:00100000:0.0:1787826236.762385:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787826236.762395:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3619:x1874663049334144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826236.764523:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3619:x1874663049334144:12345-0@lo:400:kworker.0 Request processed in 2122us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826236.764542:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787826236.766776:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826236.766790:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826236.766793:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826236.766801:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8298 00000100:00080000:1.0:1787826236.766805:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1787826236.766912:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049334400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826236.766982:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826236.767123:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826236.767149:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46ea6a300 x1874663049334528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826236.767207:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787826236.767211:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826236.767213:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826236.767218:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8298 00000100:00080000:1.0:1787826236.767221:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787826236.767225:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb343732000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826236.767238:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46ea69880 x1874663049334912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826236.767419:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049334272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.767454:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826236.767480:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049335040:0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.767504:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826236.767525:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826236.767530:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049334784:0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.767552:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826236.767580:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049334400 00000100:00100000:1.0:1787826236.767587:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049334400 00000100:00100000:3.0:1787826236.767720:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049334528:0@lo:8:kworker.0 00000100:00100000:3.0:1787826236.767755:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826236.767785:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049334912:0@lo:8:kworker.0 00000100:00100000:3.0:1787826236.767806:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826236.767848:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049334528 00000100:00100000:3.0:1787826236.767852:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049334528 00000100:00100000:3.0:1787826236.767878:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049334912 00000100:00100000:3.0:1787826236.767881:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049334912 00000100:00100000:3.0:1787826236.767897:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22580 00000100:00100000:3.0:1787826236.767904:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3616:x1874663049334528:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787826236.767927:0:43904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826236.767967:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3616:x1874663049334528:12345-0@lo:8:kworker.0 Request processed in 61us (210us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826236.767973:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22580 00000100:00100000:3.0:1787826236.767988:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22581 00000100:00100000:3.0:1787826236.767991:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3616:x1874663049334912:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787826236.768000:0:43904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826236.768023:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3616:x1874663049334912:12345-0@lo:8:kworker.0 Request processed in 30us (216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826236.768028:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22581 00000100:00080000:3.0:1787826236.768065:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826236.768069:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826236.768073:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049334528:0@lo:8:kworker.0 00000100:00080000:3.0:1787826236.768082:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826236.768085:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826236.768089:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049334912:0@lo:8:kworker.0 00000100:00100000:1.0:1787826236.768758:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049334272 00000100:00100000:1.0:1787826236.768764:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049334272 00000100:00100000:1.0:1787826236.768898:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049335040 00000100:00100000:1.0:1787826236.768902:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049335040 00000100:00100000:1.0:1787826236.768915:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049334784 00000100:00100000:1.0:1787826236.768918:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049334784 00000100:00100000:1.0:1787826236.768930:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787826236.768937:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049334400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.768995:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049334400:12345-0@lo:400:kworker.0 Request processed in 58us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826236.769000:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787826236.769017:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787826236.769023:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049334272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.769058:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049334272:12345-0@lo:400:kworker.0 Request processed in 35us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826236.769063:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787826236.769075:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787826236.769081:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049335040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.769109:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049335040:12345-0@lo:400:kworker.0 Request processed in 29us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826236.769115:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787826236.769126:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787826236.769132:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049334784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.769168:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049334784:12345-0@lo:400:kworker.0 Request processed in 24us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826236.769175:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:1.0:1787826236.769216:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb46ea6a680 x1874663049334784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826236.769229:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049334784:0@lo:400:kworker.0 00010000:00080000:1.0:1787826236.769242:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb46ea69180 x1874663049334272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826236.769744:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049334272:0@lo:400:kworker.0 00010000:00080000:1.0:1787826236.769761:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb46ea68a80 x1874663049335040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826236.769769:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049335040:0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.769937:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049334656:0@lo:400:kworker.0 00000100:00100000:1.0:1787826236.769981:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826236.770086:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049334400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826236.771748:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049334144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826236.774382:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049334656 00000100:00100000:2.0:1787826236.774396:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049334656 00000100:00100000:2.0:1787826236.774460:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7049 00000100:00100000:2.0:1787826236.774470:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049334656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826236.774562:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049334656:12345-0@lo:400:kworker.0 Request processed in 94us (4581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826236.774569:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7049 00000100:00100000:2.0:1787826236.774627:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049334656:0@lo:400:kworker.0 00000100:00080000:2.0:1787826236.787554:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826236.787564:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826236.787567:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1787826237.274424:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00080000:2.0:1787826237.274439:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975536 is committed 00010000:00010000:1.0:1787826237.276710:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826238.292719:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826238.298096:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049335168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826238.298195:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826238.298280:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049335168 00000100:00100000:0.0:1787826238.298290:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049335168 00000100:00100000:0.0:1787826238.298377:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5811 00000100:00100000:0.0:1787826238.298389:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049335168:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787826238.298418:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787826238.298425:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826238.298742:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049335168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 355us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826238.298750:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5811 00000100:00100000:1.0:1787826238.298760:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049335168:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826239.316443:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826240.249948:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826240.249990:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826240.250030:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826240.250062:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826240.250092:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042986368 00000100:00100000:3.0:1787826240.250101:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042986368 00000100:00100000:3.0:1787826240.250163:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:3.0:1787826240.250174:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663042986368:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826240.250242:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663042986368:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826240.250250:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:3.0:1787826240.250283:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042986496 00000100:00100000:3.0:1787826240.250287:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042986496 00000100:00100000:3.0:1787826240.250344:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042986624 00000100:00100000:3.0:1787826240.250348:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042986624 00000100:00100000:3.0:1787826240.250374:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 251 00000100:00100000:3.0:1787826240.250381:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042986496:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826240.250414:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042986496:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826240.250421:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 251 00000100:00100000:3.0:1787826240.250433:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 252 00000100:00100000:3.0:1787826240.250439:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042986624:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826240.250464:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042986624:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826240.250470:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 252 00000100:00080000:3.0:1787826240.250489:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826240.250494:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826240.250569:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042986880 00000100:00100000:0.0:1787826240.250574:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042986880 00000100:00100000:0.0:1787826240.250619:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7050 00000100:00100000:0.0:1787826240.250627:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042986880:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826240.250657:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042986880:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826240.250664:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7050 00000100:00080000:3.0:1787826240.251929:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826240.263424:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826240.263630:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042986752 00000100:00100000:3.0:1787826240.263643:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042986752 00000100:00100000:3.0:1787826240.263697:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22582 00000100:00100000:3.0:1787826240.263706:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2388:x1874663042986752:12345-192.168.203.47@tcp:8:kworker.0 00010000:00020000:3.0:1787826240.263731:0:43905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826240.263807:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2388:x1874663042986752:12345-192.168.203.47@tcp:8:kworker.0 Request processed in 101us (397us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826240.263814:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22582 00010000:00010000:1.0:1787826240.343718:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826240.345025:0:193926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00100000:1.0:1787826240.347992:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00010000:00010000:1.0:1787826241.365143:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826241.876669:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826241.876677:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826241.876680:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826241.876689:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8303 00000100:00080000:1.0:1787826241.876693:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826241.876700:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826241.876721:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476ca7480 x1874663049335808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826241.876750:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787826241.876753:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826241.876755:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826241.876758:0:179516:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8303 00000100:00080000:1.0:1787826241.876761:0:179516:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787826241.876764:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb343732000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826241.876775:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476ca6d80 x1874663049336320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826241.876822:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049335424:0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.876882:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826241.876929:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049336064:0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.876951:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826241.876976:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787826241.876982:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049335552:0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.877016:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826241.877035:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049336192:0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.877059:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826241.877093:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049335424 00000100:00100000:1.0:1787826241.877101:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049335424 00000100:00100000:1.0:1787826241.877164:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049336064 00000100:00100000:1.0:1787826241.877167:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049336064 00000100:00100000:1.0:1787826241.877184:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049335552 00000100:00100000:1.0:1787826241.877187:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049335552 00000100:00100000:1.0:1787826241.877205:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787826241.877212:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049335424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.877415:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049335296:0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.877451:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.877475:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049335936:0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.877498:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.877515:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049336576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.877535:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.877547:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826241.877552:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049335680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.877572:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.877590:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049336448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.877615:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.877641:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049335808:0@lo:8:kworker.0 00000100:00100000:3.0:1787826241.877663:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.877680:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049336320:0@lo:8:kworker.0 00000100:00100000:3.0:1787826241.877700:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.877728:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049335296 00000100:00100000:3.0:1787826241.877732:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049335296 00000100:00100000:3.0:1787826241.877766:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787826241.877773:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3618:x1874663049335296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.877818:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3618:x1874663049335296:12345-0@lo:400:kworker.0 Request processed in 45us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.877825:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787826241.877857:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049335936 00000100:00100000:3.0:1787826241.877860:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049335936 00000100:00100000:3.0:1787826241.877885:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049336448 00000100:00100000:3.0:1787826241.877888:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049336448 00000100:00100000:3.0:1787826241.877905:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049335808 00000100:00100000:3.0:1787826241.877907:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049335808 00000100:00100000:3.0:1787826241.877919:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049336320 00000100:00100000:3.0:1787826241.877921:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049336320 00000100:00100000:3.0:1787826241.877934:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7051 00000100:00100000:3.0:1787826241.877940:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049335936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.877973:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049335936:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.877979:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7051 00000100:00100000:3.0:1787826241.877991:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7052 00000100:00100000:3.0:1787826241.878012:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049336448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.878042:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049336448:12345-0@lo:400:kworker.0 Request processed in 45us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.878048:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7052 00000100:00100000:3.0:1787826241.878058:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22583 00000100:00100000:3.0:1787826241.878062:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1874663049335808:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787826241.878080:0:43900:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826241.878111:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1874663049335808:12345-0@lo:8:kworker.0 Request processed in 47us (448us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826241.878117:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22583 00000100:00100000:3.0:1787826241.878148:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22584 00000100:00100000:3.0:1787826241.878152:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1874663049336320:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787826241.878162:0:43900:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826241.878186:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1874663049336320:12345-0@lo:8:kworker.0 Request processed in 33us (485us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826241.878192:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22584 00000100:00100000:3.0:1787826241.878213:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049336192 00000100:00100000:3.0:1787826241.878394:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049336192 00000100:00100000:3.0:1787826241.878421:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049335680 00000100:00100000:3.0:1787826241.878424:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049335680 00000100:00100000:3.0:1787826241.878439:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12710 00000100:00100000:3.0:1787826241.878444:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049336192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.878486:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049336192:12345-0@lo:400:kworker.0 Request processed in 41us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.878492:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12710 00000100:00100000:3.0:1787826241.878503:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12711 00000100:00100000:3.0:1787826241.878509:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049335680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.878535:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049335680:12345-0@lo:400:kworker.0 Request processed in 27us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.878540:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12711 00000100:00080000:3.0:1787826241.878622:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826241.878627:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826241.878630:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049335808:0@lo:8:kworker.0 00000100:00080000:3.0:1787826241.878640:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826241.878644:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826241.878647:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049336320:0@lo:8:kworker.0 00000100:00100000:3.0:1787826241.878684:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049335680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.878694:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975536 gen 2 00000100:00100000:3.0:1787826241.878704:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049336448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.878714:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049335296:0@lo:400:kworker.0 00000100:00100000:3.0:1787826241.878724:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049335936:0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.878895:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049335424:12345-0@lo:400:kworker.0 Request processed in 1682us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826241.878903:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787826241.878919:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049336576 00000100:00100000:1.0:1787826241.878923:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049336576 00000100:00100000:1.0:1787826241.878941:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787826241.878947:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049336064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.878977:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049336064:12345-0@lo:400:kworker.0 Request processed in 30us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826241.878983:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787826241.878995:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787826241.879102:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049335552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.879145:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049335552:12345-0@lo:400:kworker.0 Request processed in 46us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826241.879151:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787826241.879165:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787826241.879171:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049336576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.879202:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049336576:12345-0@lo:400:kworker.0 Request processed in 31us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826241.879208:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1787826241.879247:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826241.879252:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826241.879254:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826241.879281:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049335552:0@lo:400:kworker.0 00000100:00100000:1.0:1787826241.879292:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049336192:0@lo:400:kworker.0 00010000:00080000:1.0:1787826241.879305:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb44f744380 x1874663049335424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826241.879315:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049335424:0@lo:400:kworker.0 00010000:00080000:1.0:1787826241.879348:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb476ca4e00 x1874663049336064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826241.879356:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049336064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826241.879707:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826241.879719:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049336704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826241.879755:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.879978:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049336704 00000100:00100000:3.0:1787826241.879984:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049336704 00000100:00100000:3.0:1787826241.880027:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12712 00000100:00100000:3.0:1787826241.880036:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049336704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826241.880060:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445617664 avail 1299378176 00000100:00100000:3.0:1787826241.880104:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049336704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.880110:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12712 00000100:00100000:3.0:1787826241.880153:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049336704:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787826241.880181:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb476ca4a80 x1874663049336576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826241.880190:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049336576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826241.880752:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826241.880763:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049336832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826241.880797:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826241.880957:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049336832 00000100:00100000:1.0:1787826241.880963:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049336832 00000100:00100000:1.0:1787826241.881006:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5812 00000100:00100000:1.0:1787826241.881014:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049336832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826241.881035:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826241.881957:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049336832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 941us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826241.881966:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5812 00000100:00100000:3.0:1787826241.882138:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049336832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826241.885835:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826241.885859:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049336960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826241.885924:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.886018:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049336960 00000100:00100000:3.0:1787826241.886027:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049336960 00000100:00100000:3.0:1787826241.886080:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12713 00000100:00100000:3.0:1787826241.886090:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049336960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826241.886130:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446047744 avail 1299808256 00000100:00100000:3.0:1787826241.886213:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049336960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.886230:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12713 00000100:00100000:2.0:1787826241.895176:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049336960:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1787826242.155912:0:194609:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787826242.155917:0:194609:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787826242.155918:0:194609:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787826242.156381:0:194609:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8eb44908e800 00000020:01000004:1.0:1787826242.156397:0:194609:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787826242.156412:0:194609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787826242.156424:0:194609:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8eb481d999b8) 00000020:00000080:1.0:1787826242.156443:0:194609:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787826242.235654:0:194609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787826242.242508:0:194609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787826242.243026:0:194609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787826242.243677:0:194609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787826242.244233:0:194609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787826242.244617:0:194609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787826242.244874:0:194609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1787826242.245802:0:194609:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787826242.246161:0:194609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787826242.246174:0:194609:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787826242.246186:0:194609:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x878a5eea00ced709 00000020:01000004:3.0:1787826242.246192:0:194609:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787826242.246214:0:194609:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787826242.246218:0:194609:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787826242.246223:0:194609:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787826242.246250:0:194609:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787826242.246254:0:194609:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787826242.270420:0:194609:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787826242.270460:0:194609:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787826242.270464:0:194609:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787826242.270466:0:194609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826242.270467:0:194609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826242.270468:0:194609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826242.270470:0:194609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826242.270471:0:194609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826242.270473:0:194609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826242.270474:0:194609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826242.270476:0:194609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826242.270479:0:194609:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787826242.270482:0:194609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826242.270483:0:194609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826242.270484:0:194609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826242.270485:0:194609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826242.270486:0:194609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826242.270487:0:194609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826242.270488:0:194609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826242.270490:0:194609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826242.270492:0:194609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826242.270519:0:194609:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787826242.270610:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787826242.270679:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826242.270790:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4624da600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826242.271730:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049337088 00000100:00100000:3.0:1787826242.271848:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049337088 00000100:00100000:2.0:1787826242.272035:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787826242.272046:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:194609:x1874663049337088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826242.272079:0:193933:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787826242.272082:0:193933:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787826242.272086:0:193933:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787826242.272422:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:194609:x1874663049337088:12345-0@lo:253:mount.lustre.0 Request processed in 378us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826242.272430:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787826242.272539:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787826242.272552:0:194609:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787826242.272555:0:194609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826242.272557:0:194609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826242.272558:0:194609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826242.272559:0:194609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826242.272560:0:194609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826242.272562:0:194609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826242.272563:0:194609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826242.272564:0:194609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826242.272566:0:194609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787826242.272584:0:194609:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb44908e800 from lustre-OST0000 10000000:01000000:1.0:1787826242.272610:0:194609:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787826242.272612:0:194609:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787826242.272621:0:194609:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8eb46a873370 local copy 00010000:00010000:1.0:1787826242.272630:0:194609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826242.272722:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826242.272755:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826242.273047:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049337216 00000100:00100000:3.0:1787826242.273052:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049337216 00000100:00100000:1.0:1787826242.273069:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826242.273163:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787826242.273172:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:194609:x1874663049337216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826242.273316:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826242.273343:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:194609:x1874663049337216:12345-0@lo:501:mount.lustre.0 Request processed in 152us (567us total) trans 0 rc -2/-2 10000000:01000000:1.0:1787826242.273346:0:194609:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1787826242.273352:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 10000000:01000000:1.0:1787826242.273363:0:194609:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787826242.273369:0:194609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826242.273380:0:194609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826242.273407:0:194609:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8eb44908e800 10000000:01000000:1.0:1787826242.273412:0:194609:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787826242.273417:0:194609:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787826242.273419:0:194609:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826242.273423:0:194609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787826242.273426:0:194609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787826242.273447:0:194609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826242.273455:0:194609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826242.273463:0:194609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826242.273474:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826242.273496:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.273596:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049337344 00000100:00100000:0.0:1787826242.273601:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049337344 00000100:00100000:0.0:1787826242.273633:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787826242.273641:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:194609:x1874663049337344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826242.273649:0:193931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826242.273661:0:193931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a568000/0x878a5eea00ced717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced710 expref: -99 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826242.273680:0:193931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a568000/0x878a5eea00ced717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced710 expref: 22 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826242.273689:0:193931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a568000/0x878a5eea00ced717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced710 expref: 22 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826242.273697:0:193931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568000, rc 0) 00000100:00100000:0.0:1787826242.273723:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337344:12345-0@lo:101:mount.lustre.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.273728:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787826242.273815:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b53600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826242.273832:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826242.273843:0:194609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced717 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826242.273851:0:194609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced717 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826242.274932:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 14 count 14 00000040:00080000:1.0:1787826242.275806:0:194609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826242.279813:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].1, 224 off8416 00000040:00080000:1.0:1787826242.279882:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].2, 128 off8544 00000040:00080000:1.0:1787826242.279897:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].3, 112 off8656 00000040:00080000:1.0:1787826242.279908:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].4, 224 off8880 00000040:00080000:1.0:1787826242.279927:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].5, 224 off9104 00000040:00080000:1.0:1787826242.279939:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].6, 80 off9184 00000040:00080000:1.0:1787826242.279951:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].7, 224 off9408 00000040:00080000:1.0:1787826242.279963:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].8, 224 off9632 00000040:00080000:1.0:1787826242.279974:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].9, 80 off9712 00000040:00080000:1.0:1787826242.279985:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].10, 224 off9936 00000040:00080000:1.0:1787826242.279997:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].11, 224 off10160 00000040:00080000:1.0:1787826242.280009:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].12, 120 off10280 00000040:00080000:1.0:1787826242.280030:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].13, 224 off10504 00000040:00080000:1.0:1787826242.280035:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 13 count 14 00000100:00100000:1.0:1787826242.280438:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826242.280503:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826242.280588:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826242.280634:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049337472 00000100:00100000:3.0:1787826242.280642:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049337472 00000100:00100000:3.0:1787826242.280694:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787826242.280706:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826242.280900:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337472:12345-0@lo:501:mount.lustre.0 Request processed in 197us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.280908:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787826242.280977:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826242.281012:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826242.281060:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826242.281089:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb479b539c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826242.281784:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049337600 00000100:00100000:0.0:1787826242.281790:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049337600 00000100:00100000:0.0:1787826242.281842:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787826242.281851:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826242.283491:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337600:12345-0@lo:503:mount.lustre.0 Request processed in 1633us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.283504:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787826242.283630:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787826242.284107:0:194609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826242.284938:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826242.285009:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826242.285052:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826242.285079:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049337728 00000100:00100000:3.0:1787826242.285086:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049337728 00000100:00100000:3.0:1787826242.285148:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787826242.285157:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826242.285702:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337728:12345-0@lo:502:mount.lustre.0 Request processed in 545us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.285711:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787826242.286290:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826242.286502:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].1, 224 off8416 00000040:00080000:1.0:1787826242.286531:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].2, 128 off8544 00000040:00080000:1.0:1787826242.286544:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].3, 112 off8656 00000040:00080000:1.0:1787826242.286555:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].4, 224 off8880 00000040:00080000:1.0:1787826242.286566:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].5, 224 off9104 00000040:00080000:1.0:1787826242.286576:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].6, 80 off9184 00000040:00080000:1.0:1787826242.286587:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].7, 224 off9408 00000040:00080000:1.0:1787826242.286598:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].8, 224 off9632 00000040:00080000:1.0:1787826242.286609:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].9, 80 off9712 00000040:00080000:1.0:1787826242.286619:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].10, 224 off9936 00000040:00080000:1.0:1787826242.286629:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].11, 224 off10160 00000040:00080000:1.0:1787826242.286640:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].12, 120 off10280 00000100:00100000:1.0:1787826242.286664:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826242.286707:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826242.286738:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826242.287200:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049337856 00000100:00100000:0.0:1787826242.287208:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049337856 00000100:00100000:0.0:1787826242.287256:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787826242.287264:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.287504:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337856:12345-0@lo:502:mount.lustre.0 Request processed in 240us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.287512:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826242.288667:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826242.288848:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].13, 224 off10504 00000040:00080000:2.0:1787826242.288863:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787826242.292225:0:194613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826242.292239:0:194613:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787826242.292246:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826242.292248:0:194613:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787826242.292255:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826242.292272:0:194613:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8eb481d98000) 00000020:00000080:1.0:1787826242.292300:0:194613:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787826242.292307:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826242.292509:0:194613:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb44908e800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787826242.292517:0:194613:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826242.292580:0:194613:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x878a5eea00ced725 00010000:00010000:1.0:1787826242.297191:0:194613:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1787826242.298040:0:194613:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 34359738466 srv lr: 34359738466 lx: 1874663049309056 gen 0 00000001:00080000:1.0:1787826242.298077:0:194613:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 34359738459 srv lr: 34359738466 lx: 1874663048752384 gen 0 00000001:00000004:1.0:1787826242.298104:0:194613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 34359738466 00080000:10000000:1.0:1787826242.299954:0:194613:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x11:0x0] (8/32) registered 00000020:00000080:1.0:1787826242.302320:0:194613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787826242.302390:0:194613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826242.302643:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826242.302647:0:194613:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787826242.302654:0:194613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787826242.302657:0:194613:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787826242.302659:0:194613:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826242.302660:0:194613:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826242.302662:0:194613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787826242.302665:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826242.302666:0:194613:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787826242.302669:0:194613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826242.302672:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826242.302673:0:194613:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787826242.302676:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787826242.302678:0:194613:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787826242.302680:0:194613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826242.302682:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826242.302683:0:194613:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787826242.302686:0:194613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826242.302688:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826242.302689:0:194613:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787826242.302693:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787826242.302721:0:194613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826242.302725:0:194613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826242.302726:0:194613:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787826242.302730:0:194613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x30:0x0] index 14 count 14 00000020:01000000:2.0:1787826242.302961:0:194609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787826242.302991:0:194609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787826242.303011:0:194609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced717 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.303023:0:194609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced717 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826242.303031:0:194609:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb44908e800 from 1 10000000:01000000:2.0:1787826242.303034:0:194609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787826242.303064:0:194609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.303072:0:194609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.303083:0:194609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826242.303104:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826242.303178:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826242.303217:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826242.303285:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049337984 00000100:00100000:0.0:1787826242.303293:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049337984 00000100:00100000:0.0:1787826242.303366:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787826242.303376:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:194609:x1874663049337984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826242.303388:0:193937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826242.303400:0:193937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a569800/0x878a5eea00ced741 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced73a expref: -99 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826242.303434:0:193937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a569800/0x878a5eea00ced741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced73a expref: 23 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826242.303445:0:193937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a569800/0x878a5eea00ced741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced73a expref: 23 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826242.303454:0:193937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569800, rc 0) 00000100:00100000:0.0:1787826242.303493:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049337984:12345-0@lo:101:mount.lustre.0 Request processed in 120us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.303500:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787826242.303555:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049337984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826242.303569:0:194609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced741 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826242.303584:0:194609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced741 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826242.304942:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 7 count 7 00000040:00080000:0.0:1787826242.305985:0:194609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826242.306693:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].1, 224 off8416 00000040:00080000:0.0:1787826242.306726:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].2, 112 off8528 00000040:00080000:0.0:1787826242.306754:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].3, 224 off8752 00000040:00080000:0.0:1787826242.306770:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].4, 224 off8976 00000040:00080000:0.0:1787826242.306783:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].5, 112 off9088 00000040:00080000:0.0:1787826242.306803:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].6, 224 off9312 00000040:00080000:0.0:1787826242.306809:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 6 count 7 00000100:00100000:0.0:1787826242.308379:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826242.308453:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.308491:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3497f7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826242.308836:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049338112 00000100:00100000:1.0:1787826242.308843:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049338112 00000100:00100000:1.0:1787826242.308900:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787826242.308910:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826242.309084:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338112:12345-0@lo:501:mount.lustre.0 Request processed in 175us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826242.309091:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787826242.309436:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826242.309467:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826242.309504:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.309532:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3497f7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826242.309812:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049338240 00000100:00100000:1.0:1787826242.309816:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049338240 00000100:00100000:1.0:1787826242.309853:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787826242.309861:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826242.309962:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338240:12345-0@lo:503:mount.lustre.0 Request processed in 101us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826242.309969:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787826242.310136:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338240:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826242.310756:0:194609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826242.310825:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.310870:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.310894:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499ab780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826242.311037:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049338368 00000100:00100000:1.0:1787826242.311043:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049338368 00000100:00100000:1.0:1787826242.311075:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787826242.311084:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826242.311190:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338368:12345-0@lo:502:mount.lustre.0 Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826242.311197:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787826242.311350:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826242.311730:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].1, 224 off8416 00000040:00080000:0.0:1787826242.311826:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].2, 112 off8528 00000040:00080000:0.0:1787826242.311839:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].3, 224 off8752 00000040:00080000:0.0:1787826242.311853:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].4, 224 off8976 00000040:00080000:0.0:1787826242.311865:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].5, 112 off9088 00000100:00100000:0.0:1787826242.311888:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.311929:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.311956:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826242.311972:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049338496 00000100:00100000:0.0:1787826242.311976:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049338496 00000100:00100000:0.0:1787826242.312007:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787826242.312014:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.312152:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338496:12345-0@lo:502:mount.lustre.0 Request processed in 138us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.312159:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787826242.312809:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826242.312874:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].6, 224 off9312 00000040:00080000:2.0:1787826242.312884:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1787826242.313738:0:194617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826242.313815:0:194617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826242.313818:0:194617:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787826242.313826:0:194617:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb44908e800 00000020:00000080:0.0:1787826242.313829:0:194617:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787826242.313837:0:194617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826242.313839:0:194617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826242.313841:0:194617:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787826242.313844:0:194617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826242.313846:0:194617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826242.313847:0:194617:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787826242.313851:0:194617:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb44908e800 00000020:00000080:0.0:1787826242.313853:0:194617:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787826242.313943:0:194617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826242.313947:0:194617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826242.313949:0:194617:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787826242.313952:0:194617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x32:0x0] index 7 count 7 00000020:01000000:2.0:1787826242.314028:0:194609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787826242.314078:0:194609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826242.314096:0:194609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced741 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.314108:0:194609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced741 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826242.314182:0:194609:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787826242.314185:0:194609:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8eb44908e800 10000000:01000000:2.0:1787826242.314188:0:194609:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8eb44908e800 10000000:01000000:2.0:1787826242.314192:0:194609:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826242.314198:0:194609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb44908e800 from 1 10000000:01000000:2.0:1787826242.314201:0:194609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826242.314238:0:194609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.314246:0:194609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.314256:0:194609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826242.314275:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826242.314357:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826242.314393:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826242.314428:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049338624 00000100:00100000:2.0:1787826242.314435:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049338624 00000100:00100000:2.0:1787826242.314472:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787826242.314481:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:194609:x1874663049338624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826242.314493:0:193931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826242.314505:0:193931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481715800/0x878a5eea00ced74f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced748 expref: -99 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.314544:0:193931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481715800/0x878a5eea00ced74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced748 expref: 24 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.314553:0:193931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481715800/0x878a5eea00ced74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced748 expref: 24 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.314561:0:193931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715800, rc 0) 00000100:00100000:2.0:1787826242.314596:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049338624:12345-0@lo:101:mount.lustre.0 Request processed in 116us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826242.314603:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787826242.314644:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826242.314657:0:194609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced74f expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826242.314665:0:194609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced74f expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826242.316318:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 52 count 51 00000040:00080000:2.0:1787826242.316790:0:194609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826242.316982:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].1, 224 off8416 00000040:00080000:2.0:1787826242.317007:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].2, 120 off8536 00000040:00080000:2.0:1787826242.317019:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].3, 168 off8704 00000040:00080000:2.0:1787826242.317031:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].4, 224 off8928 00000040:00080000:2.0:1787826242.317043:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].5, 224 off9152 00000040:00080000:2.0:1787826242.317056:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].6, 120 off9272 00000040:00080000:2.0:1787826242.317068:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].7, 168 off9440 00000040:00080000:2.0:1787826242.317081:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].8, 224 off9664 00000040:00080000:2.0:1787826242.317094:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].9, 224 off9888 00000040:00080000:2.0:1787826242.317108:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].10, 120 off10008 00000040:00080000:2.0:1787826242.317135:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].11, 224 off10232 00000040:00080000:2.0:1787826242.317150:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].12, 224 off10456 00000040:00080000:2.0:1787826242.317162:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].13, 88 off10544 00000040:00080000:2.0:1787826242.317306:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].14, 128 off10672 00000040:00080000:2.0:1787826242.317346:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].15, 144 off10816 00000040:00080000:2.0:1787826242.317365:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].16, 160 off10976 00000040:00080000:2.0:1787826242.317378:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].17, 224 off11200 00000040:00080000:2.0:1787826242.317391:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].18, 224 off11424 00000040:00080000:2.0:1787826242.317403:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].19, 80 off11504 00000040:00080000:2.0:1787826242.317652:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].20, 224 off11728 00000040:00080000:2.0:1787826242.317670:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].21, 224 off11952 00000040:00080000:2.0:1787826242.317681:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].22, 88 off12040 00000040:00080000:2.0:1787826242.317692:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].23, 128 off12168 00000040:00080000:2.0:1787826242.317704:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].24, 144 off12312 00000040:00080000:2.0:1787826242.317715:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].25, 160 off12472 00000040:00080000:2.0:1787826242.317726:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].26, 224 off12696 00000040:00080000:2.0:1787826242.317791:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].27, 224 off12920 00000040:00080000:2.0:1787826242.317808:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].28, 80 off13000 00000040:00080000:2.0:1787826242.317819:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].29, 224 off13224 00000040:00080000:2.0:1787826242.317830:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].30, 224 off13448 00000040:00080000:2.0:1787826242.317841:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].31, 88 off13536 00000040:00080000:2.0:1787826242.317851:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].32, 128 off13664 00000040:00080000:2.0:1787826242.317861:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].33, 144 off13808 00000040:00080000:2.0:1787826242.317872:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].34, 128 off13936 00000040:00080000:2.0:1787826242.317883:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].35, 224 off14160 00000040:00080000:2.0:1787826242.317893:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].36, 224 off14384 00000040:00080000:2.0:1787826242.317905:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].37, 80 off14464 00000040:00080000:2.0:1787826242.317916:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].38, 224 off14688 00000040:00080000:2.0:1787826242.317927:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].39, 224 off14912 00000040:00080000:2.0:1787826242.317938:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].40, 88 off15000 00000040:00080000:2.0:1787826242.317949:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].41, 128 off15128 00000040:00080000:2.0:1787826242.317959:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].42, 144 off15272 00000040:00080000:2.0:1787826242.317970:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].43, 128 off15400 00000040:00080000:2.0:1787826242.317981:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].44, 224 off15624 00000040:00080000:2.0:1787826242.317991:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].45, 224 off15848 00000040:00080000:2.0:1787826242.318002:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].46, 80 off15928 00000040:00080000:2.0:1787826242.318012:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].47, 224 off16152 00000040:00080000:2.0:1787826242.318023:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].48, 232 off16384 00000040:00080000:2.0:1787826242.318158:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].49, 224 off16608 00000040:00080000:2.0:1787826242.318246:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].50, 120 off16728 00000040:00080000:2.0:1787826242.318264:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].51, 224 off16952 00000040:00080000:2.0:1787826242.318269:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 51 count 51 00000100:00100000:2.0:1787826242.318383:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826242.318568:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826242.318609:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34896b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826242.318986:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049338752 00000100:00100000:0.0:1787826242.318995:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049338752 00000100:00100000:0.0:1787826242.319074:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826242.319084:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049338752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826242.319230:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049338752:12345-0@lo:501:mount.lustre.0 Request processed in 147us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.319238:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826242.319411:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826242.319603:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826242.319643:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.319704:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826242.319811:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049338880 00000100:00100000:2.0:1787826242.319816:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049338880 00000100:00100000:2.0:1787826242.319880:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787826242.319887:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049338880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826242.319974:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049338880:12345-0@lo:503:mount.lustre.0 Request processed in 87us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826242.319981:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787826242.320039:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049338880:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826242.320665:0:194609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826242.320737:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049339008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.320788:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.320819:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049339008 00000100:00100000:0.0:1787826242.320824:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049339008 00000100:00100000:0.0:1787826242.320853:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787826242.320861:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049339008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.320944:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049339008:12345-0@lo:502:mount.lustre.0 Request processed in 83us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.320951:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787826242.321000:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826242.321013:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049339008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826242.321259:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].1, 224 off8416 00000040:00080000:0.0:1787826242.321284:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].2, 120 off8536 00000040:00080000:0.0:1787826242.321296:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].3, 168 off8704 00000040:00080000:0.0:1787826242.321309:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].4, 224 off8928 00000040:00080000:0.0:1787826242.321344:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].5, 224 off9152 00000040:00080000:0.0:1787826242.321363:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].6, 120 off9272 00000040:00080000:0.0:1787826242.321375:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].7, 168 off9440 00000040:00080000:0.0:1787826242.321387:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].8, 224 off9664 00000040:00080000:0.0:1787826242.321399:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].9, 224 off9888 00000040:00080000:0.0:1787826242.321410:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].10, 120 off10008 00000040:00080000:0.0:1787826242.321509:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].11, 224 off10232 00000040:00080000:0.0:1787826242.321605:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].12, 224 off10456 00000040:00080000:0.0:1787826242.321625:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].13, 88 off10544 00000040:00080000:0.0:1787826242.321638:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].14, 128 off10672 00000040:00080000:0.0:1787826242.321650:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].15, 144 off10816 00000040:00080000:0.0:1787826242.321663:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].16, 160 off10976 00000040:00080000:0.0:1787826242.321677:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].17, 224 off11200 00000040:00080000:0.0:1787826242.321689:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].18, 224 off11424 00000040:00080000:0.0:1787826242.321700:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].19, 80 off11504 00000040:00080000:0.0:1787826242.321712:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].20, 224 off11728 00000040:00080000:0.0:1787826242.321724:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].21, 224 off11952 00000040:00080000:0.0:1787826242.321738:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].22, 88 off12040 00000040:00080000:0.0:1787826242.321752:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].23, 128 off12168 00000040:00080000:0.0:1787826242.321765:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].24, 144 off12312 00000040:00080000:0.0:1787826242.321779:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].25, 160 off12472 00000040:00080000:0.0:1787826242.321793:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].26, 224 off12696 00000040:00080000:0.0:1787826242.321805:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].27, 224 off12920 00000040:00080000:0.0:1787826242.321816:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].28, 80 off13000 00000040:00080000:0.0:1787826242.321828:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].29, 224 off13224 00000040:00080000:0.0:1787826242.321841:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].30, 224 off13448 00000040:00080000:0.0:1787826242.321853:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].31, 88 off13536 00000040:00080000:0.0:1787826242.321866:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].32, 128 off13664 00000040:00080000:0.0:1787826242.321880:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].33, 144 off13808 00000040:00080000:0.0:1787826242.321892:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].34, 128 off13936 00000040:00080000:0.0:1787826242.321905:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].35, 224 off14160 00000040:00080000:0.0:1787826242.321918:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].36, 224 off14384 00000040:00080000:0.0:1787826242.321933:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].37, 80 off14464 00000040:00080000:0.0:1787826242.321946:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].38, 224 off14688 00000040:00080000:0.0:1787826242.321959:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].39, 224 off14912 00000040:00080000:0.0:1787826242.321973:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].40, 88 off15000 00000040:00080000:0.0:1787826242.321988:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].41, 128 off15128 00000040:00080000:0.0:1787826242.322004:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].42, 144 off15272 00000040:00080000:0.0:1787826242.322017:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].43, 128 off15400 00000040:00080000:0.0:1787826242.322030:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].44, 224 off15624 00000040:00080000:0.0:1787826242.322046:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].45, 224 off15848 00000040:00080000:0.0:1787826242.322060:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].46, 80 off15928 00000040:00080000:0.0:1787826242.322075:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].47, 224 off16152 00000040:00080000:0.0:1787826242.322091:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].48, 232 off16384 00000100:00100000:0.0:1787826242.322148:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049339136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.322630:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.322707:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826242.322809:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049339136 00000100:00100000:2.0:1787826242.322817:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049339136 00000100:00100000:2.0:1787826242.322900:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826242.322910:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049339136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826242.323026:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049339136:12345-0@lo:502:mount.lustre.0 Request processed in 117us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826242.323035:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787826242.323814:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049339136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826242.324009:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].49, 224 off16608 00000040:00080000:0.0:1787826242.324035:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].50, 120 off16728 00000100:00100000:0.0:1787826242.324065:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049339264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.324113:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.324159:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049339264 00000100:00100000:0.0:1787826242.324165:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049339264 00000100:00100000:0.0:1787826242.324358:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787826242.324367:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049339264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826242.324472:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049339264:12345-0@lo:502:mount.lustre.0 Request processed in 106us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.324480:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787826242.324533:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826242.324547:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049339264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826242.324582:0:194609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].51, 224 off16952 00000040:00080000:0.0:1787826242.324589:0:194609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787826242.325903:0:194619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787826242.325919:0:194619:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8eb341a6b370) 00000020:00000080:2.0:1787826242.325944:0:194619:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787826242.326016:0:194619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb44908e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826242.326020:0:194619:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb44908e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826242.326022:0:194619:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb44908e800 3 00010000:00080000:2.0:1787826242.326048:0:194619:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb47f9a5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1787826242.329716:0:194619:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:2.0:1787826242.329990:0:194619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826242.330033:0:194619:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826242.330044:0:194619:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x878a5eea00ced75d 00000100:00080000:2.0:1787826242.330054:0:194619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826242.330060:0:194619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826242.330095:0:194619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f64000 x1874663049339392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826242.330113:0:194619:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787826242.330170:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049339392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826242.330241:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826242.330294:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049339392 00000100:00100000:2.0:1787826242.330302:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049339392 00000100:00100000:2.0:1787826242.330349:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00080000:3.0:1787826242.330353:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1787826242.330356:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049339392:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787826242.330358:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826242.330360:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826242.330364:0:185677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8308 00000100:00080000:3.0:1787826242.330368:0:185677:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826242.330372:0:185677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00010000:00080000:2.0:1787826242.330376:0:187905:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 8309 last 0 00000100:00100000:3.0:1787826242.330384:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477dd5500 x1874663049339904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1787826242.330405:0:187905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x878a5eea00ced764 00000100:00080000:3.0:1787826242.330410:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787826242.330412:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787826242.330415:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826242.330418:0:185677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8308 00000100:00080000:3.0:1787826242.330420:0:185677:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826242.330423:0:185677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb343732000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826242.330434:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f5f2a00 x1874663049340416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826242.330465:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049339520:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.330491:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:2.0:1787826242.330492:0:187905:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787826242.330510:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049340160:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.330530:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826242.330550:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826242.330555:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049340032:0@lo:400:kworker.0 00000100:00080000:2.0:1787826242.330594:0:187905:0:(import.c:65:import_set_state_nolock()) ffff8eb44908e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826242.330640:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874663049339392:12345-0@lo:38:llog_process_th.0 Request processed in 283us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826242.330647:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1787826242.330661:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049339520 00000100:00100000:2.0:1787826242.330664:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049339520 00000100:00100000:2.0:1787826242.330691:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049340160 00000100:00100000:2.0:1787826242.330694:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049340160 00000100:00100000:2.0:1787826242.330706:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787826242.330711:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049339520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826242.330817:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049339520:12345-0@lo:400:kworker.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826242.330823:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787826242.330837:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787826242.330843:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049340160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826242.330870:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049340160:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826242.330876:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787826242.331219:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826242.331247:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049340672:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.331284:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826242.331346:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb46ea69880 x1874663049339520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826242.331365:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049339520:0@lo:400:kworker.0 00000020:01000004:2.0:1787826242.331373:0:194619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00010000:00080000:3.0:1787826242.331381:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb44f745500 x1874663049340160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1787826242.331387:0:194619:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8eb341a6cd28) 00000100:00100000:3.0:1787826242.331394:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049340160:0@lo:400:kworker.0 00000020:00000080:2.0:1787826242.331409:0:194619:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:3.0:1787826242.331428:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049339648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.331524:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826242.331545:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049340288:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.331574:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826242.331663:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787826242.331670:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049339776:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.331699:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1787826242.331708:0:194619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb44908e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826242.331714:0:194619:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb44908e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787826242.331717:0:194619:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb44908e800 3 00000100:00100000:3.0:1787826242.331722:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049340544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.331748:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826242.331781:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049339904:0@lo:8:kworker.0 00000100:00100000:3.0:1787826242.331805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.331823:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049340288 00000100:00100000:0.0:1787826242.331830:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049340288 00000100:00100000:0.0:1787826242.331861:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049339776 00000100:00100000:0.0:1787826242.331863:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049339776 00000100:00100000:0.0:1787826242.331880:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12714 00000100:00100000:0.0:1787826242.331888:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049340288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826242.331931:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049340288:12345-0@lo:400:kworker.0 Request processed in 44us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.331937:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12714 00000100:00100000:0.0:1787826242.331950:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12715 00000100:00100000:0.0:1787826242.331956:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049339776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826242.331982:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049339776:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.331988:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12715 00010000:00080000:2.0:1787826242.332032:0:194619:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb341a98800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.147@tcp at head 00000100:00100000:3.0:1787826242.332086:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049340416:0@lo:8:kworker.0 00000100:00100000:3.0:1787826242.332137:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826242.332169:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb477f64000 x1874663049339392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826242.332177:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826242.332185:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 81 00000100:00080000:3.0:1787826242.332193:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787826242.332198:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787826242.332201:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826242.332208:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049339392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826242.332233:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049340672 00000100:00100000:3.0:1787826242.332237:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049340672 00000100:00100000:3.0:1787826242.332266:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049339648 00000100:00100000:3.0:1787826242.332269:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049339648 00000100:00100000:3.0:1787826242.332289:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787826242.332296:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049340672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.332365:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049340672:12345-0@lo:400:kworker.0 Request processed in 69us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.332373:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787826242.332386:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787826242.332392:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049339648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.332420:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049339648:12345-0@lo:400:kworker.0 Request processed in 29us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.332425:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787826242.332516:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049340032 00000100:00100000:3.0:1787826242.332517:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049340544 00000100:00100000:3.0:1787826242.332523:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049340544 00000100:00100000:3.0:1787826242.332549:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049339904 00000100:00100000:3.0:1787826242.332553:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049339904 00000100:00100000:3.0:1787826242.332567:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049340416 00000100:00100000:3.0:1787826242.332570:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049340416 00000100:00100000:0.0:1787826242.332597:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049340032 00000100:00100000:0.0:1787826242.332630:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7053 00000100:00100000:0.0:1787826242.332637:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049340544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.332658:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7054 00000100:00100000:3.0:1787826242.332668:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049340032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826242.332676:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049340544:12345-0@lo:400:kworker.0 Request processed in 36us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.332683:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7053 00000100:00100000:0.0:1787826242.332700:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22585 00000100:00100000:0.0:1787826242.332706:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1874663049339904:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787826242.332713:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049340032:12345-0@lo:400:kworker.0 Request processed in 46us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.332721:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7054 00000100:00100000:3.0:1787826242.332737:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22586 00000100:00100000:3.0:1787826242.332742:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:0+-99:3616:x1874663049340416:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787826242.332785:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:0+-99:3616:x1874663049340416:12345-0@lo:8:kworker.0 Request processed in 41us (648us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787826242.332791:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22586 00000100:00100000:0.0:1787826242.333259:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1874663049339904:12345-0@lo:8:kworker.0 Request processed in 551us (1451us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787826242.333266:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22585 00000100:00100000:3.0:1787826242.333556:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049339776:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.333568:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049340544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.333579:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049339648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.333668:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049340288:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.333718:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049340032:0@lo:400:kworker.0 00010000:00080000:3.0:1787826242.333733:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8eb44f5f3b80 x1874663049340672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826242.333743:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049340672:0@lo:400:kworker.0 00000100:00080000:3.0:1787826242.333782:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826242.333787:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826242.333791:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049339904:0@lo:8:kworker.0 00000100:00100000:3.0:1787826242.333799:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826242.333802:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826242.333805:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826242.333809:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049340416:0@lo:8:kworker.0 00010000:00010000:2.0:1787826242.334909:0:194619:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:2.0:1787826242.335140:0:194619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787826242.335181:0:194619:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826242.335193:0:194619:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x878a5eea00ced772 00000100:00080000:2.0:1787826242.335201:0:194619:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826242.335206:0:194619:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8eb341a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826242.335237:0:194619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477f65880 x1874663049340800/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826242.335261:0:194619:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787826242.335429:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049340800:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787826242.335457:0:194619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x34:0x0] index 52 count 51 00000020:01000000:0.0:1787826242.335509:0:194609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:3.0:1787826242.335568:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787826242.335610:0:194609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787826242.335626:0:194609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced74f expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826242.335636:0:194609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced74f expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826242.335655:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049340800 00000100:00100000:2.0:1787826242.335661:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049340800 00000020:01000004:0.0:1787826242.335681:0:194609:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787826242.335683:0:194609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826242.335684:0:194609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826242.335686:0:194609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826242.335687:0:194609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826242.335688:0:194609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:2.0:1787826242.335689:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000020:01000004:0.0:1787826242.335690:0:194609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826242.335691:0:194609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826242.335693:0:194609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787826242.335695:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049340800:12345-0@lo:38:llog_process_th.0 10000000:01000000:0.0:1787826242.335696:0:194609:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787826242.335699:0:194609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826242.335700:0:194609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826242.335701:0:194609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826242.335702:0:194609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826242.335703:0:194609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826242.335704:0:194609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826242.335705:0:194609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826242.335706:0:194609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826242.335707:0:194609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:2.0:1787826242.335719:0:188992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 8309 last 0 10000000:01000000:0.0:1787826242.335720:0:194609:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787826242.335733:0:194609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049340928:0@lo:253:mount.lustre.0 00000020:00000080:2.0:1787826242.335754:0:188992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x878a5eea00ced779 00000004:00100000:2.0:1787826242.335769:0:188992:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826242.335800:0:188992:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826242.335839:0:194609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826242.335853:0:194609:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3499abb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826242.335854:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874663049340800:12345-0@lo:38:llog_process_th.0 Request processed in 157us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826242.335861:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1787826242.335871:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049340928 00000100:00100000:0.0:1787826242.335874:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049340928 00000100:00100000:0.0:1787826242.335902:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787826242.335909:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049340928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787826242.335930:0:193932:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787826242.335942:0:193932:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787826242.336025:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826242.336035:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 4 00000100:00080000:3.0:1787826242.336042:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787826242.336046:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787826242.336048:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826242.336055:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049340800:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787826242.342151:0:193932:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826242.342242:0:193932:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787826242.342455:0:193935:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826242.342460:0:193935:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826242.342487:0:193935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.342509:0:193935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced53b expref: 24 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.342517:0:193935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced557 expref: 24 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.342536:0:193935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 9 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.342543:0:193935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.342581:0:193935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 9 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.342597:0:193935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 9 pid: 193931 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.342612:0:193935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cdb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193935:1874663049341056:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826242.342700:0:193935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ced557 expref: 24 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.342709:0:193935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00ced557 expref: 24 pid: 193932 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.342719:0:193935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193935:1874663049341184:0@lo:104: 00000100:00100000:3.0:1787826242.342770:0:193935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826242.342803:0:193935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ced53b expref: 24 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.342812:0:193935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00ced53b expref: 24 pid: 193937 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.342821:0:193935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193935:1874663049341312:0@lo:104: 00000100:00100000:3.0:1787826242.342840:0:193935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826242.342856:0:193935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3490a56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826242.342964:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049341184 00000100:00100000:3.0:1787826242.342971:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049341184 00000100:00100000:3.0:1787826242.343017:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049341312 00000100:00100000:3.0:1787826242.343020:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049341312 00000100:00100000:3.0:1787826242.343035:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4770 00000100:00100000:3.0:1787826242.343043:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+4:193935:x1874663049341184:12345-0@lo:104: 00010000:00010000:3.0:1787826242.343055:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.343104:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826242.343110:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+4:193935:x1874663049341184:12345-0@lo:104: Request processed in 68us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.343129:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4770 00000100:00100000:3.0:1787826242.343148:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4771 00000100:00100000:3.0:1787826242.343155:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:193935:x1874663049341312:12345-0@lo:104: 00010000:00010000:3.0:1787826242.343162:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.346035:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787826242.346053:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:193935:x1874663049341312:12345-0@lo:104: Request processed in 2895us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.346068:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4771 00010000:00010000:3.0:1787826242.346105:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826242.346112:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.346133:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826242.346137:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.346147:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826242.346155:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826242.346160:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826242.347001:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.347011:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826242.347029:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.347036:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481715200/0x878a5eea00ced557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced55e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.347048:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826242.347052:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.347062:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826242.347066:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.347072:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826242.347078:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826242.347083:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787826242.347095:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.347101:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826242.347113:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.347131:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00ced53b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00ced542 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.347145:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826242.347147:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826242.347149:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826242.347656:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:194609:x1874663049340928:12345-0@lo:253:mount.lustre.0 Request processed in 11741us (11809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826242.347668:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787826242.347729:0:194609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:194609:1874663049340928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787826242.348726:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 10000000:01000000:0.0:1787826242.348989:0:194609:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787826242.348993:0:194609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826242.348995:0:194609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787826242.348996:0:194609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826242.348997:0:194609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826242.348998:0:194609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826242.348999:0:194609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826242.349001:0:194609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826242.349002:0:194609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826242.349003:0:194609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787826242.349016:0:194609:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787826242.349240:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042987008 00010000:00010000:3.0:1787826242.349245:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826242.349249:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042987008 00000100:00100000:3.0:1787826242.349274:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049341440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826242.349284:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 10 pid: 193931 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826242.349318:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12224 00000100:00100000:3.0:1787826242.349342:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826242.349357:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663042987008:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826242.349371:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826242.349378:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 10 pid: 193931 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826242.349393:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 10 pid: 193931 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826242.349413:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826242.349518:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663042987008:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 190us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826242.349527:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12224 00000100:00100000:1.0:1787826242.349547:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049341440 00000100:00100000:1.0:1787826242.349550:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049341440 00010000:00010000:1.0:1787826242.349565:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00ced557 expref: 24 pid: 193932 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826242.349649:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12225 00000100:00100000:1.0:1787826242.349658:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049341440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826242.349668:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826242.349673:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00ced557 expref: 24 pid: 193932 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826242.349683:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00ced557 expref: 24 pid: 193932 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826242.349694:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826242.349727:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049341440:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826242.349735:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12225 00000100:00100000:3.0:1787826242.350136:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049341568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826242.350167:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826242.350225:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049341568 00000100:00100000:3.0:1787826242.350229:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049341568 00010000:00010000:3.0:1787826242.350246:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00ced53b expref: 24 pid: 193937 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.350279:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12226 00000100:00100000:3.0:1787826242.350286:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049341568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826242.350294:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826242.350298:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00ced53b expref: 24 pid: 193937 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350308:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00ced53b expref: 24 pid: 193937 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350336:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350345:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826242.350357:0:8420:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007897902s 00010000:00010000:3.0:1787826242.350361:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350368:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350381:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350393:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350399:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fc00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826242.350403:0:8420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350411:0:8420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350928:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.350938:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826242.350990:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049341568:12345-0@lo:103:ldlm_bl.0 Request processed in 704us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.350997:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12226 00000100:00100000:3.0:1787826242.351042:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049341440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826242.351076:0:193935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714800/0x878a5eea00ced6df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f17f expref: 9 pid: 193931 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.351088:0:193935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cdb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193935:1874663049341056:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826242.351100:0:193935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce2600/0x878a5eea00ced55e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ced557 expref: 23 pid: 193932 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.351108:0:193935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193935:1874663049341184:0@lo:104: 00010000:00010000:3.0:1787826242.351129:0:193935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3600/0x878a5eea00ced542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ced53b expref: 22 pid: 193937 timeout: 8409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.351137:0:193935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193935:1874663049341312:0@lo:104: 00010000:00010000:3.0:1787826242.351154:0:193935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.351162:0:193935:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.351177:0:193935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.351184:0:193935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8fc00/0x878a5eea00ced780 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826242.351587:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049341568:0@lo:103:ldlm_bl.0 00010000:00080000:0.0:1787826242.360162:0:194609:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 34359738466 00010000:00080000:0.0:1787826242.361926:0:194626:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 194626 00010000:02000000:0.0:1787826242.361979:0:194626:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1787826242.361984:0:194626:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787826242.361987:0:194626:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1787826242.362084:0:194609:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787826242.362150:0:194609:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787826242.362230:0:194609:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787826242.362252:0:194609:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787826242.363308:0:194609:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826242.365267:0:194609:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787826242.392526:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826243.298526:0:194675:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826243.298730:0:194675:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787826243.412892:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826243.412917:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049341696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826243.412985:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826243.413030:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049341696 00000100:00100000:3.0:1787826243.413038:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049341696 00000100:00100000:3.0:1787826243.413088:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5813 00000100:00100000:3.0:1787826243.413098:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049341696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826243.413138:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826243.413182:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049341696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826243.413189:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5813 00000100:00100000:3.0:1787826243.413235:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049341696:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826243.413302:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826243.413309:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1787826243.604491:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826243.604503:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb477f6b800 from 335 10000000:01000000:3.0:1787826243.604510:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826243.604573:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826243.604588:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826243.604602:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826243.604631:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049341824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826243.604720:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826243.605053:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb472779900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826243.605164:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049341824 00000100:00100000:0.0:1787826243.605183:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049341824 00000100:00100000:0.0:1787826243.605262:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787826243.605274:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049341824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826243.605291:0:193931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826243.605312:0:193931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a568800/0x878a5eea00ced78e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced787 expref: -99 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826243.605372:0:193931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a568800/0x878a5eea00ced78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced787 expref: 23 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826243.605383:0:193931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a568800/0x878a5eea00ced78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced787 expref: 23 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826243.605390:0:193931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568800, rc 0) 00000100:00100000:0.0:1787826243.605466:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049341824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826243.605472:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787826243.605605:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049341824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826243.605629:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826243.605641:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826243.605726:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049341952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787826243.606956:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826243.607023:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f630e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826243.607527:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049341952 00000100:00100000:0.0:1787826243.607539:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049341952 00000100:00100000:0.0:1787826243.607614:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787826243.607627:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049341952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826243.607656:0:193937:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826243.607686:0:193937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826243.607689:0:193937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 335 00000100:00100000:0.0:1787826243.607818:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049341952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826243.607825:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787826243.608213:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049341952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787826243.608298:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826243.608309:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826243.608396:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826243.608411:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787826243.608414:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb34df96000 from 335 10000000:01000000:2.0:1787826243.608417:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826243.608458:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826243.608468:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826243.608478:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826243.608615:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049342080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826243.608666:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826243.608740:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f630e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826243.608991:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049342080 00000100:00100000:1.0:1787826243.608999:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049342080 00000100:00100000:1.0:1787826243.609050:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787826243.609059:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049342080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826243.609074:0:193933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826243.609091:0:193933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce2e00/0x878a5eea00ced79c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced795 expref: -99 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826243.609130:0:193933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce2e00/0x878a5eea00ced79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced795 expref: 24 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826243.609141:0:193933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce2e00/0x878a5eea00ced79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced795 expref: 24 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826243.609152:0:193933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2e00, rc 0) 00000100:00100000:1.0:1787826243.609280:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049342080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826243.609287:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787826243.609945:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049342080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826243.609967:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced79c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826243.609978:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced79c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826243.610043:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049342208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787826243.610088:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826243.610180:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f630e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826243.610287:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049342208 00000100:00100000:0.0:1787826243.610295:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049342208 00000100:00100000:0.0:1787826243.610364:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826243.610374:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049342208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826243.610395:0:193937:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826243.610417:0:193937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826243.610420:0:193937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 335 00000100:00100000:0.0:1787826243.610525:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049342208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826243.610533:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826243.610575:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049342208:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787826243.610666:0:6488:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8eb34c51d800 already not connected (conn 14, was 0): DISCONN 00010000:00080000:0.0:1787826243.610699:0:6488:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8eb34c51d800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.147@tcp, moved to head 00000100:00080000:0.0:1787826243.610705:0:6488:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826243.610712:0:6488:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb34c51d800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826243.610738:0:6488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb343e55c00 x1874663049342336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1787826243.610794:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826243.610803:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced79c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826243.610813:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced79c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826243.610838:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049342336:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1787826243.610871:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826243.610910:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049342336 00000100:00100000:0.0:1787826243.610916:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049342336 00000100:00100000:0.0:1787826243.610938:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22587 00000100:00100000:0.0:1787826243.610944:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:0+-99:3616:x1874663049342336:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787826243.610970:0:179222:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8eb349791800, cookie 0x878a5eea00ced733 00010000:00080000:0.0:1787826243.610975:0:179222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8eb349791800 cur 8310 last 1787826242 00010000:02000400:0.0:1787826243.610984:0:179222:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1787826243.610992:0:179222:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:0.0:1787826243.611010:0:179222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8eb349791800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787826243.611014:0:179222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787826243.611017:0:179222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1787826243.611200:0:179222:0:(import.c:65:import_set_state_nolock()) ffff8eb44905a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826243.611243:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3616:x1874663049342336:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 298us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826243.611250:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22587 00010000:00080000:0.0:1787826243.611288:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb343e55c00 x1874663049342336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826243.611304:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:0.0:1787826243.611314:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787826243.611319:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1787826243.611341:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 34359738459 gen 2 00000100:00080000:0.0:1787826243.611346:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff8eb34c51d800 from lustre-OST0000_UUID committed 34359738459 last 0 00000100:00080000:0.0:1787826243.611349:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1787826243.615989:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049342336:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787826243.616059:0:194694:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1787826243.616065:0:194694:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:0.0:1787826243.616073:0:194694:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:0.0:1787826243.616131:0:194694:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787826243.616190:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049342464:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787826243.616284:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826243.616936:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049342464 00000100:00100000:2.0:1787826243.616948:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049342464 00000100:00100000:2.0:1787826243.617017:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7055 00000100:00100000:2.0:1787826243.617029:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3616:x1874663049342464:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787826243.617052:0:179223:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb343e54380 x1874663049342464/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:599/0 lens 224/0 e 0 to 0 dl 1787826254 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826243.617071:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3616:x1874663049342464:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 45us (787us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826243.617078:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7055 00010000:00080000:0.0:1787826243.617626:0:194626:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1787826243.897811:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826243.897873:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042987136 00000100:00100000:0.0:1787826243.897884:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042987136 00000100:00100000:0.0:1787826243.897977:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 94 00000100:00100000:0.0:1787826243.897989:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159735:x1874663042987136:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826243.898006:0:193931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826243.898025:0:193931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a568200/0x878a5eea00ced7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1b7 expref: -99 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826243.898051:0:193931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a568200/0x878a5eea00ced7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1b7 expref: 10 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826243.898063:0:193931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a568200/0x878a5eea00ced7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1b7 expref: 10 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826243.898072:0:193931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568200, rc 0) 00000100:00100000:0.0:1787826243.898154:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663042987136:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 167us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826243.898162:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 94 00000100:00100000:1.0:1787826243.902997:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826243.903075:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042987264 00000100:00100000:2.0:1787826243.903087:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042987264 00000100:00100000:2.0:1787826243.903156:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:2.0:1787826243.903166:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663042987264:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826243.903192:0:193937:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787826243.903210:0:193937:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826243.903214:0:193937:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 335 00000100:00100000:2.0:1787826243.907315:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663042987264:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 Request processed in 4137us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826243.907349:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:2.0:1787826243.911952:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826243.912299:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042987392 00000100:00100000:0.0:1787826243.912309:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042987392 00000100:00100000:0.0:1787826243.912377:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22588 00000100:00100000:0.0:1787826243.912386:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2388:x1874663042987392:12345-192.168.203.47@tcp:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787826243.912426:0:43902:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp recovering/t0 exp 0000000000000000 cur 8310 last 0 00010000:02000400:0.0:1787826243.912433:0:43902:0:(ldlm_lib.c:1507:target_handle_connect()) lustre-OST0000: Denying connection for new client c0d7758a-4501-4a89-8ec1-407fef4f0c7f (at 192.168.203.47@tcp), waiting for 2 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 1:09 00000100:00100000:0.0:1787826243.931117:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2388:x1874663042987392:12345-192.168.203.47@tcp:8:ll_cfg_requeue.0 Request processed in 18708us (19151us total) trans 0 rc -16/-16 00000100:00100000:0.0:1787826243.931134:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22588 00010000:00010000:3.0:1787826244.445847:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826245.379318:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826245.379362:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826245.379398:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826245.379415:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826245.379436:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826245.379457:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042987520 00000100:00100000:1.0:1787826245.379465:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042987520 00000100:00100000:1.0:1787826245.379511:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:1.0:1787826245.379521:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663042987520:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826245.379581:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663042987520:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826245.379588:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:2.0:1787826245.379860:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042988032 00000100:00100000:2.0:1787826245.379865:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042988032 00000100:00100000:2.0:1787826245.379914:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042987904 00000100:00100000:2.0:1787826245.379917:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042987904 00000100:00100000:2.0:1787826245.379933:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7056 00000100:00100000:2.0:1787826245.379940:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042988032:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826245.379978:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042988032:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826245.379985:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7056 00000100:00100000:2.0:1787826245.379999:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22589 00000100:00100000:2.0:1787826245.380004:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1874663042987904:12345-192.168.203.47@tcp:8:kworker.0 00010000:00080000:2.0:1787826245.380027:0:12319:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp recovering/t0 exp 0000000000000000 cur 8312 last 0 00010000:02000400:2.0:1787826245.380046:0:12319:0:(ldlm_lib.c:1507:target_handle_connect()) lustre-OST0000: Denying connection for new client c0d7758a-4501-4a89-8ec1-407fef4f0c7f (at 192.168.203.47@tcp), waiting for 2 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 1:08 00000100:00100000:3.0:1787826245.380114:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042987648 00000100:00100000:3.0:1787826245.380119:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042987648 00000100:00100000:3.0:1787826245.380161:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042987776 00000100:00100000:3.0:1787826245.380165:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042987776 00000100:00100000:3.0:1787826245.380186:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 261 00000100:00100000:3.0:1787826245.380192:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042987648:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826245.380223:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042987648:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826245.380230:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 261 00000100:00100000:3.0:1787826245.380244:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 262 00000100:00100000:3.0:1787826245.380250:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042987776:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826245.380276:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042987776:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826245.380282:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 262 00000100:00080000:1.0:1787826245.381523:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826245.381530:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826245.381533:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826245.415270:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1874663042987904:12345-192.168.203.47@tcp:8:kworker.0 Request processed in 35253us (35821us total) trans 0 rc -16/-16 00000100:00100000:2.0:1787826245.415284:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22589 00010000:00010000:2.0:1787826245.468960:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826246.484678:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826246.996625:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826246.996648:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049342592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826246.996719:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826247.001585:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826247.001610:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049342720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826247.001680:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826247.001816:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049342592 00000100:00100000:3.0:1787826247.001824:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049342592 00000100:00100000:3.0:1787826247.001873:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049342720 00000100:00100000:3.0:1787826247.001877:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049342720 00000100:00100000:3.0:1787826247.001899:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12716 00000100:00100000:3.0:1787826247.001909:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049342592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826247.001940:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445617664 avail 1299378176 00000100:00100000:3.0:1787826247.001989:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049342592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826247.001996:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12716 00000100:00100000:3.0:1787826247.002013:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12717 00000100:00100000:3.0:1787826247.002019:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049342720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826247.002039:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446047744 avail 1299808256 00000100:00100000:3.0:1787826247.002069:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049342720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826247.002075:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12717 00000100:00100000:3.0:1787826247.002130:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049342592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826247.002162:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049342720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826247.004988:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049342848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826247.005050:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826247.005146:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049342848 00000100:00100000:2.0:1787826247.005154:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049342848 00000100:00100000:2.0:1787826247.005211:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5814 00000100:00100000:2.0:1787826247.005220:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049342848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826247.005247:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826247.012472:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049342848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7243us (7411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826247.012848:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5814 00000100:00080000:2.0:1787826247.012891:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826247.013607:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049342848:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787826247.512365:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826247.512371:0:179516:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:1.0:1787826247.512389:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787826247.512392:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787826247.512396:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826247.512407:0:179516:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb343732000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826247.512427:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4774f0000 x1874663049343872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826247.512480:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049343360:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512558:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512601:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049344000:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512625:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512651:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826247.512657:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049342976:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512687:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512707:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049343488:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512728:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512748:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049344128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512784:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512811:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049343104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512835:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512852:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049343616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512871:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512887:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049344256:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512911:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512929:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826247.512935:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049343232:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512954:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.512971:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049343744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.512990:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.513007:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049344384:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513028:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826247.513067:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049343360 00000100:00100000:1.0:1787826247.513075:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049343360 00000100:00100000:1.0:1787826247.513122:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049343744 00000100:00100000:1.0:1787826247.513126:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049343744 00000100:00100000:1.0:1787826247.513143:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12718 00000100:00100000:1.0:1787826247.513151:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049343360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513202:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049343360:12345-0@lo:400:kworker.0 Request processed in 51us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513209:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12718 00000100:00100000:1.0:1787826247.513228:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12719 00000100:00100000:1.0:1787826247.513235:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049343744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513263:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049343744:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513268:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12719 00000100:00100000:1.0:1787826247.513285:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049344000 00000100:00100000:1.0:1787826247.513289:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049344000 00000100:00100000:1.0:1787826247.513309:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049343488 00000100:00100000:1.0:1787826247.513311:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049343488 00000100:00100000:1.0:1787826247.513363:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7057 00000100:00100000:1.0:1787826247.513369:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049344000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513398:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049344000:12345-0@lo:400:kworker.0 Request processed in 29us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513404:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7057 00000100:00100000:1.0:1787826247.513415:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7058 00000100:00100000:1.0:1787826247.513420:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049343488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513443:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049343488:12345-0@lo:400:kworker.0 Request processed in 23us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513449:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7058 00000100:00100000:1.0:1787826247.513465:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049342976 00000100:00100000:1.0:1787826247.513469:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049342976 00000100:00100000:1.0:1787826247.513494:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787826247.513501:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049342976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513527:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049342976:12345-0@lo:400:kworker.0 Request processed in 27us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513537:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787826247.513566:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049344128 00000100:00100000:1.0:1787826247.513570:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049344128 00000100:00100000:1.0:1787826247.513594:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049343104 00000100:00100000:1.0:1787826247.513598:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049343104 00000100:00100000:1.0:1787826247.513610:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049343616 00000100:00100000:1.0:1787826247.513613:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049343616 00000100:00100000:1.0:1787826247.513623:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049344256 00000100:00100000:1.0:1787826247.513625:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049344256 00000100:00100000:1.0:1787826247.513635:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049343232 00000100:00100000:1.0:1787826247.513637:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049343232 00000100:00100000:1.0:1787826247.513646:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049344384 00000100:00100000:1.0:1787826247.513648:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049344384 00000100:00100000:1.0:1787826247.513660:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787826247.513666:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049344128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513694:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049344128:12345-0@lo:400:kworker.0 Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513700:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787826247.513712:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787826247.513718:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049343104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513743:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049343104:12345-0@lo:400:kworker.0 Request processed in 26us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513749:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787826247.513760:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787826247.513764:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049343616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513787:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049343616:12345-0@lo:400:kworker.0 Request processed in 22us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513792:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787826247.513805:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787826247.513811:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049344256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513835:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049344256:12345-0@lo:400:kworker.0 Request processed in 26us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513840:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787826247.513849:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787826247.513855:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049343232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513876:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049343232:12345-0@lo:400:kworker.0 Request processed in 21us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513881:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787826247.513891:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787826247.513896:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049344384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.513917:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049344384:12345-0@lo:400:kworker.0 Request processed in 21us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826247.513921:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1787826247.513959:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826247.513963:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826247.513965:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826247.513993:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049342976:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.514006:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049343488:0@lo:400:kworker.0 00010000:00080000:1.0:1787826247.514016:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb472975c00 x1874663049344128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826247.514026:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049344128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.514034:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049343360:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.514045:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049344000:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.514096:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049343232:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.514106:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049343744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826247.514115:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049344384:0@lo:400:kworker.0 00010000:00080000:1.0:1787826247.514124:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb476ca6d80 x1874663049343104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826247.514131:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049343104:0@lo:400:kworker.0 00010000:00080000:1.0:1787826247.514140:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb4774f0e00 x1874663049343616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826247.514147:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049343616:0@lo:400:kworker.0 00010000:00080000:1.0:1787826247.514155:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb472976a00 x1874663049344256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826247.514161:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049344256:0@lo:400:kworker.0 00000100:00100000:0.0:1787826247.515483:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049343872:0@lo:8:kworker.0 00000100:00100000:0.0:1787826247.515544:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826247.515607:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049343872 00000100:00100000:0.0:1787826247.515614:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049343872 00000100:00100000:0.0:1787826247.515643:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22590 00000100:00100000:0.0:1787826247.515648:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0+-99:3616:x1874663049343872:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787826247.515675:0:177402:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8eb349797800, cookie 0x878a5eea00ced72c 00010000:00080000:0.0:1787826247.515681:0:177402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8eb349797800 cur 8314 last 1787826242 00002000:00100000:0.0:1787826247.515697:0:177402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8eb349797800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787826247.515701:0:177402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787826247.515704:0:177402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1787826247.515737:0:177402:0:(import.c:65:import_set_state_nolock()) ffff8eb443ea6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826247.515797:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049343872:12345-0@lo:8:kworker.0 Request processed in 147us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826247.515804:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22590 00010000:00080000:0.0:1787826247.515827:0:194626:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787826247.515832:0:194626:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 34359738467 00010000:00080000:0.0:1787826247.515836:0:194626:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 34359738467 00010000:00080000:0.0:1787826247.515839:0:194626:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 34359738467 00010000:00080000:0.0:1787826247.515861:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb4774f0000 x1874663049343872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787826272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826247.515870:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738466 gen 2 00000100:00080000:0.0:1787826247.515877:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:0.0:1787826247.515884:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787826247.515889:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787826247.515891:0:3616:0:(import.c:1233:ptlrpc_connect_interpret()) connect to lustre-OST0000_UUID during recovery 00000100:00080000:0.0:1787826247.515892:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY_LOCKS 00000100:00080000:0.0:1787826247.515895:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787826247.515916:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049343872:0@lo:8:kworker.0 00000100:00100000:0.0:1787826247.515931:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049344512:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1787826247.515953:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826247.515992:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049344512 00000100:00100000:0.0:1787826247.515996:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049344512 00000100:00100000:0.0:1787826247.516029:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7059 00000100:00100000:0.0:1787826247.516037:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049344512:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1787826247.516058:0:43896:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb479840a80 x1874663049344512/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:603/0 lens 224/0 e 0 to 0 dl 1787826258 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826247.516070:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049344512:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 36us (117us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826247.516075:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7059 00010000:00080000:0.0:1787826247.516095:0:194626:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 34359738467 00010000:00080000:0.0:1787826247.516098:0:194626:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1787826247.516102:0:194626:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826247.516104:0:194626:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1787826247.516209:0:194626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705664 00010000:00010000:1.0:1787826247.517261:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787826247.526191:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787826247.526204:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:1.0:1787826247.526463:0:194626:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1787826247.526480:0:194626:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8eb343e54380 x1874663049342464/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:599/0 lens 224/0 e 0 to 0 dl 1787826254 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826247.526595:0:194626:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8eb479840a80 x1874663049344512/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:603/0 lens 224/0 e 0 to 0 dl 1787826258 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1787826247.526629:0:194626:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00010000:00080000:3.0:1787826247.526674:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb479843100 x1874663049344512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826263 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826247.526691:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1787826247.526697:0:3616:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8eb479843100 x1874663049344512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826263 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826247.526717:0:3616:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8eb479843100 x1874663049344512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826263 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826247.526723:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1787826247.526740:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1787826247.526743:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787826247.526748:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049344512:0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1787826247.526764:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb343e55c00 x1874663049342464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826259 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826247.526779:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1787826247.526783:0:3616:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8eb343e55c00 x1874663049342464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826259 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826247.526791:0:3616:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8eb343e55c00 x1874663049342464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787826259 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826247.526796:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1787826247.526805:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1787826247.526807:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787826247.526811:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049342464:0@lo:400:ldlm_lock_repla.0 00000004:00080000:3.0:1787826247.526894:0:193945:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x1862:0x0] 00000100:00100000:3.0:1787826247.526917:0:193945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:193945:1874663049344768:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787826247.526958:0:193945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826247.526981:0:193945:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826247.527018:0:187969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:187969:1874663049345024:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787826247.527044:0:187969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826247.527063:0:187969:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826247.527097:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049344896:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1787826247.527104:0:193944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x140:0x0] index 3 count 2 00000100:00100000:3.0:1787826247.527126:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826247.527148:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000040:00080000:0.0:1787826247.527149:0:193944:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 81 synced_idx: 81 lgh_last_idx: 81 00000040:00080000:0.0:1787826247.527155:0:193944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x144:0x0] at index 81 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1787826247.527156:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049344640:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787826247.527181:0:193944:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787826247.527186:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826247.527217:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049344768 00000100:00100000:3.0:1787826247.527224:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049344768 00000004:00080000:0.0:1787826247.527255:0:193944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8314353929264ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787826247.527264:0:193944:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787826247.527266:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049345024 00000100:00100000:3.0:1787826247.527271:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049345024 00000100:00100000:3.0:1787826247.527300:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22591 00000100:00100000:0.0:1787826247.527304:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049345152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826247.527313:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:193945:x1874663049344768:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787826247.527367:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826247.527423:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049344896 00000100:00100000:0.0:1787826247.527428:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049344896 00000100:00100000:3.0:1787826247.527545:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049345152 00000100:00100000:0.0:1787826247.527630:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049344640 00002000:00080000:1.0:1787826247.527651:0:194626:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787826247.527658:0:194626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:0.0:1787826247.527779:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049344640 00000100:00100000:0.0:1787826247.527813:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5815 00000100:00100000:0.0:1787826247.527822:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049344896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826247.527837:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826247.527883:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049344896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826247.527890:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5815 00000100:00100000:0.0:1787826247.527905:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5816 00000100:00100000:0.0:1787826247.527912:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049344640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826247.527922:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826247.527946:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049344640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826247.527952:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5816 00000100:00100000:0.0:1787826247.527976:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22592 00000100:00100000:0.0:1787826247.527984:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:187969:x1874663049345024:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787826247.528239:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049345152 00000100:00100000:3.0:1787826247.528272:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22593 00000100:00100000:3.0:1787826247.528278:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049345152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826247.528296:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6242 count 1 00010000:00080000:3.0:1787826247.528361:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb448cd8a80 x1874663049344640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826247.528385:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049344640:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787826247.528399:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb44f747100 x1874663049344896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787826263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826247.528410:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049344896:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1787826247.530991:0:43906:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787826247.531001:0:43906:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6305 -> diff = -63 00002000:02000040:1.0:1787826247.531007:0:43906:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6243 to 0x280000401:6305) 00000004:00080000:0.0:1787826247.532944:0:193926:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787826247.536483:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049345152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8195us (9106us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826247.536497:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22593 00000004:00080000:3.0:1787826247.536616:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479843100, transno 0 00000004:00080000:3.0:1787826247.536623:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479843100/1, rc -2, transno 0 00000100:00100000:3.0:1787826247.536693:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049345152:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1787826247.536842:0:193944:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 80, last_idx 81 00000040:00080000:3.0:1787826247.536866:0:193944:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00002000:00080000:3.0:1787826247.537031:0:43898:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787826247.537037:0:43898:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x3a1:0x0] 00000100:00100000:3.0:1787826247.537144:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:187969:x1874663049345024:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9160us (10099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826247.537153:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22592 00010000:00080000:3.0:1787826247.537190:0:187969:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb44f5f2a00 x1874663049345024/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787826263 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826247.537202:0:187969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:187969:1874663049345024:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787826247.537213:0:187969:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x3a1:0x0] 00002000:00010000:2.0:1787826247.553168:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826247.553183:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.553201:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a1:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:2.0:1787826247.553206:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826247.553213:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.553232:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.553242:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.553249:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.553274:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826247.553528:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826247.553535:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.553544:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826247.553627:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.553638:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.553656:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.553664:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced7aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.553685:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.553687:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.553689:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.555908:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.556035:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.556053:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a0:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.556058:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.556065:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.556089:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.556101:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.556110:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.556138:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826247.556365:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826247.556373:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.556382:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826247.556387:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.556402:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.556419:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.556426:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.556448:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.556450:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.556451:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.557241:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x189f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.557251:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.557263:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189f:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.557267:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.557273:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.557285:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.557293:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.557300:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.557340:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826247.557605:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826247.557612:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.557620:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826247.557625:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.557633:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.557650:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.557657:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbee5f82/0x878a5eea00ced7b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.557675:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.557677:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.557678:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.559173:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x189e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.559185:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.559199:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189e:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.559203:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.559210:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.559685:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.559709:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.559724:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.561019:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826247.561042:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826247.561049:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.561062:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826247.561066:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.561077:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.561107:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.561115:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.561134:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.561136:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.561138:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.563319:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x189d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.563360:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.563378:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189d:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.563383:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.563391:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.563405:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.563415:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.563424:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.563444:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826247.564458:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x189c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.564468:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.564481:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189c:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.564485:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.564490:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.564507:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.564517:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.564525:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.564550:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787826247.565952:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826247.565965:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.565979:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826247.565984:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.565994:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.566014:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.566022:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6347ae2/0x878a5eea00ced7c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.566052:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826247.566056:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.566063:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826247.566066:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.566074:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.566095:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.566102:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b25a5a6e/0x878a5eea00ced7cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.566115:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.566117:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.566119:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.566677:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x189b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.566686:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.566696:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189b:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.566700:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.566717:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.566729:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.566746:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.566758:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.566777:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826247.567207:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826247.567213:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.567232:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826247.567237:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.567245:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.567259:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.567266:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00ced7d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.567282:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.567284:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.567285:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.568192:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.568471:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x189a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.568480:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568493:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189a:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.568497:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x189a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.568504:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568515:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568525:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568534:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568550:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826247.568560:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826247.568564:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568572:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826247.568575:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568583:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568596:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568604:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006180a024/0x878a5eea00ced7db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.568619:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.568620:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.568622:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.570464:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1899:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.570478:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.570494:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1899:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.570499:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1899:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.570505:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.570518:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.570529:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.570538:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.570556:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826247.571109:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826247.571118:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.571128:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826247.571132:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.571141:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.571159:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.571168:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00ced7e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.571187:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.571189:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.571191:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.578254:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1898:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.578268:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578285:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1898:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.578290:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1898:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.578297:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578311:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578344:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578353:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578380:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826247.578391:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826247.578397:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578405:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826247.578410:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578419:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578435:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578443:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a00b0c4f/0x878a5eea00ced7e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.578462:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.578464:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.578466:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.579192:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1897:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.579200:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579212:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1897:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.579228:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1897:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.579233:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579244:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579252:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579260:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579283:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826247.579687:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1896:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.579693:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579712:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1896:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.579717:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1896:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.579721:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579730:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579747:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579756:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.579779:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787826247.579813:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826247.579820:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579830:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.579835:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579844:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579864:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579872:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c8d34fd/0x878a5eea00ced7f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579893:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.579896:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579903:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.579906:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579914:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579923:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579931:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025445e6a/0x878a5eea00ced7f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.579943:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.579945:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.579946:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.580457:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1895:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.580464:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.580475:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1895:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.580479:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1895:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.580483:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.580493:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.580502:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.580510:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.580527:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826247.580821:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.580826:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.580834:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.580838:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.580848:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.580861:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.580868:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267d096f/0x878a5eea00ced7fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.580883:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.580885:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.580886:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.580981:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.581012:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1894:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.581019:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.581029:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1894:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.581033:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1894:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.581037:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.581047:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.581056:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.581064:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.581092:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826247.581185:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826247.581191:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.581199:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826247.581202:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.581210:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.581221:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.581229:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003738c5e0/0x878a5eea00ced805 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.581243:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.581245:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.581247:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.582066:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1893:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.582075:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.582098:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1893:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.582102:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1893:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.582107:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.582118:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.582128:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.582136:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.582157:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826247.582236:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.582242:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.582255:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.582258:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.582265:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.582280:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.582286:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cee1c85f/0x878a5eea00ced80c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.582303:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.582304:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.582306:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.584153:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1892:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.584167:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.584183:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1892:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.584187:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1892:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.584193:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.584206:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.584216:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.585204:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.585309:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826247.585776:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826247.585784:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.585793:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64600 already unused, calling callback (ffffffffc0e34230) 00002000:00010000:1.0:1787826247.586139:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1891:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.586147:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.586159:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1891:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.586164:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1891:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.586169:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.586182:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.586192:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.586201:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.586267:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.586279:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.586296:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.586304:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b1dcf44/0x878a5eea00ced813 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.589611:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826247.589624:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.589638:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826247.589643:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.589655:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.589674:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.589683:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.589685:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.589688:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.592370:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.594321:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826247.594386:0:43906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb3b4b91/0x878a5eea00ced81a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826247.595718:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1890:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.595732:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.596292:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1890:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.596297:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1890:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.596304:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.596318:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.596394:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.596403:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.596425:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826247.596752:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.596760:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.596770:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.596775:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.596785:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.596803:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.596810:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a16e03/0x878a5eea00ced821 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.596832:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.596833:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.596835:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826247.598064:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x188f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826247.598075:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.598100:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188f:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:1.0:1787826247.598104:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826247.598110:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.598121:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.598131:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.598139:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.598196:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826247.601030:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x188e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826247.601044:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.601060:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188e:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:2.0:1787826247.601065:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826247.601071:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.601094:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.601110:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.601118:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.605812:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787826247.606241:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826247.606251:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606264:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826247.606271:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606280:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606301:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606309:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058975277/0x878a5eea00ced828 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606365:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826247.606369:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606378:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826247.606381:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606388:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606397:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606404:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced82f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606416:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.606418:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826247.606420:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826247.606682:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x188d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826247.606689:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606700:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188d:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:0.0:1787826247.606704:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826247.606710:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606720:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606729:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606735:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826247.606753:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826247.606892:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826247.606898:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.606905:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826247.606908:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.606916:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.606928:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.607000:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4a1a428/0x878a5eea00ced836 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.607020:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.607023:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.607025:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.607137:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826247.613155:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x188c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826247.613271:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.613289:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188c:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:2.0:1787826247.613294:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826247.613301:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.613315:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.613343:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.613351:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.613370:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826247.615231:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.615245:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.615257:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.615262:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.615273:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.615293:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.615301:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced83d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.615342:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.615344:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.615346:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826247.623044:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x188b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826247.623060:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.623077:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188b:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:3.0:1787826247.623092:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826247.623099:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.623115:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.623125:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.623133:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.623161:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826247.623875:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826247.623884:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.623893:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826247.623898:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.623908:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.623993:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.624002:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e51285c8/0x878a5eea00ced844 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.624029:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.624032:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.624034:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826247.624475:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x188a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826247.624483:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.624500:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188a:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:3.0:1787826247.624504:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x188a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826247.624510:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.624522:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.624549:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.624559:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.624583:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826247.625417:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826247.625425:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.625435:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826247.625438:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.625447:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.625462:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.625470:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7e08bc5/0x878a5eea00ced84b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.625488:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.625490:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.625492:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826247.627650:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1889:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826247.627663:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.627679:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1889:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:3.0:1787826247.627684:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1889:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826247.627691:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.627704:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.627714:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.627722:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.627829:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826247.630435:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1888:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826247.630448:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630464:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1888:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:3.0:1787826247.630468:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1888:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826247.630475:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630487:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630497:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630506:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630530:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787826247.630540:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826247.630547:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630555:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ee00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.630560:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630570:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630585:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630594:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7f3bc46/0x878a5eea00ced852 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630616:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.630620:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630627:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.630631:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630645:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630655:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630663:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4789fb4/0x878a5eea00ced859 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.630674:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.630675:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.630677:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.631128:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826247.631511:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1887:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826247.631519:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.631531:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1887:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:3.0:1787826247.631534:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1887:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826247.631539:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.631549:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.631559:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.631568:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.631619:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826247.632167:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1886:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826247.632173:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.632184:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1886:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:3.0:1787826247.632187:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1886:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826247.632192:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.632202:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.632210:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.632218:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632250:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826247.632256:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632264:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fe00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826247.632269:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632278:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632292:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632300:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c2c92eb/0x878a5eea00ced860 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632315:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826247.632319:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632355:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826247.632359:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632366:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632375:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826247.632383:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.632384:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826247.632386:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.635344:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787826247.635361:0:43906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260aef8a/0x878a5eea00ced867 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.635955:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826247.636284:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1885:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826247.636293:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.636306:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1885:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:2.0:1787826247.636311:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1885:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826247.636318:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.636374:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.636384:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.636392:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.636408:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826247.636758:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.636766:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.636775:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.636780:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.636790:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.636820:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.636829:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00ced86e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.636845:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.636847:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.636848:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826247.640979:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1884:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826247.640993:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.641009:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1884:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:2.0:1787826247.641019:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1884:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826247.641025:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.641039:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.641050:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.641065:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.641103:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826247.641452:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.641460:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.641470:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.641475:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.641485:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.641501:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.641509:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00ced875 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.641528:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.641530:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.641532:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826247.643056:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1883:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826247.643067:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.643093:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1883:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:2.0:1787826247.643098:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1883:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826247.643105:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.643117:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.643127:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.643136:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.643819:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826247.643982:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1882:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826247.643989:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.644000:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1882:0x0].0x0 since=8314s v=(0 0) 00010000:00010000:2.0:1787826247.644004:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1882:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826247.644009:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.644019:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.644029:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826247.644036:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.645897:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826247.645910:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646039:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.646046:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646058:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646090:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646098:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00ced87c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646139:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826247.646144:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646150:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826247.646153:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646161:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646170:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.646178:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.646179:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826247.646181:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826247.650041:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787826247.650055:0:43906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00ced883 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787826247.652166:0:43906:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6242 00000100:00100000:2.0:1787826247.652266:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:193945:x1874663049344768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 124951us (125303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826247.652276:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22591 00000100:00100000:2.0:1787826247.652345:0:193945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:193945:1874663049344768:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787826247.652360:0:193945:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x18a1:0x0] from OST, last_created [0x280000401:0x18a1:0x0]last_used is [0x280000401:0x1862:0x0] 00000100:00100000:2.0:1787826247.652404:0:193945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:193945:1874663049345280:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787826247.652437:0:193945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826247.652458:0:193945:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb345388540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826247.652477:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049345280 00000100:00100000:2.0:1787826247.652483:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049345280 00000100:00100000:2.0:1787826247.652520:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22594 00000100:00100000:2.0:1787826247.652528:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:193945:x1874663049345280:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787826247.652563:0:43904:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6306 00010000:00010000:1.0:1787826247.657944:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826247.661074:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:193945:x1874663049345280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8536us (8627us total) trans 38654705665 rc 0/0 00000100:00100000:2.0:1787826247.661096:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22594 00000100:00100000:0.0:1787826247.661321:0:193945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:193945:1874663049345280:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787826247.661378:0:193945:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x18a1:0x0]-[0x280000401:0x18c1:0x0] 00010000:00010000:3.0:1787826248.533060:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826248.535415:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049345408:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.536269:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.536347:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049345920:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.536379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.536400:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049346432:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.536422:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.536611:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049346944:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.536644:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.536673:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826248.536680:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049345792:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.536705:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.537296:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049346304:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.537343:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.537363:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049346816:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.537392:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.537430:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049345536:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.539700:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.540303:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049346048:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.540359:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.540386:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049346560:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.540409:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.540430:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049347072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826248.540955:0:193933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049345408 00000100:00100000:1.0:1787826248.540964:0:193933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049345408 00000100:00100000:0.0:1787826248.541098:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.541127:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826248.541135:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049345664:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.541160:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.541176:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049346176:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.541196:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.541221:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049346688:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.541245:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826248.541273:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049345920 00000100:00100000:0.0:1787826248.541277:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049345920 00000100:00100000:0.0:1787826248.541307:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049346432 00000100:00100000:0.0:1787826248.541311:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049346432 00000100:00100000:0.0:1787826248.541347:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049346048 00000100:00100000:0.0:1787826248.541350:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049346048 00000100:00100000:0.0:1787826248.541368:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049346560 00000100:00100000:0.0:1787826248.541371:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049346560 00000100:00100000:0.0:1787826248.541390:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7060 00000100:00100000:0.0:1787826248.541399:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049345920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.541466:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049345920:12345-0@lo:400:kworker.0 Request processed in 67us (5086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.541474:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7060 00000100:00100000:0.0:1787826248.541490:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7061 00000100:00100000:0.0:1787826248.541497:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049346432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.541524:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049346432:12345-0@lo:400:kworker.0 Request processed in 28us (5102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.541530:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7061 00000100:00100000:0.0:1787826248.541554:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7062 00000100:00100000:0.0:1787826248.541561:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049346048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.541590:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049346048:12345-0@lo:400:kworker.0 Request processed in 31us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.541596:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7062 00000100:00100000:0.0:1787826248.541609:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7063 00000100:00100000:0.0:1787826248.541615:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.541643:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049346560:12345-0@lo:400:kworker.0 Request processed in 28us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.541649:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7063 00000100:00100000:0.0:1787826248.541674:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049347072 00000100:00100000:0.0:1787826248.541678:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049347072 00000100:00100000:0.0:1787826248.541700:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5817 00000100:00100000:0.0:1787826248.541707:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049347072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826248.543083:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826248.543156:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049347072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1446us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.543168:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5817 00000100:00100000:0.0:1787826248.543304:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049346048:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.543318:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049346560:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.543351:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049347072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826248.543396:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049345920:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.543408:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049346432:0@lo:400:kworker.0 00000100:00100000:1.0:1787826248.543560:0:193933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787826248.543574:0:193933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049345408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826248.543631:0:193933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049345408:12345-0@lo:400:kworker.0 Request processed in 63us (7429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826248.543637:0:193933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787826248.547935:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049345408:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.548272:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049346944 00000100:00100000:0.0:1787826248.548280:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049346944 00000100:00100000:0.0:1787826248.548343:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049346816 00000100:00100000:0.0:1787826248.548347:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049346816 00000100:00100000:0.0:1787826248.548363:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049345536 00000100:00100000:0.0:1787826248.548366:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049345536 00000100:00100000:0.0:1787826248.548376:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049345664 00000100:00100000:0.0:1787826248.548378:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049345664 00000100:00100000:0.0:1787826248.548388:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049346176 00000100:00100000:0.0:1787826248.548390:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049346176 00000100:00100000:0.0:1787826248.548400:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049346688 00000100:00100000:0.0:1787826248.548403:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049346688 00000100:00100000:0.0:1787826248.548418:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787826248.548427:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049346944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.548523:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049346944:12345-0@lo:400:kworker.0 Request processed in 97us (11878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.548530:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787826248.548754:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787826248.548762:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049346816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.548798:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049346816:12345-0@lo:400:kworker.0 Request processed in 37us (11406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.548804:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787826248.548817:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787826248.548824:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049345536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.548873:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049345536:12345-0@lo:400:kworker.0 Request processed in 50us (9179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.548879:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787826248.548891:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787826248.548898:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049345664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.548926:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049345664:12345-0@lo:400:kworker.0 Request processed in 29us (7765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.548932:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787826248.548943:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787826248.548949:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049346176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.548976:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049346176:12345-0@lo:400:kworker.0 Request processed in 28us (7779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.548981:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787826248.548993:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787826248.548999:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049346688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.549025:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049346688:12345-0@lo:400:kworker.0 Request processed in 27us (7779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826248.549031:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787826248.549090:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049345664:0@lo:400:kworker.0 00010000:00080000:0.0:1787826248.549106:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb48110ad80 x1874663049346176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826248.549116:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049346176:0@lo:400:kworker.0 00010000:00080000:0.0:1787826248.549126:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb48110a300 x1874663049346688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826248.549133:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049346688:0@lo:400:kworker.0 00010000:00080000:0.0:1787826248.549144:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481108a80 x1874663049345536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826248.549152:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049345536:0@lo:400:kworker.0 00010000:00080000:0.0:1787826248.549193:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481109500 x1874663049346816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826248.549211:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049346816:0@lo:400:kworker.0 00000100:00100000:0.0:1787826248.549223:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049346944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826248.549556:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049345792 00000100:00100000:2.0:1787826248.549562:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049345792 00000100:00100000:2.0:1787826248.549604:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049346304 00000100:00100000:2.0:1787826248.549607:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049346304 00000100:00100000:2.0:1787826248.549629:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12720 00000100:00100000:2.0:1787826248.549636:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049345792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826248.549687:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049345792:12345-0@lo:400:kworker.0 Request processed in 52us (12980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826248.549694:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12720 00000100:00100000:2.0:1787826248.549706:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12721 00000100:00100000:2.0:1787826248.549712:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049346304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826248.549753:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049346304:12345-0@lo:400:kworker.0 Request processed in 41us (12428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826248.549759:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12721 00000100:00100000:2.0:1787826248.549812:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049345792:0@lo:400:kworker.0 00000100:00100000:2.0:1787826248.549824:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049346304:0@lo:400:kworker.0 00000001:02000400:3.0:1787826248.938066:0:194966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787826249.556430:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787826249.917544:0:195018:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826249.917802:0:195018:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787826250.493740:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826250.493790:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826250.494172:0:193932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042988160 00000100:00100000:3.0:1787826250.494185:0:193932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042988160 00000100:00100000:3.0:1787826250.494249:0:193932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00100000:3.0:1787826250.494260:0:193932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663042988160:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826250.494356:0:193932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663042988160:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 98us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826250.494363:0:193932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00100000:0.0:1787826250.495539:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042988288 00000100:00100000:0.0:1787826250.495552:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042988288 00000100:00100000:0.0:1787826250.495627:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 275 00000100:00100000:0.0:1787826250.495639:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042988288:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826250.495835:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042988288:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 199us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826250.495843:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 275 00000100:00100000:3.0:1787826250.496389:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826250.496460:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826250.498689:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042988672 00000100:00100000:2.0:1787826250.498704:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042988672 00000100:00100000:2.0:1787826250.498775:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7064 00000100:00100000:2.0:1787826250.498785:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042988672:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826250.498853:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042988672:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 70us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826250.498860:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7064 00000100:00080000:0.0:1787826250.501804:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826250.501815:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826250.501836:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042988416 00000100:00100000:0.0:1787826250.501845:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042988416 00000100:00100000:0.0:1787826250.501998:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 276 00000100:00100000:0.0:1787826250.502009:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042988416:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826250.502100:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042988416:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 92us (5638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826250.502107:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 276 00000100:00080000:2.0:1787826250.502189:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826250.503403:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826250.503484:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042988544 00000100:00100000:0.0:1787826250.503492:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042988544 00000100:00100000:0.0:1787826250.503524:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22595 00000100:00100000:0.0:1787826250.503531:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2388:x1874663042988544:12345-192.168.203.47@tcp:8:kworker.0 00010000:00080000:0.0:1787826250.503563:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp t0 exp 0000000000000000 cur 8317 last 0 00000020:00000080:0.0:1787826250.503591:0:8403:0:(genops.c:1385:class_connect()) connect: client c0d7758a-4501-4a89-8ec1-407fef4f0c7f, cookie 0x878a5eea00ced88a 00002000:00100000:0.0:1787826250.503603:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c0d7758a-4501-4a89-8ec1-407fef4f0c7f/ffff8eb443ea2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787826250.503620:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787826250.503792:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787826250.503821:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8eb443ea0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826250.503886:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663042988544:12345-192.168.203.47@tcp:8:kworker.0 Request processed in 354us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826250.503894:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22595 00010000:00010000:3.0:1787826250.581945:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826250.917314:0:195068:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826250.917549:0:195068:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826251.034747:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826251.034843:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042988800 00000100:00100000:1.0:1787826251.034853:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042988800 00000100:00100000:1.0:1787826251.034917:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1028 00000100:00100000:1.0:1787826251.034928:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159931:x1874663042988800:12345-192.168.203.47@tcp:101:touch.0 00010000:00010000:1.0:1787826251.034948:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826251.034975:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced891 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1be expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.035069:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced898 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.035083:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced898 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.035097:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced898 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826251.035150:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787826251.035155:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826251.035191:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced898 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.035217:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced891 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1be expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.035232:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced898 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1be expref: 6 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.035240:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb4820ddf00) 00010000:00010000:1.0:1787826251.035243:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826251.035246:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64e00, rc 0) 00000100:00100000:1.0:1787826251.035306:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159931:x1874663042988800:12345-192.168.203.47@tcp:101:touch.0 Request processed in 379us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826251.035313:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1028 00000100:00100000:0.0:1787826251.042612:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826251.042721:0:187913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042988928 00000100:00100000:1.0:1787826251.042730:0:187913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042988928 00000100:00100000:1.0:1787826251.042771:0:187913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:1.0:1787826251.042780:0:187913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159931:x1874663042988928:12345-192.168.203.47@tcp:700:touch.0 00000100:00100000:1.0:1787826251.042893:0:187913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159931:x1874663042988928:12345-192.168.203.47@tcp:700:touch.0 Request processed in 113us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826251.042900:0:187913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:3.0:1787826251.051051:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826251.051200:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042989184 00000100:00100000:1.0:1787826251.051209:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042989184 00000100:00100000:1.0:1787826251.051273:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1029 00000100:00100000:1.0:1787826251.051284:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159931:x1874663042989184:12345-192.168.203.47@tcp:101:touch.0 00010000:00010000:1.0:1787826251.051303:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826251.051307:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826251.051356:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced898 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1be expref: 6 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.051376:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb4820ddf00) 00010000:00010000:1.0:1787826251.051388:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826251.051405:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced89f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1c5 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.051903:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.051919:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.051929:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.051947:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.051954:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.051961:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826251.052793:0:187905:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x1863:0x0], count =63 00000004:00080000:1.0:1787826251.052804:0:187905:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x1863:0x0]+63 in llog 00000004:00080000:1.0:1787826251.052823:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x18a2:0x0], index 0: 0 00010000:00010000:1.0:1787826251.053156:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced8b4 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053170:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced8b4 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053179:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced8b4 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053214:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053221:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053227:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053232:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826251.053236:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053243:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053255:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb4820dd900) 00010000:00010000:1.0:1787826251.053258:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826251.053262:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053267:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced8a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826251.053278:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000841342e6 reply state 0000000087a40276 transno 347892350977 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053288:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053294:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8eb4820dd500) 00010000:00010000:1.0:1787826251.053296:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826251.053299:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826251.053360:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced89f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1c5 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053382:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced8b4 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1c5 expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.053389:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb4820dd100) 00010000:00010000:1.0:1787826251.053391:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826251.053393:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65c00, rc 0) 00000100:00100000:1.0:1787826251.053462:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:159931:x1874663042989184:12345-192.168.203.47@tcp:101:touch.0 Request processed in 2179us (2420us total) trans 347892350977 rc 0/0 00000100:00100000:1.0:1787826251.053472:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1029 00000100:00100000:0.0:1787826251.056801:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826251.056895:0:187915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042989312 00000100:00100000:1.0:1787826251.056905:0:187915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042989312 00000100:00100000:1.0:1787826251.056957:0:187915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:1.0:1787826251.056968:0:187915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159931:x1874663042989312:12345-192.168.203.47@tcp:900:touch.0 00000100:00100000:1.0:1787826251.057231:0:187915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159931:x1874663042989312:12345-192.168.203.47@tcp:900:touch.0 Request processed in 263us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826251.057242:0:187915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:0.0:1787826251.061516:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826251.065252:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042989568 00000100:00100000:2.0:1787826251.065276:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042989568 00000100:00100000:2.0:1787826251.065348:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1030 00000100:00100000:2.0:1787826251.065357:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:159931:x1874663042989568:12345-192.168.203.47@tcp:36:touch.0 00010000:00010000:2.0:1787826251.065407:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826251.065587:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced8b4 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1c5 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.065605:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb4820dd100) 00010000:00010000:2.0:1787826251.065615:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826251.065673:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.065726:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.065736:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826251.065825:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089b8f72f reply state 0000000084f1d057 transno 347892350978 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.065836:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.065842:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:2.0:1787826251.065844:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826251.065846:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826251.065937:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:159931:x1874663042989568:12345-192.168.203.47@tcp:36:touch.0 Request processed in 580us (4430us total) trans 347892350978 rc 0/0 00000100:00100000:2.0:1787826251.065943:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1030 00000100:00100000:0.0:1787826251.072366:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826251.072515:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042989696 00000100:00100000:2.0:1787826251.072526:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042989696 00000100:00100000:2.0:1787826251.072579:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1031 00000100:00100000:2.0:1787826251.072589:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:159931:x1874663042989696:12345-192.168.203.47@tcp:101:touch.0 00010000:00010000:2.0:1787826251.072612:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826251.072631:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00ced8c9 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1cc expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.072683:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00ced8c9 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1cc expref: 10 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.072697:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00ced8c9 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1cc expref: 10 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.072719:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:2.0:1787826251.072722:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826251.072725:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715e00, rc 0) 00000100:00100000:2.0:1787826251.072768:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:159931:x1874663042989696:12345-192.168.203.47@tcp:101:touch.0 Request processed in 181us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826251.072774:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1031 00000100:00100000:2.0:1787826251.081802:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826251.088349:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042989824 00000100:00100000:1.0:1787826251.088363:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042989824 00000100:00100000:1.0:1787826251.088439:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22596 00000100:00100000:1.0:1787826251.088451:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663042989824:12345-192.168.203.47@tcp:2:touch.0 00000100:00080000:2.0:1787826251.089197:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787826251.095353:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705666 is committed 00000001:00100000:1.0:1787826251.095368:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00080000:1.0:1787826251.095375:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705665 is committed 00000100:00100000:1.0:1787826251.095540:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042989824:12345-192.168.203.47@tcp:2:touch.0 Request processed in 7085us (13739us total) trans 38654705666 rc 0/0 00000100:00100000:1.0:1787826251.095552:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22596 00000100:00100000:3.0:1787826251.105370:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826251.105419:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042990080 00000100:00100000:3.0:1787826251.105429:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042990080 00000100:00100000:3.0:1787826251.105479:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:3.0:1787826251.105489:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:159931:x1874663042990080:12345-192.168.203.47@tcp:35:touch.0 00000100:00100000:3.0:1787826251.105824:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:159931:x1874663042990080:12345-192.168.203.47@tcp:35:touch.0 Request processed in 335us (463us total) trans 347892350979 rc 0/0 00000100:00100000:3.0:1787826251.105832:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:0.0:1787826251.133264:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826251.133352:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042990208 00000100:00100000:2.0:1787826251.133362:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042990208 00000100:00100000:2.0:1787826251.133415:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1032 00000100:00100000:2.0:1787826251.133425:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:159932:x1874663042990208:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:2.0:1787826251.133447:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826251.133468:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ced8d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1d3 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.133533:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced8d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.133547:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.133558:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826251.133602:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787826251.133606:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826251.133645:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.133670:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ced8d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1d3 expref: 13 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.134144:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1d3 expref: 12 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.134155:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826251.134158:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826251.134161:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715200, rc 0) 00000100:00100000:2.0:1787826251.134227:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:159932:x1874663042990208:12345-192.168.203.47@tcp:101:rm.0 Request processed in 803us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826251.134234:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1032 00000100:00100000:3.0:1787826251.138551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826251.138661:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042990336 00000100:00100000:2.0:1787826251.138673:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042990336 00000100:00100000:2.0:1787826251.141676:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1033 00000100:00100000:2.0:1787826251.141689:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:159932:x1874663042990336:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:2.0:1787826251.141709:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826251.141733:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ced8de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1da expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141797:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141812:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141822:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141833:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141840:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141846:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141948:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced8f3 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141957:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced8f3 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.141964:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced8f3 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826251.142004:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x1:0x0]: returning size 0 00000004:00200000:2.0:1787826251.142008:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826251.142023:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced8f3 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142036:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced8f3 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142044:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142051:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142073:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142079:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826251.142083:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142090:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142101:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:2.0:1787826251.142105:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826251.142109:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142115:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced8e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142128:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142134:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142139:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142143:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826251.142146:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142156:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142164:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8eb4820dd500) 00010000:00010000:2.0:1787826251.142167:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826251.142170:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142175:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced8ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142199:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ced8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1da expref: 14 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142211:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced8f3 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1da expref: 13 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826251.142217:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:2.0:1787826251.142220:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826251.142222:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2600, rc 0) 00000100:00100000:2.0:1787826251.142294:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:159932:x1874663042990336:12345-192.168.203.47@tcp:101:rm.0 Request processed in 606us (3752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826251.142302:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1033 00000100:00100000:1.0:1787826251.146533:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826251.146611:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042990464 00000100:00100000:0.0:1787826251.146622:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042990464 00000100:00100000:0.0:1787826251.146678:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22597 00000100:00100000:0.0:1787826251.146688:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042990464:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826251.146710:0:151857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826251.146731:0:151857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1e1 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826251.146757:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a2:0x0] initial LVB size: 0, mtime: 0x6a90104b, atime: 0x6a90104b, ctime: 0x6a90104b, blocks: 0x0 00010000:00010000:0.0:1787826251.146777:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a2:0x0].0x0 since=8317s v=(0 0) 00010000:00010000:0.0:1787826251.146782:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826251.146791:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 6 pid: 151857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.146810:0:151857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 6 pid: 151857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.146824:0:151857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569a00, rc 0) 00000100:00100000:0.0:1787826251.146892:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663042990464:12345-192.168.203.47@tcp:101:rm.0 Request processed in 194us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826251.146898:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22597 00000100:00100000:1.0:1787826251.151419:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826251.151728:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042990720 00000100:00100000:0.0:1787826251.151738:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042990720 00000100:00100000:0.0:1787826251.151795:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1034 00000100:00100000:0.0:1787826251.151806:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:159932:x1874663042990720:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826251.151858:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787826251.152586:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ced8f3 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1da expref: 13 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152614:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00ced8c9 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1cc expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152625:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:0.0:1787826251.152635:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ced8d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1d3 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152642:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb449aacf00) 00010000:00010000:0.0:1787826251.152649:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826251.152673:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152686:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152695:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152705:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152712:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152718:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152806:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152818:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.152824:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826251.154144:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x144:0x0].2, 64 off8320 00000004:00080000:0.0:1787826251.154158:0:188682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8317980831880ns, next at 8318980829287ns, rc = 0 00010000:00010000:0.0:1787826251.154217:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154230:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154239:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154246:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154252:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154258:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154284:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826251.154306:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154312:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154319:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154352:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826251.154357:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154364:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154375:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:0.0:1787826251.154378:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826251.154381:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154386:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ced90f lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154406:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154412:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154418:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154422:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826251.154424:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154434:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154440:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb46e062600) 00010000:00010000:0.0:1787826251.154443:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826251.154445:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154451:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ced901 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826251.154467:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ce75f0a reply state 00000000a30abe17 transno 347892350980 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154477:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826251.154483:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8eb4820dd500) 00010000:00010000:0.0:1787826251.154485:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826251.154489:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826251.154582:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:159932:x1874663042990720:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2774us (3168us total) trans 347892350980 rc 0/0 00000100:00100000:0.0:1787826251.154592:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1034 00010000:00010000:1.0:1787826251.155104:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826251.155111:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.155118:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826251.155122:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.155128:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.155137:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:1.0:1787826251.155139:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826251.155143:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 1/0,0 mode: --/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.155148:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced916 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826251.155164:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826251.155166:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826251.155167:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826251.604745:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826252.116700:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049347200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826252.116793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826252.117192:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049347200 00000100:00100000:3.0:1787826252.117201:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049347200 00000100:00100000:3.0:1787826252.117259:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12722 00000100:00100000:3.0:1787826252.117269:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049347200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826252.117299:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446047744 avail 1299808256 00000100:00100000:3.0:1787826252.117367:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049347200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826252.117374:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12722 00000100:00100000:2.0:1787826252.117511:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049347200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826252.117978:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049347328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826252.118011:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826252.118096:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049347328 00000100:00100000:1.0:1787826252.118101:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049347328 00000100:00100000:1.0:1787826252.118133:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12723 00000100:00100000:1.0:1787826252.118140:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049347328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826252.118160:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445629952 avail 1299390464 00000100:00100000:1.0:1787826252.118195:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049347328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826252.118201:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12723 00000100:00100000:1.0:1787826252.118230:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049347328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826252.123058:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049347456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826252.123130:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826252.123241:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049347456 00000100:00100000:0.0:1787826252.123249:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049347456 00000100:00100000:0.0:1787826252.123314:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5818 00000100:00100000:0.0:1787826252.123342:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049347456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826252.123372:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826252.123418:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049347456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826252.123426:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5818 00000100:00080000:3.0:1787826252.123736:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826252.123774:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049347456:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787826252.629060:0:193945:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8319455732716ns, next at 8320455729744ns, rc = 0 00010000:00010000:3.0:1787826252.629101:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826252.629351:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049347584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826252.629610:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826252.629651:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049347712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826252.629679:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826252.629903:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049347584 00000100:00100000:0.0:1787826252.629910:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049347584 00000100:00100000:0.0:1787826252.629981:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049347712 00000100:00100000:0.0:1787826252.629985:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049347712 00000100:00100000:0.0:1787826252.630007:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5819 00000100:00100000:0.0:1787826252.630016:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049347584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826252.630055:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826252.630101:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049347584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826252.630107:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5819 00000100:00100000:0.0:1787826252.630125:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5820 00000100:00100000:0.0:1787826252.630132:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049347712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826252.630141:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826252.630165:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049347712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826252.630170:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5820 00000100:00100000:1.0:1787826252.630387:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049347584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826252.630399:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705665 gen 2 00000100:00100000:1.0:1787826252.630415:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049347712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787826252.630478:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787826252.635027:0:193926:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787826252.635081:0:193926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350980 is committed 00000004:00080000:0.0:1787826252.635086:0:193926:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787826252.635251:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635282:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635290:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635295:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826252.635300:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635308:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635349:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8eb4820dd500) 00010000:00010000:2.0:1787826252.635353:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826252.635357:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635364:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced8ad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635383:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635388:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635394:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635404:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826252.635406:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635412:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635419:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:2.0:1787826252.635421:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826252.635424:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 2/0,0 mode: --/TXN res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635430:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714800/0x878a5eea00ced8c2 lrc: 0/0,0 mode: --/TXN res: [0x200027cd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635446:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635451:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635457:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635462:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826252.635465:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635471:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635482:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff8eb4820dd500) 00010000:00010000:2.0:1787826252.635485:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826252.635487:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.635492:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced908 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826252.635649:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049347840:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826252.635894:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826252.636618:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049347840 00000100:00100000:3.0:1787826252.636627:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049347840 00000100:00100000:3.0:1787826252.636690:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22598 00000100:00100000:3.0:1787826252.636701:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049347840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826252.636728:0:179226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:6306 count 1 00010000:00010000:3.0:1787826252.636752:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.636896:0:179226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 5 pid: 151857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.636906:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787826252.636910:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826252.636915:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.636947:0:179226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 5 pid: 151857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.636962:0:179226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 5 pid: 151857 timeout: 8419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826252.636974:0:179226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:179226:1874663049347968:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826252.637062:0:179226:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a76f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826252.653601:0:179226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:179226:1874663049347968:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826252.653634:0:179226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826252.656689:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826252.656807:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042990848 00000100:00100000:2.0:1787826252.656817:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042990848 00010000:00010000:2.0:1787826252.656854:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 6 pid: 151857 timeout: 8419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826252.656904:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12227 00000100:00100000:2.0:1787826252.656915:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042990848:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826252.656930:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826252.656936:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 6 pid: 151857 timeout: 8419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.656951:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 6 pid: 151857 timeout: 8419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.656976:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098d41782/0x878a5eea00ced8fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x18a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e1 expref: 6 pid: 151857 timeout: 8419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.656996:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826252.657002:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826252.657008:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.657019:0:10369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.657057:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826252.657120:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042990848:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 206us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826252.657129:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12227 00010000:00010000:3.0:1787826252.657158:0:179226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.657171:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.657182:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.657189:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.657219:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826252.657412:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049347840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20712us (21517us total) trans 38654705667 rc 0/0 00000100:00100000:3.0:1787826252.657420:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22598 00000004:00080000:3.0:1787826252.657466:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479843100/2, rc 0, transno 38654705667 00000100:00100000:3.0:1787826252.657473:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049347840:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787826252.657665:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826252.657684:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.657693:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826252.657697:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.657705:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.657718:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.657725:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00ced91d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826252.657749:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826252.657752:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826252.657755:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826253.091021:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826253.091110:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042990976 00000100:00100000:2.0:1787826253.091122:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042990976 00000100:00100000:2.0:1787826253.091202:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1035 00000100:00100000:2.0:1787826253.091213:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159959:x1874663042990976:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826253.091237:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826253.091259:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1e8 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826253.091322:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced92b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826253.091365:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced92b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826253.091373:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced92b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826253.091407:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787826253.091409:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826253.091443:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced92b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826253.091461:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ced924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e8 expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826253.091473:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced92b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e8 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826253.091479:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:2.0:1787826253.091481:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826253.091483:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2c00, rc 0) 00000100:00100000:2.0:1787826253.091538:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159959:x1874663042990976:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 327us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.091545:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1035 00000100:00080000:3.0:1787826253.091690:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826253.098771:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826253.105442:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042991104 00000100:00100000:2.0:1787826253.105459:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042991104 00000100:00100000:2.0:1787826253.105599:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1036 00000100:00100000:2.0:1787826253.105611:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159959:x1874663042991104:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826253.105650:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445629952 avail 1299390464 00000100:00100000:2.0:1787826253.105738:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:159959:x1874663042991104:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 129us (6975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.105746:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1036 00000100:00100000:1.0:1787826253.112383:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826253.112483:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042991232 00000100:00100000:0.0:1787826253.112494:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042991232 00000100:00100000:0.0:1787826253.112565:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1037 00000100:00100000:0.0:1787826253.112575:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159959:x1874663042991232:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826253.112612:0:188682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446047744 avail 1299808256 00000100:00100000:0.0:1787826253.112691:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159959:x1874663042991232:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826253.112698:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1037 00000100:00080000:3.0:1787826253.113946:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826253.125143:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826253.125453:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042991360 00000100:00100000:0.0:1787826253.125464:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042991360 00000100:00100000:0.0:1787826253.125543:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5821 00000100:00100000:0.0:1787826253.125554:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159959:x1874663042991360:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826253.125582:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00080000:3.0:1787826253.125797:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826253.125871:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159959:x1874663042991360:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 318us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826253.125880:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5821 00000100:00100000:1.0:1787826253.134319:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826253.134444:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042991488 00000100:00100000:0.0:1787826253.134455:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042991488 00000100:00100000:0.0:1787826253.134537:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5822 00000100:00100000:0.0:1787826253.134549:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159959:x1874663042991488:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826253.134574:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826253.134649:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:159959:x1874663042991488:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 102us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826253.134657:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5822 00000100:00080000:3.0:1787826253.135070:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826253.652881:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826253.653130:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049348224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826253.653196:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049348352:0@lo:400:kworker.0 00000100:00100000:3.0:1787826253.653237:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826253.653429:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049348096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826253.658862:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049348736:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.660979:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049348480:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.661198:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826253.661345:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049348992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826253.661614:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826253.661793:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049349248:0@lo:400:kworker.0 00000100:00100000:3.0:1787826253.661831:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826253.661875:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049348736 00000100:00100000:3.0:1787826253.661886:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049348736 00000100:00100000:0.0:1787826253.661910:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826253.661977:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049349248 00000100:00100000:0.0:1787826253.661986:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049349248 00000100:00100000:3.0:1787826253.662101:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7065 00000100:00100000:3.0:1787826253.662114:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049348736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826253.662354:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049348736:12345-0@lo:400:kworker.0 Request processed in 241us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826253.662364:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7065 00000100:00100000:3.0:1787826253.662504:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7066 00000100:00100000:3.0:1787826253.662513:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049349248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826253.662548:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049349248:12345-0@lo:400:kworker.0 Request processed in 37us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826253.662557:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7066 00000100:00100000:2.0:1787826253.663485:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826253.663528:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049349504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.663570:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826253.663625:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049348480 00000100:00100000:2.0:1787826253.663632:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049348480 00000100:00100000:2.0:1787826253.663677:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12724 00000100:00100000:2.0:1787826253.663686:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049348480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.663740:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049348480:12345-0@lo:400:kworker.0 Request processed in 56us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.663748:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12724 00000100:00100000:2.0:1787826253.663764:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049348992 00000100:00100000:2.0:1787826253.663768:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049348992 00000100:00100000:2.0:1787826253.663930:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12725 00000100:00100000:2.0:1787826253.663937:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049348992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.663969:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049348992:12345-0@lo:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.663976:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12725 00000100:00100000:2.0:1787826253.664021:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049348480:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.664031:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049348992:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.664068:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049348224 00000100:00100000:2.0:1787826253.664072:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049348224 00000100:00100000:2.0:1787826253.664102:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049348352 00000100:00100000:2.0:1787826253.664106:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049348352 00000100:00100000:2.0:1787826253.664122:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049349504 00000100:00100000:2.0:1787826253.664137:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049349504 00000100:00100000:2.0:1787826253.664150:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787826253.664157:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049348224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.664190:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049348224:12345-0@lo:400:kworker.0 Request processed in 34us (10956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.664196:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787826253.664208:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787826253.664430:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049348352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.664465:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049348352:12345-0@lo:400:kworker.0 Request processed in 251us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.664472:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787826253.664485:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787826253.664490:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049349504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.664521:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049349504:12345-0@lo:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.664527:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787826253.664551:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049349504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.664622:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049349248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.664632:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049349760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826253.664658:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826253.664685:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049348224:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.664716:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049348736:0@lo:400:kworker.0 00000100:00080000:2.0:1787826253.664739:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826253.664743:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826253.664745:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826253.668599:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049349760 00000100:00100000:1.0:1787826253.668616:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049349760 00000100:00100000:1.0:1787826253.668692:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5823 00000100:00100000:1.0:1787826253.668714:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049349760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826253.668747:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826253.668823:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049349760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (4164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826253.668830:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5823 00000100:00100000:1.0:1787826253.668868:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826253.668898:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049348096 00000100:00100000:1.0:1787826253.668902:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049348096 00000100:00100000:1.0:1787826253.668927:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787826253.668934:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049348096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.668967:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049348096:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826253.668973:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787826253.669031:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049348096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.669055:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049348608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.669084:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826253.669497:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049348608 00000100:00100000:3.0:1787826253.669510:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049348608 00000100:00100000:3.0:1787826253.669589:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7067 00000100:00100000:3.0:1787826253.669600:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049348608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.669780:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049349760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826253.669875:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049348352:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.669887:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049348864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.670005:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049349120:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.670122:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826253.670147:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049349376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.670172:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826253.670219:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049348864 00000100:00100000:2.0:1787826253.670223:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049348864 00000100:00100000:2.0:1787826253.670249:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049349376 00000100:00100000:2.0:1787826253.670251:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049349376 00000100:00100000:2.0:1787826253.670270:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787826253.670277:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049348864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.670310:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049348864:12345-0@lo:400:kworker.0 Request processed in 33us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.670317:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787826253.670359:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787826253.670365:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049349376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.670402:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049349376:12345-0@lo:400:kworker.0 Request processed in 38us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.670408:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787826253.670442:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049348864:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.670453:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049349376:0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.671941:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826253.671994:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049348608:12345-0@lo:400:kworker.0 Request processed in 2392us (2905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826253.672008:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7067 00000100:00100000:1.0:1787826253.672024:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049349632:0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.672078:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826253.672094:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049349120 00000100:00100000:3.0:1787826253.672103:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049349120 00000100:00100000:1.0:1787826253.672109:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049349632 00000100:00100000:1.0:1787826253.672115:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049349632 00000100:00100000:1.0:1787826253.672166:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787826253.672175:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049349632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.672217:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049349632:12345-0@lo:400:kworker.0 Request processed in 43us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826253.672223:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1787826253.672252:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826253.672295:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049349632:0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.672350:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049348608:0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.672927:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7068 00000100:00100000:2.0:1787826253.672939:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049349120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826253.672998:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049349120:12345-0@lo:400:kworker.0 Request processed in 63us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826253.673005:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7068 00000100:00100000:3.0:1787826253.673069:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049349120:0@lo:400:kworker.0 00010000:00010000:0.0:1787826254.678962:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826255.612154:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826255.612225:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826255.612258:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042991616 00000100:00100000:1.0:1787826255.612271:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042991616 00000100:00100000:3.0:1787826255.612273:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826255.612294:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826255.612356:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:3.0:1787826255.612360:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826255.612369:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663042991616:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826255.612385:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042991872 00000100:00100000:3.0:1787826255.612389:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042991872 00000100:00100000:3.0:1787826255.612433:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042991744 00000100:00100000:3.0:1787826255.612436:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042991744 00000100:00100000:3.0:1787826255.612460:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 283 00000100:00100000:1.0:1787826255.612461:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663042991616:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826255.612467:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042991872:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826255.612469:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:3.0:1787826255.612515:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042991872:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 48us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826255.612521:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 283 00000100:00100000:3.0:1787826255.612534:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 284 00000100:00100000:3.0:1787826255.612540:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2391:x1874663042991744:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826255.612564:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2391:x1874663042991744:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826255.612570:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 284 00000100:00080000:1.0:1787826255.612600:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826255.612606:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826255.612656:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042992128 00000100:00100000:0.0:1787826255.612660:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042992128 00000100:00100000:0.0:1787826255.612703:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042992000 00000100:00100000:0.0:1787826255.612707:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042992000 00000100:00100000:0.0:1787826255.612730:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7069 00000100:00100000:0.0:1787826255.612736:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042992128:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826255.612765:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042992128:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826255.612770:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7069 00000100:00100000:0.0:1787826255.612786:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7070 00000100:00100000:0.0:1787826255.612791:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042992000:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826255.612822:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042992000:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826255.612829:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7070 00000100:00080000:3.0:1787826255.613232:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826255.613236:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826255.701207:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826256.725351:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826257.237471:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826257.237507:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049349888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826257.237599:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826257.237681:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049349888 00000100:00100000:2.0:1787826257.237690:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049349888 00000100:00100000:2.0:1787826257.237759:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12726 00000100:00100000:2.0:1787826257.237768:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049349888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826257.237810:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446047744 avail 1299808256 00000100:00100000:2.0:1787826257.237866:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049349888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826257.237874:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12726 00000100:00100000:2.0:1787826257.237929:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049349888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826257.238621:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826257.238634:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049350016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826257.238678:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826257.238893:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049350016 00000100:00100000:0.0:1787826257.238900:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049350016 00000100:00100000:0.0:1787826257.238939:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12727 00000100:00100000:0.0:1787826257.238948:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049350016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826257.238981:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445629952 avail 1299390464 00000100:00100000:0.0:1787826257.239041:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049350016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826257.239048:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12727 00000100:00100000:0.0:1787826257.239096:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049350016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826257.243246:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049350144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826257.243686:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826257.243901:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049350144 00000100:00100000:2.0:1787826257.243913:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049350144 00000100:00100000:2.0:1787826257.243995:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5824 00000100:00100000:2.0:1787826257.244010:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049350144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826257.244061:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826257.244209:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049350144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (522us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826257.244212:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826257.244219:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5824 00000100:00100000:1.0:1787826257.248889:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049350144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826257.748704:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049350272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826257.748801:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826257.748880:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049350272 00000100:00100000:1.0:1787826257.748890:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049350272 00000100:00100000:1.0:1787826257.748961:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5825 00000100:00100000:1.0:1787826257.748972:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049350272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826257.749018:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826257.749071:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049350272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826257.749079:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5825 00000100:00080000:1.0:1787826257.749123:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826257.749166:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049350272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826257.749407:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049350400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826257.749445:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826257.749657:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049350400 00000100:00100000:1.0:1787826257.749663:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049350400 00000100:00100000:1.0:1787826257.749710:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5826 00000100:00100000:1.0:1787826257.749718:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049350400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826257.749734:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826257.749774:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049350400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826257.749781:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5826 00000100:00100000:1.0:1787826257.749816:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049350400:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787826257.749875:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826257.752207:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787826258.264253:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705667 is committed 00010000:00010000:0.0:1787826258.772916:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826258.773123:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826258.773156:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049350528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826258.773222:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826258.773271:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049350528 00000100:00100000:2.0:1787826258.773279:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049350528 00000100:00100000:2.0:1787826258.773369:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5827 00000100:00100000:2.0:1787826258.773380:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049350528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826258.773402:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826258.773449:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049350528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826258.773456:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5827 00000100:00100000:2.0:1787826258.773500:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049350528:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787826258.773753:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826258.774483:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049350912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.774532:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826258.774572:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049351424:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.774597:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826258.774612:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049351936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.774728:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049351040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.774758:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826258.774785:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049351552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.774811:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826258.774830:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049352064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.774854:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826258.774898:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049351424 00000100:00100000:0.0:1787826258.774904:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049351424 00000100:00100000:0.0:1787826258.774940:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049351040 00000100:00100000:0.0:1787826258.774944:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049351040 00000100:00100000:0.0:1787826258.774966:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12728 00000100:00100000:0.0:1787826258.774976:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049351424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.775031:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049351424:12345-0@lo:400:kworker.0 Request processed in 56us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826258.775037:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12728 00000100:00100000:0.0:1787826258.775062:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12729 00000100:00100000:0.0:1787826258.775067:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049351040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.775094:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049351040:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826258.775099:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12729 00000100:00100000:0.0:1787826258.775116:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049351552 00000100:00100000:0.0:1787826258.775120:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049351552 00000100:00100000:0.0:1787826258.775158:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7071 00000100:00100000:0.0:1787826258.775168:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049351552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.775203:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049351552:12345-0@lo:400:kworker.0 Request processed in 38us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826258.775210:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7071 00000100:00100000:0.0:1787826258.775229:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049350912 00000100:00100000:0.0:1787826258.775233:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049350912 00000100:00100000:0.0:1787826258.775262:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049352064 00000100:00100000:0.0:1787826258.775265:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049352064 00000100:00100000:0.0:1787826258.775284:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787826258.775291:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049350912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.775319:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049350912:12345-0@lo:400:kworker.0 Request processed in 30us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826258.775344:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787826258.775357:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787826258.775363:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049352064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.775389:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049352064:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826258.775396:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1787826258.775422:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826258.775445:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049351040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.775454:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 2 00000004:00080000:0.0:1787826258.775459:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479843100, transno 38654705667 00000100:00100000:0.0:1787826258.775468:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049351552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.775476:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049352064:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.775732:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049350784:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.775764:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.775792:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049351296:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.775811:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.775828:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049351808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.775845:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.775863:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787826258.775869:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049350656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.775895:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.775919:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049351168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.775941:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.775958:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049351680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.775979:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.776018:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049350784 00000100:00100000:3.0:1787826258.776022:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049350784 00000100:00100000:3.0:1787826258.776054:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049351296 00000100:00100000:3.0:1787826258.776058:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049351296 00000100:00100000:3.0:1787826258.776070:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049351808 00000100:00100000:3.0:1787826258.776072:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049351808 00000100:00100000:3.0:1787826258.776084:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787826258.776091:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049350784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.776126:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049350784:12345-0@lo:400:kworker.0 Request processed in 35us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826258.776146:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787826258.776160:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787826258.776167:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049351296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.776193:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049351296:12345-0@lo:400:kworker.0 Request processed in 27us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826258.776199:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787826258.776210:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787826258.776216:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049351808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.776242:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049351808:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826258.776249:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787826258.776377:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049350656 00000100:00100000:3.0:1787826258.776381:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049350656 00000100:00100000:3.0:1787826258.776409:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787826258.776415:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.776445:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049350656:12345-0@lo:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826258.776451:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787826258.776476:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049351168 00000100:00100000:3.0:1787826258.776480:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049351168 00000100:00100000:3.0:1787826258.776500:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049351680 00000100:00100000:3.0:1787826258.776503:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049351680 00000100:00100000:3.0:1787826258.776518:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7072 00000100:00100000:3.0:1787826258.776524:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049351168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.776551:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049351168:12345-0@lo:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826258.776556:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7072 00000100:00100000:3.0:1787826258.776566:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7073 00000100:00100000:3.0:1787826258.776572:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.776593:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049351680:12345-0@lo:400:kworker.0 Request processed in 22us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826258.776597:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7073 00000100:00100000:1.0:1787826258.776931:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826258.776970:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049350912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.776982:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049351424:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.777032:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049350656:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.777043:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049351168:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.777052:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049351680:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.777061:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049350784:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.777071:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049351296:0@lo:400:kworker.0 00000100:00100000:1.0:1787826258.777081:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049351808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.777241:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049351936 00000100:00100000:0.0:1787826258.777246:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049351936 00000100:00100000:0.0:1787826258.777285:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787826258.777292:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049351936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826258.777548:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049351936:12345-0@lo:400:kworker.0 Request processed in 257us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826258.777555:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787826258.777773:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049351936:0@lo:400:kworker.0 00000100:00080000:3.0:1787826258.781243:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787826259.693400:0:195264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80a: DNE: create remote dir, drop update rep from MDT0, fail MDT0 ========================================================== 06:24:18 (1787826258) 00000100:00100000:0.0:1787826259.803574:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826259.803609:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042992256 00000100:00100000:0.0:1787826259.803632:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042992256 00000100:00100000:0.0:1787826259.803701:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1038 00000100:00100000:0.0:1787826259.803711:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160559:x1874663042992256:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826259.803732:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826259.803750:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1ef expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.803812:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826259.803821:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826259.803827:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.803837:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.803851:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.803857:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.803864:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826259.804013:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826259.805346:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805359:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805365:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805372:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826259.805376:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805384:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805398:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:3.0:1787826259.805400:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826259.805405:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805415:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805429:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805434:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805440:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805444:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826259.805447:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805452:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805460:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8eb47f8fee00) 00010000:00010000:3.0:1787826259.805462:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826259.805464:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805469:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced940 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805507:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced932 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1ef expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805522:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:3.0:1787826259.805525:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826259.805529:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1ef expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826259.805538:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569c00, rc 0) 00000100:00100000:3.0:1787826259.805603:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160559:x1874663042992256:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1893us (2036us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826259.805612:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1038 00000100:00100000:3.0:1787826259.837005:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826259.837156:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042992512 00000100:00100000:0.0:1787826259.837166:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042992512 00000100:00100000:0.0:1787826259.837237:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1039 00000100:00100000:0.0:1787826259.837247:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160559:x1874663042992512:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826259.837297:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826259.837321:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ced92b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1e8 expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.837372:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb449aac400) 00010000:00010000:0.0:1787826259.837383:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826259.837452:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.837464:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.837473:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.837485:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.837491:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.837501:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839005:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839022:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839031:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826259.839046:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0e16881 reply state 00000000a015857a transno 347892350981 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839057:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839064:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:0.0:1787826259.839066:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826259.839069:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787826259.839074:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787826259.839081:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839087:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839093:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839100:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826259.839105:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839112:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839121:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fe600) 00010000:00010000:0.0:1787826259.839123:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826259.839126:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839132:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ced947 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826259.839150:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0e16881 reply state 00000000a015857a transno 347892350981 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839162:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826259.839168:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8eb47f8fe000) 00010000:00010000:0.0:1787826259.839170:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826259.839172:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787826259.839421:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:160559:x1874663042992512:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 2172us (2432us total) trans 347892350981 rc 0/0 00000100:00100000:0.0:1787826259.839431:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1039 00000100:00100000:2.0:1787826260.646803:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826260.646874:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042992640 00000100:00100000:0.0:1787826260.646894:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042992640 00000100:00100000:0.0:1787826260.646986:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1040 00000100:00100000:0.0:1787826260.647015:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:160572:x1874663042992640:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826260.647050:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826260.647085:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced95c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1f6 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826260.647185:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced963 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826260.647917:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826260.648152:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826260.648468:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787826260.648475:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826260.648509:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826260.648553:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced95c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1f6 expref: 9 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826260.648577:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1f6 expref: 8 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826260.648588:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fe600) 00010000:00010000:0.0:1787826260.648592:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826260.648596:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568c00, rc 0) 00000100:00100000:0.0:1787826260.648692:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:160572:x1874663042992640:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1680us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826260.648703:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1040 00000100:00100000:3.0:1787826260.676807:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826260.676961:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042992768 00000100:00100000:1.0:1787826260.676978:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042992768 00000100:00100000:1.0:1787826260.677082:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1041 00000100:00100000:1.0:1787826260.677097:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:160572:x1874663042992768:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826260.677139:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826260.677171:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced96a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f1fd expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678018:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678043:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678061:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678075:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678083:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678090:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678951:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced97f lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678973:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced97f lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.678983:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced97f lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826260.679067:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1787826260.679072:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826260.679111:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced97f lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679144:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679152:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679165:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679171:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826260.679176:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679185:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679291:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fe600) 00010000:00010000:1.0:1787826260.679296:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826260.679303:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679311:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679652:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679661:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679667:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679673:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826260.679677:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679688:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679701:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8eb47f8fe000) 00010000:00010000:1.0:1787826260.679703:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826260.679707:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679713:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679760:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced96a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1fd expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679777:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced97f lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1fd expref: 9 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.679786:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:1.0:1787826260.679789:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787826260.679792:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64e00, rc 0) 00000100:00100000:1.0:1787826260.680958:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:160572:x1874663042992768:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 3841us (4146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826260.680977:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1041 00000100:00100000:1.0:1787826260.684529:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826260.684625:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042992896 00000100:00100000:2.0:1787826260.684638:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042992896 00000100:00100000:2.0:1787826260.684752:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1042 00000100:00100000:2.0:1787826260.684765:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:160572:x1874663042992896:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826260.684794:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826260.684823:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ced986 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f204 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685510:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685533:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685547:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685564:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685572:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685580:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685639:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685649:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685656:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685662:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826260.685667:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685674:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685688:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:2.0:1787826260.685692:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826260.685697:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685703:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2800/0x878a5eea00ced98d lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685715:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685722:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685728:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685733:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826260.685736:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685742:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685748:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0xf7117594 (ffff8eb449aac800) 00010000:00010000:2.0:1787826260.685750:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826260.685752:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685758:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced994 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685800:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ced986 lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f204 expref: 10 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685812:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:2.0:1787826260.685815:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826260.685819:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ced986 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f204 expref: 10 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.685830:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2a00, rc 0) 00000100:00100000:2.0:1787826260.687053:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:160572:x1874663042992896:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 2278us (2526us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826260.687067:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1042 00000100:00100000:2.0:1787826260.705455:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826260.705644:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042993024 00000100:00100000:1.0:1787826260.705659:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042993024 00000100:00100000:1.0:1787826260.705740:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1043 00000100:00100000:1.0:1787826260.705752:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:160572:x1874663042993024:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826260.705783:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826260.705813:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced99b lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f20b expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.705911:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.705929:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.705943:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.705961:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.705968:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.705976:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706045:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706054:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706061:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706067:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826260.706074:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706082:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706097:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:1.0:1787826260.706100:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826260.706107:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706114:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65800/0x878a5eea00ced9a2 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706127:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706134:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706140:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706145:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826260.706148:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706154:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706161:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0xf7117594 (ffff8eb348b07b00) 00010000:00010000:1.0:1787826260.706164:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826260.706167:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706173:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64600/0x878a5eea00ced9a9 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706526:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced99b lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f20b expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706540:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:1.0:1787826260.706543:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826260.706547:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced99b lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f20b expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826260.706558:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65c00, rc 0) 00000100:00100000:1.0:1787826260.706661:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:160572:x1874663042993024:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 910us (1221us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826260.706670:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1043 00000100:00100000:1.0:1787826260.714852:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826260.715130:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042993152 00000100:00100000:2.0:1787826260.715144:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042993152 00000100:00100000:2.0:1787826260.715313:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1044 00000100:00100000:2.0:1787826260.715346:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:160572:x1874663042993152:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826260.715452:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826260.715481:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ced9b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f212 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.715575:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.715596:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.715611:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826260.715678:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1787826260.715683:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826260.715711:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.715741:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2a00/0x878a5eea00ced9b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.715760:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.715771:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:2.0:1787826260.715775:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826260.715779:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3800, rc 0) 00000100:00100000:2.0:1787826260.715868:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:160572:x1874663042993152:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 544us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826260.715879:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1044 00000100:00100000:1.0:1787826260.722305:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826260.725936:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042993408 00000100:00100000:0.0:1787826260.725961:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042993408 00000100:00100000:0.0:1787826260.726701:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1045 00000100:00100000:0.0:1787826260.726720:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:160572:x1874663042993408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826260.726748:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826260.726777:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced9be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f219 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826260.726921:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787826260.727063:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced9be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f219 expref: 12 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826260.727082:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fe600) 00010000:00010000:0.0:1787826260.727085:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826260.727091:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ced9be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f219 expref: 12 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826260.727106:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569000, rc 0) 00000100:00100000:0.0:1787826260.727283:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:160572:x1874663042993408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 568us (4994us total) trans 347892350982 rc 301/301 00000100:00100000:0.0:1787826260.727292:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1045 00000100:00100000:1.0:1787826260.731963:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826260.732035:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826260.732084:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826260.732112:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826260.732146:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826260.732199:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042993792 00000100:00100000:1.0:1787826260.732212:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042993792 00000100:00100000:1.0:1787826260.732300:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042993920 00000100:00100000:1.0:1787826260.732304:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042993920 00000100:00100000:1.0:1787826260.732395:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7074 00000100:00100000:1.0:1787826260.732411:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042993792:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826260.732520:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042993792:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 114us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826260.732530:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7074 00000100:00100000:1.0:1787826260.732552:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7075 00000100:00100000:2.0:1787826260.733267:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042993536 00000100:00100000:2.0:1787826260.733276:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042993536 00000100:00100000:2.0:1787826260.733347:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 103 00000100:00100000:2.0:1787826260.733357:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663042993536:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826260.733409:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663042993536:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 54us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826260.733417:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 103 00000100:00100000:3.0:1787826260.735158:0:187914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042994048 00000100:00100000:3.0:1787826260.735179:0:187914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042994048 00000100:00100000:3.0:1787826260.735266:0:187914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:3.0:1787826260.735279:0:187914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160572:x1874663042994048:12345-192.168.203.47@tcp:700:lfs.0 00000100:00080000:0.0:1787826260.735393:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826260.735401:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826260.735401:0:187914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160572:x1874663042994048:12345-192.168.203.47@tcp:700:lfs.0 Request processed in 124us (3253us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826260.735409:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826260.735413:0:187914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:0.0:1787826260.735436:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042993664 00000100:00100000:0.0:1787826260.735443:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042993664 00000100:00100000:0.0:1787826260.735481:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 291 00000100:00100000:0.0:1787826260.735489:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042993664:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826260.735522:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042993664:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 34us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826260.735530:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 291 00000100:00100000:1.0:1787826260.736718:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042993920:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826260.736796:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042993920:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 4232us (4679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826260.736806:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7075 00000100:00100000:2.0:1787826260.745061:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826260.745118:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042994304 00000100:00100000:2.0:1787826260.745133:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042994304 00000100:00100000:2.0:1787826260.745208:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1046 00000100:00100000:2.0:1787826260.745221:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160572:x1874663042994304:12345-192.168.203.47@tcp:36:lfs.0 00000100:00100000:2.0:1787826260.745433:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352192:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826260.745508:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826260.745557:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3446220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826260.745582:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049352192 00000100:00100000:2.0:1787826260.745587:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049352192 00000100:00100000:2.0:1787826260.745623:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12730 00000100:00100000:2.0:1787826260.745630:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187906:x1874663049352192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826260.745710:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187906:x1874663049352192:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826260.745718:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12730 00000100:00100000:2.0:1787826260.745770:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352192:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826260.745839:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352320:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826260.745863:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826260.745878:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3446220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826260.745892:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049352320 00000100:00100000:2.0:1787826260.745896:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049352320 00000100:00100000:2.0:1787826260.745918:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12731 00000100:00100000:2.0:1787826260.745924:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187906:x1874663049352320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826260.750195:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187906:x1874663049352320:12345-0@lo:1000:mdt00_002.0 Request processed in 4253us (4315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826260.750217:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12731 00000100:00100000:2.0:1787826260.750764:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352320:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826260.750879:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352448:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826260.750966:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826260.751020:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3446220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826260.751047:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049352448 00000100:00100000:2.0:1787826260.751055:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049352448 00000100:00100000:2.0:1787826260.751105:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12732 00000100:00100000:2.0:1787826260.751116:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187906:x1874663049352448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826260.751240:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187906:x1874663049352448:12345-0@lo:1000:mdt00_002.0 Request processed in 124us (275us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826260.751977:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12732 00000100:00100000:2.0:1787826260.752136:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352448:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787826260.752229:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.752308:0:187906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.752576:0:187906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826260.752599:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352576:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1787826260.752659:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826260.752697:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344622b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826260.753149:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049352576 00000100:00100000:2.0:1787826260.753159:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049352576 00000100:00100000:2.0:1787826260.753213:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12733 00000100:00100000:2.0:1787826260.753223:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187906:x1874663049352576:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787826260.753310:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826260.753366:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced9cc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.753615:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 2/0,1 mode: TXN/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.753630:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.753640:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 5/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.753677:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.753696:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 10 pid: 187905 timeout: 8427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826260.754188:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8415:1874663049352704:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826260.754700:0:8415:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1787826260.754812:0:8415:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787826260.754858:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3446220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826260.758039:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826260.758130:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042994432 00000100:00100000:2.0:1787826260.758145:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042994432 00010000:00010000:2.0:1787826260.758201:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 5/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 11 pid: 187905 timeout: 8427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826260.758248:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12228 00000100:00100000:2.0:1787826260.758260:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb450a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2391:x1874663042994432:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826260.758280:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826260.758290:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 5/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 11 pid: 187905 timeout: 8427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.758306:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 11 pid: 187905 timeout: 8427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.758361:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:2.0:1787826260.758370:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.758806:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826260.758892:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb450a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2391:x1874663042994432:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 632us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826260.758901:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12228 00010000:00010000:2.0:1787826260.759516:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3800/0x878a5eea00ced9b7 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f212 expref: 10 pid: 187905 timeout: 8427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826260.759537:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8415:1874663049352704:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826260.759575:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759586:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:2.0:1787826260.759589:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826260.759593:0:8415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759601:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2400, rc 0) 00000100:00100000:2.0:1787826260.759722:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:187906:x1874663049352576:12345-0@lo:101:mdt00_002.0 Request processed in 6469us (7031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826260.759731:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12733 00000001:00080000:2.0:1787826260.759825:0:193926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350982 is committed 00010000:00010000:2.0:1787826260.759864:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759873:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759881:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759891:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826260.759898:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759906:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759921:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8eb47f8fe000) 00010000:00010000:2.0:1787826260.759925:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826260.759929:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759936:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ced94e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759958:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759965:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 2/0,0 mode: TXN/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759972:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,0 mode: TXN/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759978:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826260.759981:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 3/0,0 mode: TXN/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.759987:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 4/0,0 mode: TXN/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.760011:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:2.0:1787826260.760013:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826260.760017:0:3603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.760028:0:3603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.760038:0:3603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826260.760078:0:3603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826260.760095:0:3603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3603:1874663049352832:0@lo:105: 00000100:00100000:2.0:1787826260.760146:0:3603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.760199:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049352832 00000100:00100000:2.0:1787826260.760203:0:3603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3446220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.760210:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049352832 00000100:00100000:2.0:1787826260.760239:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352576:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787826260.760258:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4772 00010000:00010000:2.0:1787826260.760261:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826260.760270:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3603:x1874663049352832:12345-0@lo:105: 00010000:00010000:2.0:1787826260.760277:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760284:0:6474:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760304:0:6474:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760313:0:6474:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760353:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 5/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760362:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760374:0:6474:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760396:0:6474:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb481ce2800) 00000100:00100000:3.0:1787826260.760437:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3603:x1874663049352832:12345-0@lo:105: Request processed in 171us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826260.760445:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4772 00000100:00100000:3.0:1787826260.760479:0:3603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3603:1874663049352832:0@lo:105: 00010000:00010000:3.0:1787826260.760494:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 2/0,0 mode: --/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760501:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ced955 lrc: 0/0,0 mode: --/TXN res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760524:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.760534:0:187906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826260.760558:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x2:0x0] 00010000:00010000:3.0:1787826260.762529:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.762547:0:187906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.762578:0:187906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826260.762609:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352960:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787826260.762687:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.762725:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4812529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.762761:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049352960 00000100:00100000:3.0:1787826260.762770:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049352960 00000100:00100000:3.0:1787826260.762832:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12734 00000100:00100000:3.0:1787826260.762843:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:187906:x1874663049352960:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787826260.762865:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826260.762886:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ced9e1 lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced9da expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.762917:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ced9e1 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced9da expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.762934:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ced9e1 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced9da expref: 8 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.762943:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0xf7117594 (ffff8eb47f8fd800) 00010000:00010000:3.0:1787826260.762947:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826260.762950:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39c00, rc 0) 00000100:00100000:3.0:1787826260.763006:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049352960:12345-0@lo:101:mdt00_002.0 Request processed in 164us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826260.763014:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12734 00000100:00100000:3.0:1787826260.763077:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049352960:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787826260.763094:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced9e1 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826260.763106:0:187906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced9e1 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826260.763125:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x2:0x0] 00000100:00100000:3.0:1787826260.763164:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353088:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763196:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.763214:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481252cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.763233:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049353088 00000100:00100000:3.0:1787826260.763237:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049353088 00000100:00100000:3.0:1787826260.763267:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12735 00000100:00100000:3.0:1787826260.763275:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763371:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353088:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826260.763379:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12735 00000100:00100000:3.0:1787826260.763407:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353088:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763450:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353216:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763475:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.763490:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481252cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.763502:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049353216 00000100:00100000:3.0:1787826260.763506:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049353216 00000100:00100000:3.0:1787826260.763527:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12736 00000100:00100000:3.0:1787826260.763535:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763619:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353216:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (143us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826260.763627:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12736 00000100:00100000:3.0:1787826260.763654:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353216:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763736:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353344:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763762:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.763776:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481252cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.763787:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049353344 00000100:00100000:3.0:1787826260.763791:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049353344 00000100:00100000:3.0:1787826260.763814:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12737 00000100:00100000:3.0:1787826260.763820:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763874:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353344:12345-0@lo:1000:mdt00_002.0 Request processed in 54us (111us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826260.763882:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12737 00000100:00100000:3.0:1787826260.763907:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353344:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763956:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353472:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.763985:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.766228:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481252cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826260.766448:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049353472 00000100:00100000:1.0:1787826260.766459:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049353472 00000100:00100000:1.0:1787826260.766558:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12738 00000100:00100000:1.0:1787826260.766636:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787826260.766766:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353472:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826260.766775:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12738 00000100:00100000:3.0:1787826260.766850:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353472:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.766946:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353600:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.767001:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.767020:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481252cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.767037:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049353600 00000100:00100000:3.0:1787826260.767041:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049353600 00000100:00100000:3.0:1787826260.767069:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12739 00000100:00100000:3.0:1787826260.767077:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.767146:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353600:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826260.767153:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12739 00000100:00100000:3.0:1787826260.767180:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353600:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.767219:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353728:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.767241:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.767255:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481252cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.767267:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049353728 00000100:00100000:3.0:1787826260.767270:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049353728 00000100:00100000:3.0:1787826260.767294:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12740 00000100:00100000:3.0:1787826260.767300:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.767386:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353728:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826260.767393:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12740 00000100:00100000:3.0:1787826260.767426:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353728:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787826260.767553:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353856:0@lo:700:mdt00_002.0 00000100:00100000:3.0:1787826260.767653:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.767671:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481252d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.767687:0:187914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049353856 00000100:00100000:3.0:1787826260.767691:0:187914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049353856 00000100:00100000:3.0:1787826260.767719:0:187914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787826260.767727:0:187914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353856:12345-0@lo:700:mdt00_002.0 00000100:00100000:3.0:1787826260.767772:0:187914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049353856:12345-0@lo:700:mdt00_002.0 Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826260.767779:0:187914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787826260.767808:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049353856:0@lo:700:mdt00_002.0 00000040:00080000:3.0:1787826260.767922:0:187906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826260.767944:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].7, 64 off33216 00000004:00080000:3.0:1787826260.767954:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb481252d80 with version 5 00000040:00080000:3.0:1787826260.768026:0:187906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826260.768037:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].8, 64 off33280 00000004:00080000:3.0:1787826260.768041:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb481252240 with version 6 00000004:00080000:3.0:1787826260.771858:0:187966:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb348d2e6c0 version 5 rpc_version 5 00000020:00100000:3.0:1787826260.771916:0:187966:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826260.771932:0:187966:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb47758f100 x1874663049354112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826260.771963:0:187966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049354112:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787826260.772072:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826260.772113:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826260.772147:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049354112 00000100:00100000:3.0:1787826260.772157:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049354112 00000100:00100000:3.0:1787826260.772218:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12741 00000100:00100000:3.0:1787826260.772230:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187966:x1874663049354112:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:3.0:1787826260.785719:0:187906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826260.785798:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].4, 64 off33024 00000040:00080000:3.0:1787826260.786147:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f5a:0x1:0x0].1, 1096 off33864 00000040:00080000:3.0:1787826260.786296:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027cd2:0x1:0x0].1, 1240 off34008 00000004:00080000:3.0:1787826260.786307:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb4812529c0 with version 7 00000001:00080000:2.0:1787826260.795188:0:193926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350983 is committed 00010000:02000000:2.0:1787826260.795263:0:8415:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00010000:00020000:2.0:1787826260.802268:0:8415:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8eb47758c380 x1874663049354112/t347892350983(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:616/0 lens 1312/4320 e 0 to 0 dl 1787826271 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826260.825753:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826260.853596:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187966:x1874663049354112:12345-0@lo:1000:osp_up0-1.0 Request processed in 81353us (81510us total) trans 347892350983 rc 0/0 00000100:00100000:2.0:1787826260.853620:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12741 00000001:00080000:2.0:1787826261.628960:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869984 is committed 00000100:00100000:2.0:1787826261.750418:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826261.750858:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042994560 00000100:00100000:3.0:1787826261.750871:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042994560 00000100:00100000:3.0:1787826261.750962:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1047 00000100:00100000:3.0:1787826261.750975:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:160582:x1874663042994560:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:3.0:1787826261.752529:0:188682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445625856 avail 1299386368 00000100:00100000:3.0:1787826261.752646:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:160582:x1874663042994560:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 1668us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826261.752657:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1047 00000100:00080000:1.0:1787826261.753084:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826261.770874:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826261.771001:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042994688 00000100:00100000:3.0:1787826261.771014:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042994688 00000100:00100000:3.0:1787826261.771091:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1048 00000100:00100000:3.0:1787826261.771101:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160582:x1874663042994688:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:3.0:1787826261.771154:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:3.0:1787826261.771236:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160582:x1874663042994688:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 135us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826261.771245:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1048 00000100:00100000:3.0:1787826261.777772:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826261.777842:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042994816 00000100:00100000:1.0:1787826261.777857:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042994816 00000100:00100000:1.0:1787826261.777938:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5828 00000100:00100000:1.0:1787826261.777951:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160582:x1874663042994816:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:1.0:1787826261.778007:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826261.778100:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160582:x1874663042994816:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 151us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826261.778112:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5828 00000100:00100000:3.0:1787826261.782968:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826261.783276:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042994944 00000100:00100000:1.0:1787826261.783291:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042994944 00000100:00100000:1.0:1787826261.783403:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5829 00000100:00100000:1.0:1787826261.783418:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160582:x1874663042994944:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:1.0:1787826261.783463:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826261.783559:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160582:x1874663042994944:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 144us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826261.783568:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5829 00010000:00010000:1.0:1787826261.849855:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826261.879537:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826261.879738:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042995200 00000100:00100000:3.0:1787826261.879752:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042995200 00000100:00100000:3.0:1787826261.879838:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1049 00000100:00100000:3.0:1787826261.879852:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:160589:x1874663042995200:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00010000:3.0:1787826261.879933:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826261.880096:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ced963 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1f6 expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.880121:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fe600) 00010000:00010000:3.0:1787826261.880133:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826261.880902:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.880922:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.880933:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.881031:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.881041:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.881048:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882816:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882834:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882843:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882850:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826261.882856:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882865:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882886:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fdd00) 00010000:00010000:3.0:1787826261.882890:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826261.882895:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882902:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38000/0x878a5eea00ced9e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826261.882923:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a19e1554 reply state 0000000028432999 transno 347892350984 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882938:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826261.882946:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fd500) 00010000:00010000:3.0:1787826261.882948:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826261.882952:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826261.883124:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:160589:x1874663042995200:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 3268us (3593us total) trans 347892350984 rc 0/0 00000100:00100000:3.0:1787826261.883135:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1049 00000100:00100000:3.0:1787826261.906630:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826261.907698:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042995328 00000100:00100000:1.0:1787826261.908252:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042995328 00000100:00100000:1.0:1787826261.908385:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1050 00000100:00100000:1.0:1787826261.908399:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:160592:x1874663042995328:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:1.0:1787826261.908432:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826261.908462:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced9f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f220 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826261.908819:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced9fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826261.908838:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826261.908851:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826261.908911:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787826261.908917:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826261.908944:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826261.908976:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65c00/0x878a5eea00ced9f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f220 expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826261.909010:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced9fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f220 expref: 9 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826261.909020:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481c35500) 00010000:00010000:1.0:1787826261.909023:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826261.909027:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65200, rc 0) 00000100:00100000:1.0:1787826261.909121:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:160592:x1874663042995328:12345-192.168.203.47@tcp:101:rm.0 Request processed in 723us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826261.909129:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1050 00000100:00100000:3.0:1787826261.912082:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826261.912245:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042995456 00000100:00100000:0.0:1787826261.912257:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042995456 00000100:00100000:0.0:1787826261.912398:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1051 00000100:00100000:0.0:1787826261.912412:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:160592:x1874663042995456:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826261.912439:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826261.912465:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ceda04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f227 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.912798:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.912817:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.912831:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.912845:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.912854:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.912861:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.912996:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceda19 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913006:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceda19 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913013:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceda19 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826261.913069:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x3:0x0]: returning size 0 00000004:00200000:0.0:1787826261.913073:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826261.913096:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceda19 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913110:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceda19 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913120:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913127:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913135:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913141:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826261.913146:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913155:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913240:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481c35500) 00010000:00010000:0.0:1787826261.913245:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826261.913249:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913256:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00ceda0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913273:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913279:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913284:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913289:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826261.913292:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913298:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913304:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fd500) 00010000:00010000:0.0:1787826261.913307:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826261.913310:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913315:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568400/0x878a5eea00ceda12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913465:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00ceda04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f227 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913671:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceda19 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f227 expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.913680:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x3:0x0].0x0 (ffff8eb472727b00) 00010000:00010000:0.0:1787826261.913682:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826261.913685:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569a00, rc 0) 00000100:00100000:0.0:1787826261.913862:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:160592:x1874663042995456:12345-192.168.203.47@tcp:101:rm.0 Request processed in 1451us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826261.913871:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1051 00000100:00100000:0.0:1787826261.918654:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826261.918793:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042995712 00000100:00100000:2.0:1787826261.918807:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042995712 00000100:00100000:2.0:1787826261.918877:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1052 00000100:00100000:2.0:1787826261.918890:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:160592:x1874663042995712:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826261.918962:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787826261.919006:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceda19 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f227 expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919029:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x3:0x0].0x0 (ffff8eb472727b00) 00010000:00010000:2.0:1787826261.919068:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65200/0x878a5eea00ced9fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f220 expref: 9 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919079:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb481c35500) 00010000:00010000:2.0:1787826261.919089:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826261.919119:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919135:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919147:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919160:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919293:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919301:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919488:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919564:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919573:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919954:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919965:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919973:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919990:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.919997:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920005:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920072:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826261.920097:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920104:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920110:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920114:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826261.920119:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920127:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920138:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x3:0x0].0x0 (ffff8eb448d12400) 00010000:00010000:2.0:1787826261.920141:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826261.920145:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920151:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2600/0x878a5eea00ceda2e lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920177:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920187:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920192:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920197:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826261.920200:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920206:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920213:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb448d12b00) 00010000:00010000:2.0:1787826261.920215:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826261.920218:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920223:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2c00/0x878a5eea00ceda20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826261.920236:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eff2b712 reply state 000000002d78965b transno 347892350985 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920248:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826261.920254:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fd500) 00010000:00010000:2.0:1787826261.920256:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826261.920260:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826261.920398:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:160592:x1874663042995712:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1508us (2031us total) trans 347892350985 rc 0/0 00000100:00100000:2.0:1787826261.920407:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1052 00010000:00010000:0.0:1787826261.922938:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826261.923032:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.923046:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826261.923052:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.923064:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.923087:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x3:0x0].0x0 (ffff8eb448d12400) 00010000:00010000:0.0:1787826261.923091:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826261.923097:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 1/0,0 mode: --/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.923102:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2000/0x878a5eea00ceda35 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826261.923127:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826261.923128:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826261.923130:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826262.356525:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826262.357086:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049354368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826262.357318:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826262.357625:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826262.357639:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049354496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826262.357678:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826262.357893:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049354240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826262.357925:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826262.358172:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049354368 00000100:00100000:0.0:1787826262.358271:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049354496 00000100:00100000:0.0:1787826262.358280:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049354496 00000100:00100000:2.0:1787826262.358424:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049354368 00000100:00080000:3.0:1787826262.358439:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826262.358463:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049354240 00000100:00100000:2.0:1787826262.358466:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049354240 00000100:00100000:3.0:1787826262.358473:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12742 00000100:00100000:2.0:1787826262.358495:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12743 00000100:00100000:2.0:1787826262.358502:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049354240:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826262.358506:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5830 00000100:00100000:0.0:1787826262.358513:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049354496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826262.358537:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000004:00000024:2.0:1787826262.358548:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:0.0:1787826262.358595:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049354496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826262.358595:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049354240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826262.358603:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5830 00000100:00100000:2.0:1787826262.358603:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12743 00000100:00100000:2.0:1787826262.358659:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049354496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826262.358688:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049354368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826262.358715:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445625856 avail 1299386368 00000100:00100000:3.0:1787826262.358765:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049354368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 283us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.358771:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12742 00000100:00100000:2.0:1787826262.359070:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049354240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826262.359101:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350983 gen 2 00000100:00100000:2.0:1787826262.359110:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049354368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826262.869994:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049354624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826262.870113:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826262.870187:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049354624 00000100:00100000:1.0:1787826262.870197:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049354624 00000100:00100000:1.0:1787826262.870275:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5831 00000100:00100000:1.0:1787826262.870287:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049354624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826262.870318:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826262.870394:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049354624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.870401:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5831 00000100:00100000:1.0:1787826262.870460:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049354624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826262.871075:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049354752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826262.871133:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826262.871194:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826262.871217:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049354752 00000100:00100000:0.0:1787826262.871223:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049354752 00000100:00100000:0.0:1787826262.871267:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5832 00000100:00100000:0.0:1787826262.871276:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049354752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826262.871292:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826262.871357:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049354752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826262.871364:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5832 00000100:00080000:0.0:1787826262.871388:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826262.871414:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049354752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787826262.873136:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826263.892881:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049354880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826263.892995:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826263.893083:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049354880 00000100:00100000:1.0:1787826263.893095:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049354880 00000100:00100000:1.0:1787826263.893188:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5833 00000100:00100000:1.0:1787826263.893203:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049354880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826263.893245:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00010000:00010000:3.0:1787826263.893566:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826263.893669:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826263.893869:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049354880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 668us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826263.893879:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5833 00000100:00100000:0.0:1787826263.894102:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049355264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.894151:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.894178:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049355776:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.894206:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.894224:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049356288:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.894246:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.894266:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787826263.894272:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049355136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.894295:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.894311:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049355648:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.894358:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.894376:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049356160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.894398:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.894422:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049355264 00000100:00100000:0.0:1787826263.894431:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049355264 00000100:00100000:0.0:1787826263.894475:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049356288 00000100:00100000:0.0:1787826263.894479:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049356288 00000100:00100000:0.0:1787826263.894492:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049355136 00000100:00100000:0.0:1787826263.894495:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049355136 00000100:00100000:0.0:1787826263.894509:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049355648 00000100:00100000:0.0:1787826263.894511:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049355648 00000100:00100000:0.0:1787826263.894522:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049356160 00000100:00100000:0.0:1787826263.894524:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049356160 00000100:00100000:0.0:1787826263.894538:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787826263.894548:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049355264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.894606:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049355264:12345-0@lo:400:kworker.0 Request processed in 58us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.894613:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787826263.894629:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787826263.894635:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049356288:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826263.894651:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481109c00 x1874663049356288/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:619/0 lens 224/224 e 0 to 0 dl 1787826274 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826263.894681:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049356288:12345-0@lo:400:kworker.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.894688:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787826263.894710:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787826263.894717:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049355136:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826263.894729:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481109f80 x1874663049355136/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:619/0 lens 224/224 e 0 to 0 dl 1787826274 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826263.894754:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049355136:12345-0@lo:400:kworker.0 Request processed in 38us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.894760:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787826263.894772:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787826263.894778:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049355648:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826263.894788:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb48110a680 x1874663049355648/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:619/0 lens 224/224 e 0 to 0 dl 1787826274 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826263.894814:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049355648:12345-0@lo:400:kworker.0 Request processed in 37us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.894820:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787826263.894831:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787826263.894836:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049356160:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826263.894846:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481108e00 x1874663049356160/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:619/0 lens 224/224 e 0 to 0 dl 1787826274 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826263.894876:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049356160:12345-0@lo:400:kworker.0 Request processed in 40us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.894883:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787826263.894905:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049355776 00000100:00100000:0.0:1787826263.894909:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049355776 00000100:00100000:0.0:1787826263.894941:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12744 00000100:00100000:0.0:1787826263.894948:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049355776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.894994:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049355776:12345-0@lo:400:kworker.0 Request processed in 47us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.895001:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12744 00000100:00080000:0.0:1787826263.895035:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826263.895039:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826263.895075:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049355136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895086:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049355648:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895095:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049356160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895105:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049355264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895115:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049355776:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895126:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049356288:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895420:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049355008:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895465:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.895498:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049355520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895524:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.895546:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049356032:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895567:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.895588:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826263.895594:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049355392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895618:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.895636:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049355904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.895671:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049356416:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895693:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826263.895718:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049355520 00000100:00100000:0.0:1787826263.895723:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049355520 00000100:00100000:0.0:1787826263.895754:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049356032 00000100:00100000:0.0:1787826263.895757:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049356032 00000100:00100000:0.0:1787826263.895775:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049355904 00000100:00100000:0.0:1787826263.895778:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049355904 00000100:00100000:0.0:1787826263.895797:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7076 00000100:00100000:0.0:1787826263.895804:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049355520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895852:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049355520:12345-0@lo:400:kworker.0 Request processed in 47us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.895858:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7076 00000100:00100000:0.0:1787826263.895874:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7077 00000100:00100000:0.0:1787826263.895880:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049356032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895908:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049356032:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.895914:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7077 00000100:00100000:0.0:1787826263.895926:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7078 00000100:00100000:0.0:1787826263.895932:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049355904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.895959:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049355904:12345-0@lo:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.895965:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7078 00000100:00100000:0.0:1787826263.895998:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049355392 00000100:00100000:0.0:1787826263.896002:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049355392 00000100:00100000:0.0:1787826263.896028:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12745 00000100:00100000:0.0:1787826263.896034:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049355392:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826263.896050:0:8414:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481109500 x1874663049355392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:619/0 lens 224/224 e 0 to 0 dl 1787826274 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826263.896077:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049355392:12345-0@lo:400:kworker.0 Request processed in 43us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.896082:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12745 00000100:00100000:0.0:1787826263.896127:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049355392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.896139:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049355904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.896148:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049355520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.896157:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049356032:0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.896181:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049356416 00000100:00100000:0.0:1787826263.896185:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049356416 00000100:00100000:0.0:1787826263.896217:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787826263.896224:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049356416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826263.896255:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049356416:12345-0@lo:400:kworker.0 Request processed in 31us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826263.896261:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1787826263.896282:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826263.896299:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049356416:0@lo:400:kworker.0 00000100:00100000:1.0:1787826263.896406:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049355008 00000100:00100000:1.0:1787826263.896411:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049355008 00000100:00100000:1.0:1787826263.896451:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787826263.896459:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049355008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826263.896503:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049355008:12345-0@lo:400:kworker.0 Request processed in 45us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826263.896510:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787826263.896551:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049355008:0@lo:400:kworker.0 00000100:00100000:2.0:1787826263.896717:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049354880:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826264.917392:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826265.852660:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826265.852705:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826265.852736:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826265.852768:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826265.852799:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826265.852835:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042995968 00000100:00100000:3.0:1787826265.852847:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042995968 00000100:00100000:3.0:1787826265.852917:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042996096 00000100:00100000:3.0:1787826265.852920:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042996096 00000100:00100000:3.0:1787826265.852947:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 298 00000100:00100000:3.0:1787826265.852972:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:2390:x1874663042995968:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:3.0:1787826265.853014:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348e5c000 x1874663042995968/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:621/0 lens 224/224 e 0 to 0 dl 1787826276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826265.853085:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:2390:x1874663042995968:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 128us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826265.853093:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 298 00000100:00100000:3.0:1787826265.853111:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 299 00000100:00100000:3.0:1787826265.853119:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663042996096:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826265.853158:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663042996096:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 40us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826265.853165:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 299 00000100:00100000:3.0:1787826265.853185:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042996224 00000100:00100000:3.0:1787826265.853188:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042996224 00000100:00100000:3.0:1787826265.853215:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042996352 00000100:00100000:3.0:1787826265.853218:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042996352 00000100:00100000:3.0:1787826265.853242:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7079 00000100:00100000:3.0:1787826265.853249:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042996224:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826265.853275:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663042996224:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826265.853282:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7079 00000100:00100000:3.0:1787826265.853293:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7080 00000100:00100000:3.0:1787826265.853299:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042996352:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826265.853319:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042996352:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 21us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826265.853357:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7080 00000100:00080000:3.0:1787826265.853379:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826265.853383:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826265.853386:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826265.853388:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826265.853859:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042995840 00000100:00100000:2.0:1787826265.853866:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042995840 00000100:00100000:2.0:1787826265.853911:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 105 00000100:00100000:2.0:1787826265.853919:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663042995840:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826265.853971:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663042995840:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 53us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826265.853978:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 105 00010000:00010000:0.0:1787826265.943890:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826266.965454:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826267.476510:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049356544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826267.476583:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826267.476839:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049356544 00000100:00100000:0.0:1787826267.476846:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049356544 00000100:00100000:2.0:1787826267.476914:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049356800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826267.476958:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826267.476982:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049356672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826267.477004:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826267.481176:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049356672 00000100:00100000:0.0:1787826267.481189:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049356672 00000100:00100000:1.0:1787826267.481360:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12746 00000100:00100000:1.0:1787826267.481373:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049356544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826267.481411:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:1.0:1787826267.481493:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049356544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826267.481501:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12746 00000100:00100000:1.0:1787826267.481527:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12747 00000100:00100000:1.0:1787826267.481533:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049356672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826267.481554:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445625856 avail 1299386368 00010000:00000080:1.0:1787826267.481565:0:8414:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e84fb80 x1874663049356672/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:623/0 lens 224/368 e 0 to 0 dl 1787826278 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826267.481710:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049356672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (4703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826267.481717:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12747 00000100:00100000:1.0:1787826267.481772:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049356544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826267.481867:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049356800 00000100:00100000:0.0:1787826267.481872:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049356800 00000100:00100000:0.0:1787826267.481916:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5834 00000100:00100000:0.0:1787826267.481923:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049356800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826267.481950:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826267.481985:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049356800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826267.481992:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5834 00000100:00080000:0.0:1787826267.482008:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826267.482474:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049356672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826267.482503:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049356800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787826267.988764:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826267.989347:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826267.989368:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049356928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826267.989436:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826267.989527:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049356928 00000100:00100000:0.0:1787826267.989536:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049356928 00000100:00100000:0.0:1787826267.989619:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5835 00000100:00100000:0.0:1787826267.989630:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049356928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826267.989659:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826267.989706:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049356928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826267.989712:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5835 00000100:00100000:0.0:1787826267.989761:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049356928:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787826267.989981:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826267.990233:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826267.990244:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049357056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826267.990279:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826267.990492:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049357056 00000100:00100000:0.0:1787826267.990498:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049357056 00000100:00100000:2.0:1787826267.990678:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5836 00000100:00100000:2.0:1787826267.990689:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049357056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826267.990705:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826267.990753:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049357056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826267.990760:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5836 00000100:00100000:1.0:1787826267.990891:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049357056:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787826267.990978:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787826268.210826:0:193926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350985 is committed 00010000:00010000:1.0:1787826268.210909:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.210922:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.210930:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.210946:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826268.210951:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.210959:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.210980:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fd500) 00010000:00010000:1.0:1787826268.210984:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826268.210989:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.210995:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ced9ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.211014:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.211019:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.211025:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.211031:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826268.211034:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.211040:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.211048:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fd500) 00010000:00010000:1.0:1787826268.211050:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826268.211053:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826268.211058:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce3600/0x878a5eea00ceda27 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826269.012755:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826269.012778:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049357184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826269.012846:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826269.012894:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049357184 00000100:00100000:2.0:1787826269.012903:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049357184 00000100:00080000:3.0:1787826269.012949:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826269.012961:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826269.012976:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5837 00000100:00100000:2.0:1787826269.012988:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049357184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826269.013010:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826269.013072:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049357184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826269.013079:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5837 00000100:00100000:3.0:1787826269.013173:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049357184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826269.014974:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049357440:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.015027:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049357696:0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.015039:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826269.015097:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049357312:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.023106:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826269.023113:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049357952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.023184:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049358208:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.023227:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826269.023246:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826269.023257:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049358720:0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.023275:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049358464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.023289:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826269.023344:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826269.023348:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787826269.023359:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049357568:0@lo:400:kworker.0 00000100:00100000:0.0:1787826269.023379:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826269.023881:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826269.023897:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049358080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.023921:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826269.023954:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049358592:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.023976:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826269.024007:0:193931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049357312 00000100:00100000:3.0:1787826269.024008:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049357440 00000100:00100000:1.0:1787826269.024016:0:193931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049357312 00000100:00100000:3.0:1787826269.024017:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049357440 00000100:00100000:3.0:1787826269.024063:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049357952 00000100:00100000:3.0:1787826269.024067:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049357952 00000100:00100000:1.0:1787826269.024069:0:193931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787826269.024082:0:193931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049357312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.024085:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049358720 00000100:00100000:3.0:1787826269.024090:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049358720 00000100:00100000:3.0:1787826269.024105:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049358464 00000100:00100000:3.0:1787826269.024109:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049358464 00000100:00100000:3.0:1787826269.024125:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049357568 00000100:00100000:3.0:1787826269.024129:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049357568 00000100:00100000:3.0:1787826269.024142:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049358592 00000100:00100000:1.0:1787826269.024151:0:193931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049357312:12345-0@lo:400:kworker.0 Request processed in 71us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826269.024157:0:193931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787826269.024191:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049358208 00000100:00100000:1.0:1787826269.024195:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049358208 00000100:00100000:1.0:1787826269.024223:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7081 00000100:00100000:1.0:1787826269.024229:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049358208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.024265:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049358208:12345-0@lo:400:kworker.0 Request processed in 36us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826269.024271:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7081 00000100:00100000:3.0:1787826269.026987:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049358592 00000100:00100000:3.0:1787826269.027052:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787826269.027062:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049357440:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826269.027087:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a428380 x1874663049357440/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:625/0 lens 224/224 e 0 to 0 dl 1787826280 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826269.028320:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049357312:0@lo:400:kworker.0 00000100:00100000:0.0:1787826269.028349:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049357824:0@lo:400:kworker.0 00000100:00100000:0.0:1787826269.028394:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826269.028488:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049358336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.032961:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049357440:12345-0@lo:400:kworker.0 Request processed in 5892us (17914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826269.032977:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787826269.033614:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049357696 00000100:00100000:3.0:1787826269.033633:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049357696 00000100:00100000:3.0:1787826269.033684:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049358080 00000100:00100000:3.0:1787826269.033688:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049358080 00000100:00100000:3.0:1787826269.033709:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12748 00000100:00100000:3.0:1787826269.033717:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049357696:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826269.033744:0:8414:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde3800 x1874663049357696/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:625/0 lens 224/224 e 0 to 0 dl 1787826280 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826269.033807:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049357696:12345-0@lo:400:kworker.0 Request processed in 90us (10711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826269.033813:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12748 00000100:00100000:3.0:1787826269.033825:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12749 00000100:00100000:3.0:1787826269.033831:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049358080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.033861:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049358080:12345-0@lo:400:kworker.0 Request processed in 31us (9940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826269.033870:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12749 00000100:00100000:3.0:1787826269.033893:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787826269.033900:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049357952:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826269.033912:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a42bb80 x1874663049357952/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:625/0 lens 224/224 e 0 to 0 dl 1787826280 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826269.033954:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049357952:12345-0@lo:400:kworker.0 Request processed in 54us (10709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826269.033960:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787826269.033973:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787826269.033980:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049358720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.034012:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049358720:12345-0@lo:400:kworker.0 Request processed in 34us (10725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826269.034052:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049357440:0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.034080:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049357952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.034862:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787826269.034871:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787826269.034880:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787826269.034888:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049357568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826269.034919:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049357568:12345-0@lo:400:kworker.0 Request processed in 34us (11041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826269.034923:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787826269.034941:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787826269.034949:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049358592:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826269.034966:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde0380 x1874663049358592/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:625/0 lens 224/224 e 0 to 0 dl 1787826280 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826269.034975:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826269.034983:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826269.034987:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826269.034999:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049358592:12345-0@lo:400:kworker.0 Request processed in 49us (11021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826269.035010:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787826269.035021:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049357568:0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.035037:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049358080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.035047:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049358592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.035057:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049357696:0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.035069:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049358208:0@lo:400:kworker.0 00000100:00100000:1.0:1787826269.035081:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049358720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826269.035431:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049358464:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826269.035450:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb476ca6680 x1874663049358464/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:625/0 lens 224/224 e 0 to 0 dl 1787826280 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826269.035497:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049358464:12345-0@lo:400:kworker.0 Request processed in 617us (12174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826269.035504:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787826269.035540:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049358464:0@lo:400:kworker.0 00000100:00100000:0.0:1787826269.036991:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049357824 00000100:00100000:0.0:1787826269.037004:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049357824 00000100:00100000:0.0:1787826269.037068:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7082 00000100:00100000:0.0:1787826269.037077:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049357824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826269.037140:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049357824:12345-0@lo:400:kworker.0 Request processed in 64us (8746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826269.037159:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7082 00000100:00100000:0.0:1787826269.037198:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826269.037220:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049358336 00000100:00100000:2.0:1787826269.037226:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049358336 00000100:00100000:2.0:1787826269.037267:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7083 00000100:00100000:0.0:1787826269.037273:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049357824:0@lo:400:kworker.0 00000100:00100000:2.0:1787826269.037279:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049358336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826269.037355:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049358336:12345-0@lo:400:kworker.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826269.037362:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7083 00000100:00080000:3.0:1787826269.037402:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826269.037407:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826269.037442:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049358336:0@lo:400:kworker.0 00000001:02000400:2.0:1787826269.232528:0:195707:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:1.0:1787826270.039074:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787826270.959476:0:195804:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787826270.959542:0:195804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.959556:0:195804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.959563:0:195804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.959569:0:195804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.959609:0:195804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787826270.959616:0:195804:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787826270.959645:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826270.959650:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787826270.959657:0:195804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787826270.959679:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb47984c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787826270.959970:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826270.959977:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826270.959986:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826270.959990:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826270.959999:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826270.960007:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826270.960012:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787826270.960014:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787826270.960017:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787826270.960042:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826270.960050:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826270.960090:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826270.960098:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481714a00/0x878a5eea00ced511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced518 expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826270.960110:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826270.960112:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826270.960114:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826270.960121:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826270.960139:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049358976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826270.960200:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826270.960254:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049358976 00000100:00100000:2.0:1787826270.960261:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049358976 00000100:00100000:2.0:1787826270.960308:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4229 00000100:00100000:2.0:1787826270.960318:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049358976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826270.960353:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826270.960381:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65000/0x878a5eea00ced518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced511 expref: 24 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826270.960394:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826270.960429:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3620:x1874663049358976:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826270.960436:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4229 00000100:00100000:2.0:1787826270.960475:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049358976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826270.963360:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049358848:0@lo:39:umount.0 00000100:00100000:3.0:1787826270.963432:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826270.963800:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049358848 00000100:00100000:1.0:1787826270.963809:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049358848 00000100:00100000:1.0:1787826270.963863:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1787826270.963874:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049358848:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826270.963913:0:187904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced5e3 00000100:00080000:1.0:1787826270.963939:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb3423ec000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1787826270.963968:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde2d80 x1874663049358848/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:665/0 lens 224/224 e 0 to 0 dl 1787826320 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826270.964017:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1874663049358848:12345-0@lo:39:umount.0 Request processed in 144us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826270.964025:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000020:00000080:1.0:1787826270.964038:0:187904:0:(genops.c:885:class_export_put()) final put ffff8eb3423e8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787826270.964604:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3423e8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787826270.964667:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3423ec000 for lustre-MDT0000 00010000:00010000:2.0:1787826270.966010:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826270.966058:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47984c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787826270.966081:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049358848:0@lo:39:umount.0 00000100:00080000:1.0:1787826270.966725:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826270.966730:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787826270.966736:0:195804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787826270.970050:0:195804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970069:0:195804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970078:0:195804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970085:0:195804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970103:0:195804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826270.970109:0:195804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970123:0:195804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970130:0:195804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970137:0:195804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970149:0:195804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787826270.970161:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826270.970166:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970174:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1787826270.970178:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970187:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826270.970195:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826270.970201:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826270.970203:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787826270.970236:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970247:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826270.970267:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970275:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e200/0x878a5eea00ced446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced44d expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970292:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826270.970295:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970301:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fc00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1787826270.970303:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970309:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826270.970315:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826270.970321:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826270.970345:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787826270.970347:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787826270.970362:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970368:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826270.970382:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970393:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8fc00/0x878a5eea00ced787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced78e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970402:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826270.970403:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826270.970405:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826270.970413:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826270.970430:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049359104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826270.970496:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826270.970552:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826270.970561:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049359232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826270.970586:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826270.970616:0:195804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970623:0:195804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970629:0:195804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970635:0:195804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970646:0:195804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826270.970651:0:195804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970662:0:195804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970667:0:195804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970672:0:195804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.970680:0:195804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787826270.970683:0:195804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787826270.970687:0:195804:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787826270.970713:0:195804:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787826270.970717:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1787826270.970720:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787826270.970726:0:195804:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1787826270.972864:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826270.972877:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.972899:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826270.972903:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.972913:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826270.972935:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826270.972941:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787826270.972943:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787826270.972947:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787826270.972989:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.972995:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826270.973015:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973023:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d65e00/0x878a5eea00ced503 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced50a expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973037:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826270.973041:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973046:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826270.973049:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973055:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826270.973061:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826270.973071:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826270.973073:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787826270.973075:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787826270.973091:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973097:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826270.973109:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973115:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481714600/0x878a5eea00ced438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ced43f expref: -99 pid: 193925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973125:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826270.973127:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826270.973129:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826270.973135:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826270.973154:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049359104 00000100:00100000:0.0:1787826270.973162:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049359104 00000100:00100000:0.0:1787826270.973217:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4230 00000100:00100000:0.0:1787826270.973227:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3619:x1874663049359104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826270.973241:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826270.973256:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64a00/0x878a5eea00ced44d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced446 expref: 23 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973267:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826270.973346:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3619:x1874663049359104:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (2850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826270.973354:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4230 00000100:00100000:0.0:1787826270.973525:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049359232 00000100:00100000:0.0:1787826270.973530:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049359232 00000100:00100000:0.0:1787826270.973568:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4231 00000100:00100000:0.0:1787826270.973586:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3618:x1874663049359232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826270.973594:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826270.973604:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a568800/0x878a5eea00ced78e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced787 expref: 22 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973614:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826270.973642:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3618:x1874663049359232:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (3055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826270.973648:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4231 00000100:00100000:0.0:1787826270.973666:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826270.973678:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049359360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826270.973714:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826270.973743:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826270.973751:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049359488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826270.973776:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826270.973800:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049359360 00000100:00100000:0.0:1787826270.973804:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049359360 00000100:00100000:0.0:1787826270.973825:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049359488 00000100:00100000:0.0:1787826270.973828:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049359488 00000100:00100000:0.0:1787826270.973843:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4232 00000100:00100000:0.0:1787826270.973848:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3617:x1874663049359360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826270.973855:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826270.973865:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64000/0x878a5eea00ced50a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced503 expref: 22 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.973876:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826270.974069:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3617:x1874663049359360:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826270.974075:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4232 00000100:00100000:0.0:1787826270.974089:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4233 00000100:00100000:0.0:1787826270.974095:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:3620:x1874663049359488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826270.974102:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826270.974112:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3a00/0x878a5eea00ced43f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced438 expref: 20 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.974121:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826270.974153:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3620:x1874663049359488:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826270.974161:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4233 00000100:00100000:0.0:1787826270.974199:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049359488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826270.974233:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049359232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826270.974262:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049359360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826270.974280:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049359104:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1787826270.978113:0:195804:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1787826270.978356:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1787826270.978366:0:195804:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb348a38000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787826270.978375:0:195804:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb442c2e800 c0d7758a-4501-4a89-8ec1-407fef4f0c7f 192.168.203.47@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 347892350985 stale:0 00000020:00080000:1.0:1787826270.978381:0:195804:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb3423eb000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787826270.978385:0:195804:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb479849000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787826270.978390:0:195804:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb448c98000 lustre-MDT0001-mdtlov_UUID 0@lo 7 (0 0 2) 0 0 0 0: 0000000000000000 347892350983 stale:0 00000020:00080000:1.0:1787826270.978394:0:195804:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8eb3449f3370) has exports, disconnecting them 00000020:00080000:1.0:1787826270.978399:0:195804:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb348a38000), last request at 1787826269 00000020:00000080:1.0:1787826270.978405:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced764 00000100:00080000:1.0:1787826270.978415:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb44908e000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787826270.978846:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787826270.978859:0:195804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb348a38000): rc 0 00000020:00000080:1.0:1787826270.978862:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb348a38000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787826270.978874:0:195804:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.47@tcp (ffff8eb442c2e800), last request at 1787826265 00000020:00000080:1.0:1787826270.979681:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced6ed 00000020:00010000:1.0:1787826270.979689:0:195804:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb442c2e800: total 1 00000100:00080000:1.0:1787826270.979694:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb472755000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787826270.979726:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a38000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826270.980002:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb44908e000 for lustre-MDT0000 00000020:00080000:1.0:1787826270.980051:0:195804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb442c2e800): rc 0 00000020:00080000:1.0:1787826270.980055:0:195804:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb3423eb000), last request at 1787826231 00000020:00000080:1.0:1787826270.980059:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced5dc 00000100:00080000:1.0:1787826270.980063:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb3423ef800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826270.980072:0:195804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb3423eb000): rc 0 00000020:00000080:1.0:1787826270.980074:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb3423eb000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787826270.980082:0:195804:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb479849000), last request at 1787826269 00000020:00000080:1.0:1787826270.980085:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced5d5 00000100:00080000:1.0:1787826270.980092:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb47984d800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787826270.980102:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3423eb000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826270.980126:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3423ef800 for lustre-MDT0000 00000020:00010000:1.0:1787826270.980143:0:66923:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb442c2e800: total 0 00010000:00010000:1.0:1787826270.980146:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826270.980191:0:66923:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb442c2e800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787826270.980225:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d64e00/0x878a5eea00ced97f lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1fd expref: 2 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.980240:0:66923:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb442c2e800, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1787826270.980963:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826270.980999:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826270.981029:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826270.981050:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826270.981078:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:0.0:1787826270.981098:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826270.981103:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826270.981119:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042996864 00000100:00100000:0.0:1787826270.981128:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042996864 00000100:00100000:0.0:1787826270.981176:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7084 00000100:00100000:0.0:1787826270.981186:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042996864:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826270.981254:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042996864:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826270.981262:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7084 00000100:00100000:0.0:1787826270.981278:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042996992 00000100:00100000:0.0:1787826270.981281:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042996992 00000100:00100000:0.0:1787826270.981305:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7085 00000100:00100000:0.0:1787826270.981312:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042996992:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826270.981355:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663042996992:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826270.981361:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7085 00010000:00010000:3.0:1787826270.981656:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826270.983466:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826270.983476:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1787826270.984024:0:195804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb479849000): rc 0 00000020:00000080:0.0:1787826270.984030:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb479849000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787826270.984046:0:195804:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb448c98000), last request at 1787826226 00000020:00000080:0.0:1787826270.984054:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced48c 00000020:00010000:0.0:1787826270.984066:0:195804:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb448c98000: total 1 00000100:00080000:0.0:1787826270.984071:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a7800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787826270.984095:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb448c98000: total 1 00010000:00010000:0.0:1787826270.984159:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb448c98000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787826270.984194:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481ce2400/0x878a5eea00ced9d3 lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.984225:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39c00/0x878a5eea00ced9e1 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced9da expref: 5 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826270.984244:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb448c98000, canceled 2 locks, left on hash table 0. 00000020:00000080:2.0:1787826270.988035:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb479849000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787826270.988097:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47984d800 for lustre-MDT0000 00000100:00100000:2.0:1787826270.988123:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042996608 00000100:00100000:2.0:1787826270.988133:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042996608 00000100:00100000:2.0:1787826270.988175:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042996736 00000100:00100000:2.0:1787826270.988179:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042996736 00000100:00100000:2.0:1787826270.988228:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 306 00000100:00100000:2.0:1787826270.988240:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663042996736:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826270.988320:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663042996736:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 82us (7268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826270.988343:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 306 00000100:00100000:2.0:1787826270.988363:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1054 00000100:00100000:2.0:1787826270.988368:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874663042996608:12345-192.168.203.47@tcp:400:kworker.0 00000020:00080000:2.0:1787826270.988374:0:187905:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.47@tcp 00000100:00100000:2.0:1787826270.988402:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874663042996608:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 32us (7443us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826270.988407:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1054 00000100:00100000:2.0:1787826270.988426:0:193937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042996480 00000100:00100000:2.0:1787826270.988431:0:193937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042996480 00000100:00100000:2.0:1787826270.988460:0:193937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 107 00000100:00100000:2.0:1787826270.988467:0:193937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663042996480:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826270.988492:0:193937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663042996480:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (7463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826270.988499:0:193937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 107 00000100:00080000:3.0:1787826270.990026:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00080000:2.0:1787826270.994106:0:195804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb448c98000): rc 0 00000004:00000080:2.0:1787826270.994120:0:195804:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb65b81d4fae0 00000100:00080000:2.0:1787826270.994144:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787826270.994148:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787826270.997462:0:195804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787826270.997495:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb47f953800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787826270.997552:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049359616:0@lo:39:umount.0 00000100:00100000:2.0:1787826270.999856:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826271.000722:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049359616 00000100:00100000:2.0:1787826271.000732:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049359616 00000100:00100000:2.0:1787826271.000780:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12750 00000100:00100000:2.0:1787826271.000791:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049359616:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787826271.000825:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4cb 00000100:00080000:2.0:1787826271.000834:0:8414:0:(import.c:65:import_set_state_nolock()) ffff8eb343734800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826271.000855:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 4, last_transno is 17179869984 00000100:00100000:2.0:1787826271.001812:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1874663049359616:12345-0@lo:39:umount.0 Request processed in 1019us (1959us total) trans 17179869985 rc 0/0 00000100:00100000:2.0:1787826271.001822:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12750 00000100:00100000:2.0:1787826271.002784:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:2.0:1787826271.002821:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826271.002836:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042997120 00000100:00100000:2.0:1787826271.002843:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042997120 00000100:00100000:2.0:1787826271.002875:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1055 00000100:00080000:3.0:1787826271.003040:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f953800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787826271.003049:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049359616:0@lo:39:umount.0 00000100:00100000:2.0:1787826271.003697:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042997120:12345-192.168.203.47@tcp:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787826271.003719:0:187905:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.47@tcp (stopping) 00000100:00100000:2.0:1787826271.015826:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663042997120:12345-192.168.203.47@tcp:38:ptlrpcd_00_00.0 Request processed in 12124us (13933us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826271.015841:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1055 00000100:00080000:3.0:1787826271.021675:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787826271.021683:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 3 00000004:00080000:3.0:1787826271.021696:0:195804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787826271.021752:0:195804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787826271.021779:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787826271.021796:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787826271.021798:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975536 gen 3 00000004:00080000:3.0:1787826271.021806:0:195804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787826271.021874:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049359744:0@lo:9:umount.0 00000100:00100000:3.0:1787826271.023066:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826271.023136:0:195804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787826271.023157:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb343217800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787826271.023185:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049359872:0@lo:9:umount.0 00000100:00100000:3.0:1787826271.023211:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787826271.023278:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb3449f3370) has no exports 00000100:00100000:2.0:1787826271.024078:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049359744 00000100:00100000:2.0:1787826271.024088:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049359744 00000100:00100000:2.0:1787826271.024146:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049359872 00000100:00100000:2.0:1787826271.024150:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049359872 00000100:00100000:2.0:1787826271.024176:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22599 00000100:00100000:2.0:1787826271.024187:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049359744:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787826271.024212:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced72c 00000100:00080000:2.0:1787826271.024227:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8eb443ea6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826271.024271:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705667 00000100:00100000:2.0:1787826271.024443:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049359744:12345-0@lo:9:umount.0 Request processed in 257us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826271.024452:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22599 00000100:00100000:2.0:1787826271.024468:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22600 00000100:00100000:2.0:1787826271.024477:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049359872:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787826271.024490:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4ee 00000100:00080000:2.0:1787826271.024496:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8eb47a6a0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826271.024518:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975536 00000100:00080000:3.0:1787826271.026029:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826271.026038:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826271.026258:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049359872:12345-0@lo:9:umount.0 Request processed in 1778us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826271.026269:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22600 00010000:00010000:2.0:1787826271.026401:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826271.026408:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826271.026471:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343217800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787826271.026486:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787826271.026488:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826271.026492:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049359872:0@lo:9:umount.0 00000100:00080000:2.0:1787826271.026506:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343732000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787826271.026514:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787826271.026515:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826271.026518:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049359744:0@lo:9:umount.0 00000020:00080000:3.0:1787826271.026799:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb3449f3370) has no exports 00000020:00000080:1.0:1787826271.040991:0:66923:0:(genops.c:885:class_export_put()) final put ffff8eb442c2e800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00010000:00010000:1.0:1787826271.041047:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826271.041050:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826271.041053:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826271.041134:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb442c2e800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f for lustre-MDT0000 00000020:00000080:2.0:1787826271.041198:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb472755000 for lustre-MDT0000 00000020:00000080:0.0:1787826271.047979:0:6478:0:(genops.c:885:class_export_put()) final put ffff8eb448c98000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1787826271.051436:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826271.051442:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826271.051445:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826271.052222:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c98000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787826271.056970:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f9a7800 for lustre-MDT0000 00000020:00000080:3.0:1787826271.082205:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4a1 00000020:00000080:3.0:1787826271.082221:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb3434f5000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787826271.082287:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00010000:00010000:1.0:1787826271.082561:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826271.082766:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3434f5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787826271.082788:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826271.082800:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787826271.082805:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8eb344e619b8) has no exports 00000020:00000080:2.0:1787826271.083209:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced49a 00000020:00000080:2.0:1787826271.083216:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb3496a8800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826271.083280:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3496a8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826271.083516:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826271.083525:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787826271.083528:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb47a4ed000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787826271.083531:0:195804:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a4ed000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787826271.083536:0:195804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787826271.083805:0:195804:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb344f2b600 - data ffff8eb4479ba798/ffff8eb4771a3400 00000020:01000000:2.0:1787826271.084034:0:195804:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb477eeac00 - data ffff8eb447aff288/ffff8eb477447400 00000100:00080000:2.0:1787826271.138915:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787826271.138935:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787826271.138950:0:195804:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb46e84f100 x1874663049359616/t17179869985(17179869985) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826280 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826271.138975:0:195804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787826271.140229:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787826271.140235:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 4 00000004:00080000:2.0:1787826271.140255:0:195804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826271.140258:0:195804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787826271.140741:0:193944:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787826271.140746:0:193944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x144:0x0] index 2 count 1 00000040:00080000:0.0:1787826271.140756:0:193944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 81 count 2 00000100:00080000:2.0:1787826271.141448:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787826271.141453:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975536 gen 4 00000004:00080000:2.0:1787826271.141505:0:195804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826271.141508:0:195804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787826271.143597:0:193946:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787826271.143603:0:193946:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x146:0x0] index 1 count 1 00000040:00080000:0.0:1787826271.143614:0:193946:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 81 count 2 00000020:00000080:2.0:1787826271.144650:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced462 00000020:00000080:2.0:1787826271.144661:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb3434f1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826271.144754:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3434f1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826271.145517:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced477 00000020:00000080:2.0:1787826271.145524:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb472784800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787826271.145572:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787826271.145578:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826271.145587:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787826271.145592:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8eb3449f0000) has no exports 00000004:01000000:2.0:1787826271.145784:0:195804:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787826271.145793:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4e7 00000020:00000080:2.0:1787826271.145798:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb44905c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826271.146211:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb472784800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787826271.146750:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb44905c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787826271.151748:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787826271.151764:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826271.151776:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787826271.151782:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8eb46a870000) has no exports 00000020:00000080:2.0:1787826271.151791:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4e0 00000020:00000080:2.0:1787826271.151800:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb343212000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787826271.152204:0:195804:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787826271.152208:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787826271.152213:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975536 gen 5 00000004:00080000:2.0:1787826271.152219:0:195804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826271.152221:0:195804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826271.152256:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826271.152263:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826271.152269:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4d2 00000020:00000080:2.0:1787826271.152275:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb46a6c6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787826271.152278:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787826271.152283:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826271.152286:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787826271.152288:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8eb46a874d28) has no exports 00000020:00000080:2.0:1787826271.152292:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4c4 00000020:00000080:2.0:1787826271.152294:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb343737800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787826271.152632:0:195804:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787826271.152635:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787826271.152637:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 5 00000004:00080000:2.0:1787826271.152641:0:195804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826271.152643:0:195804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826271.152669:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826271.152674:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787826271.152685:0:195804:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787826271.152691:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4b6 00000020:00000080:2.0:1787826271.152695:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb46a6c2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787826271.152699:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787826271.152702:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826271.152706:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787826271.152709:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8eb344e60000) has no exports 00000020:00000080:2.0:1787826271.152712:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced4af 00000020:00000080:2.0:1787826271.152715:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb47f951800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826271.153528:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343212000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826271.153540:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb343217800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787826271.153548:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb3434f5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826271.153551:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3434f5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787826271.153556:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826271.153645:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46a6c6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787826271.153651:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343737800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787826271.153656:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb343732000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787826271.153659:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb46a6c7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826271.153662:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46a6c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787826271.153664:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826271.153695:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46a6c2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787826271.153699:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f951800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787826271.194390:0:195804:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787826271.194399:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826271.194403:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787826271.194412:0:195804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826271.194477:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826271.194490:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826271.194514:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826271.194517:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826271.194523:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb343640000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826271.194528:0:195804:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343640000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787826271.194540:0:195804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826271.194645:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced47e 00000020:00000080:0.0:1787826271.194651:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb472783000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787826271.194656:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787826271.194660:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826271.194665:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826271.194668:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8eb3449f19b8) has no exports 00000020:00000080:0.0:1787826271.194698:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826271.194702:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787826271.194707:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced485 00000020:00000080:0.0:1787826271.194711:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb472786000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787826271.194717:0:195804:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb477f6b800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787826271.194721:0:195804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb477f6b800 3 00000020:01000004:0.0:1787826271.194724:0:195804:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb477f6b800 from lustre-MDT0000 00000020:00000080:0.0:1787826271.194742:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826271.194745:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787826271.194748:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb3434f4000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787826271.194750:0:195804:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3434f4000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787826271.194758:0:195804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787826271.194790:0:195804:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787826271.194793:0:195804:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787826271.194796:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787826271.194799:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826271.194802:0:195804:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787826271.194810:0:195804:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb47bfd2800 f40147eb-9b53-47d4-b77c-99ceedd9664c 192.168.203.47@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826271.194816:0:195804:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb3426a9800 205ad83e-e455-4070-92a2-f1e25b8f3f40 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826271.194820:0:195804:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8eb341a68000) has exports, disconnecting them 00000020:00080000:0.0:1787826271.194825:0:195804:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.47@tcp (ffff8eb47bfd2800), last request at 1787826234 00000020:00000080:0.0:1787826271.194846:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced6ca 00000020:00010000:0.0:1787826271.194851:0:195804:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb47bfd2800: total 2 00000100:00080000:0.0:1787826271.194854:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb47bfd1800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826271.194865:0:195804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb47bfd2800): rc 0 00000020:00080000:0.0:1787826271.194868:0:195804:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8eb3426a9800), last request at 1787826226 00000020:00000080:0.0:1787826271.194912:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced42a 00000020:00010000:0.0:1787826271.194929:0:195804:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb3426a9800: total 2 00000100:00080000:0.0:1787826271.194932:0:195804:0:(import.c:65:import_set_state_nolock()) ffff8eb3426a9000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826271.194939:0:195804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb3426a9800): rc 0 00000020:00080000:0.0:1787826271.194943:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8eb341a68000) has no exports 00000100:00100000:1.0:1787826271.195109:0:193931:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8eb3436fe000:193931] 0 exiting: rc = 1 00000100:00100000:1.0:1787826271.195199:0:193933:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8eb3436ffe00:193933] 2 exiting: rc = 0 00000020:00000080:1.0:1787826271.195240:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f953800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787826271.195246:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb3434f2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826271.195248:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3434f2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787826271.195253:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826271.195305:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb472783000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787826271.195309:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb3434f2800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787826271.195311:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3434f2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787826271.195315:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787826271.195370:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb472786000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1787826271.195382:0:66923:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb47bfd2800: total 0 00010000:00010000:1.0:1787826271.195401:0:66923:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb47bfd2800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1787826271.195429:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8f000/0x878a5eea00ced6d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f14e expref: 5 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195447:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a568200/0x878a5eea00ced7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f1b7 expref: 4 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195459:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8ec00/0x878a5eea00ced6d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f147 expref: 3 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195472:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8f400/0x878a5eea00ced6e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f186 expref: 2 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195481:0:66923:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb47bfd2800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1787826271.195499:0:66923:0:(genops.c:885:class_export_put()) final put ffff8eb47bfd2800/f40147eb-9b53-47d4-b77c-99ceedd9664c 00000020:00010000:1.0:1787826271.195511:0:66923:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb3426a9800: total 1 00010000:00010000:1.0:1787826271.195528:0:66923:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb3426a9800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787826271.195544:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3400/0x878a5eea00ced588 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced581 expref: 14 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195556:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8e800/0x878a5eea00ced596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced58f expref: 13 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195568:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a568000/0x878a5eea00ced717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced710 expref: 12 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195579:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3e00/0x878a5eea00ced5a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced59d expref: 11 pid: 193932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195590:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481715800/0x878a5eea00ced74f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced748 expref: 10 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195600:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3200/0x878a5eea00ced5b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced5ab expref: 9 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195611:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a569800/0x878a5eea00ced741 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced73a expref: 8 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195626:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714400/0x878a5eea00ced550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced549 expref: 7 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195637:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481715400/0x878a5eea00ced5ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced5c7 expref: 6 pid: 193937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195647:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce2e00/0x878a5eea00ced79c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced795 expref: 5 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195659:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481714e00/0x878a5eea00ced5c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced5b9 expref: 4 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195669:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8f600/0x878a5eea00ced57a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced573 expref: 3 pid: 193931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195693:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb47fa8e000/0x878a5eea00ced56c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced565 expref: 2 pid: 193933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826271.195705:0:66923:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb3426a9800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787826271.195718:0:66923:0:(genops.c:885:class_export_put()) final put ffff8eb3426a9800/205ad83e-e455-4070-92a2-f1e25b8f3f40 00010000:00010000:1.0:1787826271.195723:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826271.195725:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826271.195727:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826271.195833:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47bfd2800/f40147eb-9b53-47d4-b77c-99ceedd9664c for MGS 00000020:00000080:0.0:1787826271.195866:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3426a9800/205ad83e-e455-4070-92a2-f1e25b8f3f40 for MGS 00000020:00000080:0.0:1787826271.195879:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47bfd1800 for MGS 00000020:00000080:0.0:1787826271.195883:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3426a9000 for MGS 00010000:00010000:2.0:1787826271.198186:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826271.198236:0:193937:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8eb345709a00:193937] 3 exiting: rc = 0 00000100:00100000:2.0:1787826271.198451:0:193932:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8eb3436fee00:193932] 1 exiting: rc = 0 00000100:00100000:0.0:1787826271.198948:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.198958:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.198964:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.198970:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.198976:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.198983:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.198988:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.198994:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199000:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199007:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199013:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199020:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199027:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199034:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199040:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199047:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199052:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199057:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199064:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199069:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199075:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199081:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199086:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199092:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199098:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199104:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199110:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199115:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199121:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199127:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199133:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199140:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199145:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199149:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199154:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199160:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199166:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199173:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199179:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199186:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199192:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199198:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199205:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199211:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199217:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199223:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199229:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199235:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199240:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199246:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199251:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199257:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199263:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199268:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199274:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199280:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199286:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199293:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199298:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199305:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199311:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199316:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199424:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826271.199434:0:195804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787826271.200234:0:195804:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb344451ae0 - data ffff8eb4720ef1b0/ffff8eb47743e400 00000020:01000000:0.0:1787826271.200391:0:195804:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb344f2bcc0 - data ffff8eb4478775e8/ffff8eb345505800 00000020:00000080:0.0:1787826271.200911:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced423 00000020:00000080:0.0:1787826271.200929:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb3431bf800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787826271.200942:0:195804:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb477f6b800 from MGS, refs=2 00000020:01000004:0.0:1787826271.200946:0:195804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb477f6b800 2 00000020:01000004:0.0:1787826271.200949:0:195804:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb477f6b800 from MGS 00000020:00000080:0.0:1787826271.200972:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826271.200978:0:195804:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787826271.200981:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb3431bc000/MGS 00000020:00000080:0.0:1787826271.200984:0:195804:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3431bc000/MGS for MGS 00000020:01000000:0.0:1787826271.200990:0:195804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787826271.201055:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787826271.201058:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826271.201064:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826271.201071:0:195804:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8eb479848000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826271.201077:0:195804:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8eb481d9b370) has exports, disconnecting them 00000020:00080000:0.0:1787826271.201082:0:195804:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8eb479848000), last request at 1787826226 00000020:00000080:0.0:1787826271.201086:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced526 00000020:00080000:0.0:1787826271.201095:0:195804:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb479848000): rc 0 00000020:00000080:0.0:1787826271.201100:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb479848000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787826271.201416:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3431bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787826271.201424:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb479848000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787826271.204398:0:195804:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787826271.204406:0:195804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826271.204410:0:195804:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787826271.204417:0:195804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826271.204579:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826271.204588:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787826271.204595:0:195804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb477f6b800 1 00000020:00000080:1.0:1787826271.204601:0:195804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced415 00000020:00000080:1.0:1787826271.204610:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb3431b9000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787826271.204614:0:195804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787826271.204619:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826271.204622:0:195804:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787826271.204626:0:195804:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8eb46a8719b8) has no exports 00000020:00000080:2.0:1787826271.205665:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47984c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787826271.205676:0:179516:0:(genops.c:885:class_export_put()) final put ffff8eb3434f1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787826271.205679:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3434f1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787826271.205686:0:179516:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787826271.205764:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3431b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787826271.232111:0:195804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826271.232124:0:195804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787826271.232129:0:195804:0:(genops.c:885:class_export_put()) final put ffff8eb477f6d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787826271.232134:0:195804:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb477f6d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787826271.232146:0:195804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787826271.232268:0:195804:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8eb477f6e800 00000020:02000400:1.0:1787826271.232350:0:195804:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787826272.085298:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826272.087645:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 1 seconds 00000100:00100000:1.0:1787826272.600843:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049360000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826272.600926:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826272.600988:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049360000 00000100:00100000:1.0:1787826272.600995:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049360000 00000100:00100000:1.0:1787826272.601029:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12751 00000100:00100000:1.0:1787826272.601037:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1874663049360000:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787826272.601045:0:177386:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826272.601084:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1874663049360000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (158us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826272.601091:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12751 00000100:02020000:1.0:1787826272.601185:0:3620:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787826272.601190:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826272.601195:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826272.601199:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787826272.601216:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826272.601220:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8298 00000100:00080000:1.0:1787826272.601227:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826272.601248:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34ddd7b80 x1874663049360128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826272.601501:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049360128:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787826272.601543:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826272.601902:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049360128 00000100:00100000:3.0:1787826272.601919:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049360128 00000100:00100000:3.0:1787826272.601946:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12752 00000100:00100000:3.0:1787826272.601952:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049360128:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1787826272.602043:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826272.622216:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049360128:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 20254us (20663us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826272.622231:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12752 00000100:00080000:3.0:1787826272.622290:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826272.622296:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826272.622300:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049360128:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1787826273.108770:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826273.110847:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049360256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826273.110932:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826273.111380:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 1 seconds 00000100:00100000:2.0:1787826273.112418:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049360256 00000100:00100000:2.0:1787826273.112431:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049360256 00000100:00100000:2.0:1787826273.112504:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5838 00000100:00100000:2.0:1787826273.112515:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049360256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826273.112544:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826273.112616:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049360256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826273.112624:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5838 00000100:00080000:2.0:1787826273.112655:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826273.112764:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049360256:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787826274.134099:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826274.134106:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1787826274.134107:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049360384:0@lo:400:kworker.0 00000100:00080000:1.0:1787826274.134111:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826274.134120:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8339 00000100:00080000:1.0:1787826274.134127:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826274.134133:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826274.134156:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34ddd5c00 x1874663049360896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1787826274.134170:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049360384 offset 0 length 224: 4 00000100:00100000:1.0:1787826274.134231:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049360768:0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.134232:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049361024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826274.134349:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 1 seconds 00000100:00100000:0.0:1787826274.134385:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049360512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826274.143196:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826274.143272:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049361536:0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.143345:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826274.143397:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049360896:0@lo:38:kworker.0 00000100:00100000:3.0:1787826274.143429:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826274.143856:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049360896 00000100:00100000:3.0:1787826274.143866:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049360896 00000100:00100000:3.0:1787826274.143913:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12753 00000100:00100000:3.0:1787826274.143921:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049360896:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826274.143943:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826274.143990:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049360896:12345-0@lo:38:kworker.0 Request processed in 68us (559us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826274.143998:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12753 00000100:00080000:3.0:1787826274.144281:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826274.144370:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826274.144374:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049360896:0@lo:38:kworker.0 00000100:00100000:3.0:1787826274.144416:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049361536 00000100:00100000:3.0:1787826274.144421:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049361536 00000100:00100000:3.0:1787826274.144461:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787826274.144585:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049361536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.144640:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049361536:12345-0@lo:400:kworker.0 Request processed in 173us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826274.144647:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:3.0:1787826274.144666:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826274.144693:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049361536:0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.144728:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049361024 00000100:00100000:3.0:1787826274.144732:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049361024 00000100:00100000:3.0:1787826274.144763:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7086 00000100:00100000:3.0:1787826274.144770:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049361024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.144811:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049361024:12345-0@lo:400:kworker.0 Request processed in 42us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826274.144817:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7086 00000100:00100000:3.0:1787826274.144839:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049360640:0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.144868:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826274.144888:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049361280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.144931:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826274.144963:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049360640 00000100:00100000:3.0:1787826274.144966:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049360640 00000100:00100000:3.0:1787826274.144984:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049361280 00000100:00100000:3.0:1787826274.144987:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049361280 00000100:00100000:3.0:1787826274.144998:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1787826274.145003:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1874663049360640:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787826274.145008:0:188682:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826274.145038:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1874663049360640:12345-0@lo:400:kworker.0 Request processed in 33us (169us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826274.146498:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826274.146535:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049361408:0@lo:400:kworker.0 00000100:00100000:1.0:1787826274.146572:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826274.146609:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826274.147262:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049360768 00000100:00100000:1.0:1787826274.147271:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049360768 00000100:00100000:1.0:1787826274.147316:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049361408 00000100:00100000:1.0:1787826274.147319:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049361408 00000100:00100000:1.0:1787826274.147357:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787826274.147877:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049360768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826274.147972:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049360768:12345-0@lo:400:kworker.0 Request processed in 607us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826274.147982:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787826274.148006:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1787826274.148011:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1874663049361280:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826274.148018:0:188992:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826274.148047:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1874663049361280:12345-0@lo:400:kworker.0 Request processed in 34us (3116us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826274.148052:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1787826274.148064:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1787826274.148067:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1874663049361408:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826274.148071:0:188992:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826274.148089:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1874663049361408:12345-0@lo:400:kworker.0 Request processed in 20us (1516us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826274.148093:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1787826274.148139:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049361024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.150062:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:3.0:1787826274.150371:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826274.150415:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787826274.150420:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787826274.150424:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787826274.150429:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826274.150433:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8298 00000100:00080000:3.0:1787826274.150440:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826274.150733:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47a1ff800 x1874663049361664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826274.150770:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049360640:0@lo:400:kworker.0 00000100:00080000:3.0:1787826274.150786:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787826274.150788:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787826274.150791:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787826274.150794:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826274.150797:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8298 00000100:00080000:3.0:1787826274.150801:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826274.150818:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47a1fc700 x1874663049361792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826274.150827:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049361280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.150864:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049361664:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787826274.150930:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826274.150964:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049361792:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787826274.150985:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826274.151022:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049361664 00000100:00100000:3.0:1787826274.151028:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049361664 00000100:00100000:3.0:1787826274.151066:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049361792 00000100:00100000:3.0:1787826274.151069:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049361792 00000100:00100000:3.0:1787826274.151080:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1787826274.151086:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049361664:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1787826274.151105:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826274.151445:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1787826274.151453:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049361792:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1787826274.151466:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826274.151518:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049361792:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 64us (530us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826274.151525:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1787826274.151565:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049360768:0@lo:400:kworker.0 00000100:00080000:1.0:1787826274.151579:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826274.151583:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826274.151587:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787826274.151591:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826274.151595:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8309 00000100:00080000:1.0:1787826274.151601:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826274.151618:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4815e2300 x1874663049361920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826274.151631:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049361408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826274.152283:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049361664:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1194us (1351us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826274.154213:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1787826274.154271:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049361920:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787826274.154420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826274.154516:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826274.154522:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826274.154526:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049361664:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1787826274.154535:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826274.154538:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826274.154541:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049361792:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787826274.154764:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049361920 00000100:00100000:1.0:1787826274.154772:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049361920 00000100:00100000:1.0:1787826274.154803:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1787826274.154810:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049361920:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787826274.154833:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826274.154868:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826274.154892:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049361920:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 79us (470us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826274.154910:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1787826274.154918:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049361152:0@lo:400:kworker.0 00000100:00080000:2.0:1787826274.154939:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787826274.154943:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049360512 00000100:00080000:2.0:1787826274.154945:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826274.154947:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049360512 00000100:00100000:2.0:1787826274.154948:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049361920:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787826274.154956:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826274.154996:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5839 00000100:00100000:0.0:1787826274.155002:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049361152 00000100:00100000:1.0:1787826274.155007:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049360512:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826274.155009:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049361152 00000100:00080000:2.0:1787826274.155015:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787826274.155037:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826274.155064:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7087 00000100:00100000:0.0:1787826274.155076:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049361152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826274.155097:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049360512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826274.155104:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5839 00000100:00100000:0.0:1787826274.155117:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049361152:12345-0@lo:400:kworker.0 Request processed in 44us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826274.155125:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7087 00000100:00100000:0.0:1787826274.155169:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049360512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826274.155179:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049361152:0@lo:400:kworker.0 00000100:00100000:0.0:1787826275.156452:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 1 seconds 00010000:00010000:2.0:1787826275.160531:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1787826276.093970:0:3612:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042997248 offset 0 length 224: 4 00000100:00100000:2.0:1787826276.094020:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826276.094248:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042997376 00000100:00100000:1.0:1787826276.094258:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042997376 00000100:00100000:1.0:1787826276.094313:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1062 00000100:00100000:1.0:1787826276.094321:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042997376:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:1.0:1787826276.094385:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826276.094456:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042997376:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 133us (434us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826276.094463:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1062 00000100:00100000:3.0:1787826276.098977:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826276.099154:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042997504 00000100:00100000:0.0:1787826276.099170:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042997504 00000100:00100000:0.0:1787826276.099260:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 309 00000100:00100000:0.0:1787826276.099272:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2391:x1874663042997504:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826276.099414:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2391:x1874663042997504:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 143us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826276.099422:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 309 00000100:00080000:2.0:1787826276.099788:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826276.120524:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826276.122297:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042997760 00000100:00100000:0.0:1787826276.122314:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042997760 00000100:00100000:0.0:1787826276.122572:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7088 00000100:00100000:0.0:1787826276.122583:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042997760:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826276.122676:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663042997760:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 95us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826276.122685:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7088 00000100:00080000:2.0:1787826276.125416:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826276.135185:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826276.135831:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042997632 00000100:00100000:0.0:1787826276.135841:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042997632 00000100:00100000:0.0:1787826276.135931:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7089 00000100:00100000:0.0:1787826276.135942:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042997632:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826276.136031:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042997632:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 90us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826276.136039:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7089 00000100:00080000:2.0:1787826276.136151:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00000400:3.0:1787826276.180957:0:187966:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826260/real 1787826260] req@ffff8eb47758f100 x1874663049354112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 1 dl 1787826276 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826276.180990:0:187966:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8eb48165c000 already not connected (conn 29, was 27): DISCONN 00000100:00100000:3.0:1787826276.180994:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787826276.181058:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826277.204444:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787826277.204609:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787826277.213087:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826277.213096:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb343211000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787826277.213150:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826277.213154:0:194610:0:(genops.c:885:class_export_put()) final put ffff8eb349797800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826277.213220:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343211000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787826277.213270:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb349797800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787826277.213286:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47a6a0800 for lustre-OST0001 00000020:00000080:3.0:1787826277.213291:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb443ea6000 for lustre-OST0000 00000001:00100000:0.0:1787826277.217030:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787826277.217048:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869985 is committed 00000020:00000080:0.0:1787826277.217054:0:187942:0:(genops.c:885:class_export_put()) final put ffff8eb343730000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826277.222417:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb343730000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787826277.222583:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb343734800 for lustre-MDT0001 00010000:00010000:1.0:1787826278.229055:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826278.229109:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:0.0:1787826278.229586:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049362048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826278.229661:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826278.229781:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049362048 00000100:00100000:1.0:1787826278.229789:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049362048 00000100:00080000:3.0:1787826278.229820:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826278.229846:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5840 00000100:00100000:1.0:1787826278.229856:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049362048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826278.229895:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826278.230376:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049362048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 519us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826278.230384:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5840 00000100:00100000:0.0:1787826278.230522:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049362048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826279.252453:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00080000:1.0:1787826279.253118:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826279.253124:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826279.253128:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826279.253135:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8340 00000100:00080000:1.0:1787826279.253141:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826279.253147:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826279.253169:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4815e3480 x1874663049362304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826279.253178:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049362176:0@lo:400:kworker.0 00000100:00080000:1.0:1787826279.253198:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826279.253201:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826279.253202:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826279.253205:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8340 00000100:00080000:1.0:1787826279.253208:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787826279.253211:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826279.253221:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4815e2300 x1874663049362560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1787826279.253229:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049362176 offset 0 length 224: 4 00000100:00080000:1.0:1787826279.253239:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826279.253242:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826279.253243:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826279.253246:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8340 00000100:00080000:1.0:1787826279.253248:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826279.253251:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826279.253261:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f6c2d80 x1874663049362944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826279.253269:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826279.253272:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1787826279.253274:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1787826279.253274:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826279.253277:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8340 00000100:00100000:0.0:1787826279.253279:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049362816:0@lo:400:kworker.0 00000100:00080000:1.0:1787826279.253280:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826279.253289:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826279.253300:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f6c0e00 x1874663049363072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826279.253308:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826279.253346:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049363200:0@lo:400:kworker.0 00000100:00100000:1.0:1787826279.253352:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049362432:0@lo:400:kworker.0 00000100:00100000:0.0:1787826279.253371:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826279.253391:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049363200 00000100:00100000:1.0:1787826279.253398:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049363200 00000100:00100000:0.0:1787826279.253417:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049362688:0@lo:400:kworker.0 00000100:00100000:0.0:1787826279.253441:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826279.253453:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787826279.253463:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049363200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826279.253470:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826279.253541:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049362304:0@lo:38:kworker.0 00000100:00100000:0.0:1787826279.253593:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049362432 00000100:00100000:0.0:1787826279.253597:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049362432 00000100:00100000:0.0:1787826279.253625:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787826279.253631:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049362432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826279.253673:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049362816 00000100:00100000:3.0:1787826279.253677:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049362816 00000100:00100000:3.0:1787826279.253707:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049362688 00000100:00100000:3.0:1787826279.253710:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049362688 00000100:00100000:3.0:1787826279.253730:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7090 00000100:00100000:3.0:1787826279.253737:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049362816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826279.256219:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049363200:12345-0@lo:400:kworker.0 Request processed in 2750us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826279.256233:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787826279.256385:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7091 00000100:00100000:1.0:1787826279.256403:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049362688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826279.256913:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049362688:12345-0@lo:400:kworker.0 Request processed in 515us (3469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826279.256921:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7091 00000100:00100000:1.0:1787826279.257045:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049363200:0@lo:400:kworker.0 00000100:00080000:1.0:1787826279.257123:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826279.257130:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826279.257143:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049363328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826279.257179:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826279.257250:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049362688:0@lo:400:kworker.0 00000100:00100000:1.0:1787826279.257373:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049363328 00000100:00100000:1.0:1787826279.257380:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049363328 00000100:00100000:1.0:1787826279.257417:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5841 00000100:00100000:1.0:1787826279.257424:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049363328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826279.257758:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826279.257803:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049363328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 379us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826279.257809:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5841 00000100:00100000:1.0:1787826279.257849:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049363328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826279.264312:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049362432:12345-0@lo:400:kworker.0 Request processed in 10670us (10830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826279.264344:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787826279.264424:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049362432:0@lo:400:kworker.0 00000100:00100000:0.0:1787826279.264474:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049362816:0@lo:400:kworker.0 00000100:00100000:3.0:1787826279.264561:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049362816:12345-0@lo:400:kworker.0 Request processed in 10700us (11128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826279.264572:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7090 00000100:00100000:2.0:1787826279.265186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826279.265450:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049362304 00000100:00100000:3.0:1787826279.265457:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049362304 00000100:00100000:3.0:1787826279.265497:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1787826279.265504:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049362304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826279.265526:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826279.265572:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049362304:12345-0@lo:38:kworker.0 Request processed in 66us (386us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826279.265578:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00080000:2.0:1787826279.265661:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826279.265666:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826279.265670:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049362304:0@lo:38:kworker.0 00000100:00100000:2.0:1787826279.265679:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049362560:0@lo:38:kworker.0 00000100:00100000:2.0:1787826279.265716:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826279.265735:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049362944:0@lo:38:kworker.0 00000100:00100000:2.0:1787826279.265755:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826279.265776:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049362944 00000100:00100000:2.0:1787826279.265780:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049362944 00000100:00100000:2.0:1787826279.265801:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:2.0:1787826279.265806:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049362944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826279.265817:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826279.265842:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049362944:12345-0@lo:38:kworker.0 Request processed in 35us (86us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826279.265849:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00080000:2.0:1787826279.265883:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826279.265887:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826279.265890:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049362944:0@lo:38:kworker.0 00000100:00100000:2.0:1787826279.265897:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049363072:0@lo:38:kworker.0 00000100:00100000:2.0:1787826279.265921:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826279.265939:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049363072 00000100:00100000:2.0:1787826279.265943:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049363072 00000100:00100000:2.0:1787826279.265959:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1787826279.265964:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049363072:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826279.265974:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826279.265997:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049363072:12345-0@lo:38:kworker.0 Request processed in 32us (75us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826279.266002:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00080000:2.0:1787826279.266023:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826279.266027:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826279.266030:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049363072:0@lo:38:kworker.0 00000100:00100000:3.0:1787826279.266136:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049362560 00000100:00100000:3.0:1787826279.266140:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049362560 00000100:00100000:3.0:1787826279.266169:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12754 00000100:00100000:3.0:1787826279.266174:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049362560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826279.266184:0:8414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826279.266508:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049362560:12345-0@lo:38:kworker.0 Request processed in 44us (502us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826279.266515:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12754 00000100:00080000:2.0:1787826279.266692:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826279.266697:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826279.266700:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049362560:0@lo:38:kworker.0 00010000:00010000:0.0:1787826279.268526:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826280.276921:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826280.277231:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000400:00000100:1.0:1787826281.210665:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042997888 offset 0 length 224: 4 00000100:00100000:1.0:1787826281.218393:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826281.219148:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042998016 00000100:00100000:2.0:1787826281.219160:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042998016 00000100:00100000:2.0:1787826281.219234:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1066 00000100:00100000:2.0:1787826281.219243:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042998016:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:2.0:1787826281.219268:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826281.219368:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042998016:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 124us (984us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826281.219375:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1066 00000100:00100000:1.0:1787826281.227117:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826281.227163:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826281.227200:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826281.227286:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042998144 00000100:00100000:0.0:1787826281.227298:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042998144 00000100:00100000:0.0:1787826281.227395:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 312 00000100:00100000:0.0:1787826281.227406:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2391:x1874663042998144:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826281.227498:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2391:x1874663042998144:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 93us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826281.227507:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 312 00000100:00100000:3.0:1787826281.227743:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042998272 00000100:00100000:3.0:1787826281.227748:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042998272 00000100:00100000:3.0:1787826281.227783:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042998400 00000100:00100000:3.0:1787826281.227787:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042998400 00000100:00100000:3.0:1787826281.227812:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7092 00000100:00100000:3.0:1787826281.227820:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042998272:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826281.227875:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042998272:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 56us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826281.227882:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7092 00000100:00100000:3.0:1787826281.227896:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7093 00000100:00100000:3.0:1787826281.227902:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042998400:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826281.227926:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663042998400:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826281.227932:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7093 00000100:00080000:1.0:1787826281.228424:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826281.228430:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826281.228433:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826281.300985:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787826281.301176:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826282.330740:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826282.330990:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:0.0:1787826283.348465:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:0.0:1787826283.348684:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826283.348693:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826283.348712:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049363456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826283.348780:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826283.349123:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049363456 00000100:00100000:2.0:1787826283.349132:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049363456 00000100:00100000:2.0:1787826283.349214:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5842 00000100:00100000:2.0:1787826283.349226:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049363456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826283.349254:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826283.349311:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049363456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826283.349318:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5842 00000100:00100000:0.0:1787826283.349451:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049363456:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787826283.349555:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826284.372617:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826284.372652:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:2.0:1787826284.373728:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049363584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826284.374153:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826284.379210:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826284.379226:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826284.379229:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826284.379238:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8346 00000100:00100000:3.0:1787826284.379239:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049363712:0@lo:400:kworker.0 00000100:00080000:0.0:1787826284.379251:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826284.379259:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000400:00000100:3.0:1787826284.379289:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049363712 offset 0 length 224: 4 00000100:00100000:0.0:1787826284.379538:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47a424380 x1874663049363840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826284.379579:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826284.379583:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826284.379585:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826284.379588:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8346 00000100:00080000:0.0:1787826284.379591:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826284.379595:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826284.379607:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47a427480 x1874663049364096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826284.379624:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826284.379627:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826284.379629:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826284.379631:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8346 00000100:00080000:0.0:1787826284.379634:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826284.379637:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826284.379647:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47a426d80 x1874663049364352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826284.379655:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826284.379658:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826284.379660:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826284.379663:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8346 00000100:00080000:0.0:1787826284.379665:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826284.379669:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826284.379678:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47a427800 x1874663049364480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826284.379706:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049363968:0@lo:400:kworker.0 00000100:00100000:0.0:1787826284.379757:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826284.379781:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826284.379786:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049364224:0@lo:400:kworker.0 00000100:00100000:2.0:1787826284.379799:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049364608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826284.379812:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826284.379839:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826284.379854:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049364224 00000100:00100000:0.0:1787826284.379861:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049364224 00000100:00100000:2.0:1787826284.379874:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049363968 00000100:00100000:2.0:1787826284.379878:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049363968 00000100:00100000:0.0:1787826284.379901:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7094 00000100:00100000:2.0:1787826284.379904:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049364608 00000100:00100000:2.0:1787826284.379906:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049364608 00000100:00100000:0.0:1787826284.379910:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049364224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826284.379924:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787826284.379929:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049363968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826284.379957:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049363968:12345-0@lo:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826284.379965:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787826284.379980:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787826284.379981:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049363840:0@lo:38:kworker.0 00000100:00100000:2.0:1787826284.379986:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049364608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826284.380008:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826284.380015:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049364608:12345-0@lo:400:kworker.0 Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.380018:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049364096:0@lo:38:kworker.0 00000100:00100000:2.0:1787826284.380021:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787826284.380031:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049363840 00000100:00100000:2.0:1787826284.380034:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049363840 00000100:00100000:3.0:1787826284.380040:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826284.380047:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1787826284.380051:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049363840:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826284.380056:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049364352:0@lo:38:kworker.0 00010000:00020000:2.0:1787826284.380068:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826284.380073:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826284.380081:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049364480:0@lo:38:kworker.0 00000100:00100000:2.0:1787826284.380092:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049363840:12345-0@lo:38:kworker.0 Request processed in 40us (84us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826284.380098:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1787826284.380098:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826284.380107:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049364352 00000100:00100000:2.0:1787826284.380110:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049364352 00000100:00100000:2.0:1787826284.380117:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049364480 00000100:00100000:2.0:1787826284.380119:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049364480 00000100:00080000:3.0:1787826284.380120:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826284.380124:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826284.380127:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1787826284.380127:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049363840:0@lo:38:kworker.0 00000100:00100000:2.0:1787826284.380130:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049364352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826284.380139:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826284.380157:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049364096 00000100:00100000:3.0:1787826284.380161:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049364096 00000100:00100000:2.0:1787826284.380166:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049364352:12345-0@lo:38:kworker.0 Request processed in 35us (93us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826284.380172:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1787826284.380182:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1787826284.380182:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12755 00000100:00100000:2.0:1787826284.380186:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049364480:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826284.380186:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049364096:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826284.380194:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1787826284.380202:0:8415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826284.380217:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049364480:12345-0@lo:38:kworker.0 Request processed in 30us (118us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826284.380222:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1787826284.380228:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049364096:12345-0@lo:38:kworker.0 Request processed in 41us (187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826284.380234:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12755 00000100:00100000:2.0:1787826284.380248:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049364608:0@lo:400:kworker.0 00000100:00080000:3.0:1787826284.380274:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826284.380278:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826284.380281:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049364096:0@lo:38:kworker.0 00000100:00080000:3.0:1787826284.380288:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826284.380724:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826284.380728:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049364352:0@lo:38:kworker.0 00000100:00080000:3.0:1787826284.380837:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826284.380841:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826284.380844:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049364480:0@lo:38:kworker.0 00000100:00100000:0.0:1787826284.380916:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049364224:12345-0@lo:400:kworker.0 Request processed in 1006us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826284.380924:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7094 00000100:00100000:0.0:1787826284.380975:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049364224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826284.380985:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049363968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826284.381221:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049363584 00000100:00100000:1.0:1787826284.381227:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049363584 00000100:00100000:1.0:1787826284.381282:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5843 00000100:00100000:1.0:1787826284.381290:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049363584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826284.381314:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581696 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826284.381394:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049363584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (7241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826284.381402:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5843 00000100:00080000:1.0:1787826284.381430:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826284.381434:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826284.381460:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049363584:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826285.397011:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826285.398796:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:3.0:1787826286.330119:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000400:00000100:3.0:1787826286.330158:0:3611:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042998528 offset 0 length 224: 4 00000100:00100000:3.0:1787826286.330181:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826286.330222:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826286.330253:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826286.330282:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042998912 00000100:00100000:3.0:1787826286.330292:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042998912 00000100:00100000:3.0:1787826286.330368:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042999040 00000100:00100000:3.0:1787826286.330372:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042999040 00000100:00100000:3.0:1787826286.330407:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22601 00000100:00100000:3.0:1787826286.330419:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2388:x1874663042998912:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:3.0:1787826286.330465:0:179225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced88a 00000100:00080000:3.0:1787826286.330474:0:179225:0:(import.c:65:import_set_state_nolock()) ffff8eb443ea0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787826286.330523:0:179225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705667 00000100:00100000:3.0:1787826286.330660:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+2:2388:x1874663042998912:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 244us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.330667:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22601 00000100:00100000:3.0:1787826286.330682:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22602 00000100:00100000:3.0:1787826286.330689:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2388:x1874663042999040:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:3.0:1787826286.330701:0:179225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced6fb 00000100:00080000:3.0:1787826286.330707:0:179225:0:(import.c:65:import_set_state_nolock()) ffff8eb3423e9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787826286.330729:0:179225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975536 00000100:00100000:3.0:1787826286.330800:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+2:2388:x1874663042999040:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 110us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.330807:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22602 00000100:00080000:3.0:1787826286.330839:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826286.330843:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826286.331483:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042998784 00000100:00100000:2.0:1787826286.331490:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042998784 00000100:00100000:2.0:1787826286.331533:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042998656 00000100:00100000:2.0:1787826286.331537:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042998656 00000100:00100000:2.0:1787826286.331559:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 315 00000100:00080000:3.0:1787826286.331567:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826286.331570:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042998784:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826286.331620:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042998784:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 54us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826286.331627:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 315 00000100:00100000:2.0:1787826286.331642:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1070 00000100:00100000:2.0:1787826286.331647:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042998656:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:2.0:1787826286.331667:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826286.331690:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663042998656:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 42us (1510us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826286.331696:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1070 00010000:00010000:1.0:1787826286.332141:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826286.332381:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826286.420896:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:0.0:1787826286.425626:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826287.444560:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826287.444621:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:1.0:1787826288.468434:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787826288.468995:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826288.469668:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049364736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826288.469736:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826288.469882:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049364736 00000100:00100000:2.0:1787826288.469899:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049364736 00000100:00100000:2.0:1787826288.469969:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5844 00000100:00100000:2.0:1787826288.469980:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049364736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826288.470010:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826288.470066:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049364736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826288.470073:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5844 00000100:00100000:0.0:1787826288.470190:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049364736:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787826288.470213:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826289.492765:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826289.493484:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826289.493489:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826289.493492:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826289.493501:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8351 00000100:00080000:2.0:1787826289.493507:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826289.493514:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826289.493547:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47f996680 x1874663049364992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826289.493571:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826289.493574:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826289.493575:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826289.493579:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8351 00000100:00080000:2.0:1787826289.493581:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826289.493584:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826289.493595:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47f997b80 x1874663049365248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826289.493629:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826289.493633:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826289.493634:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826289.493637:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8351 00000100:00080000:2.0:1787826289.493640:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826289.493643:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826289.493653:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47f995c00 x1874663049365632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826289.493660:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826289.493663:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826289.493664:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826289.493667:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8351 00000100:00080000:2.0:1787826289.493669:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826289.493673:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826289.493684:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46e80e300 x1874663049365760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826289.493718:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049365120:0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.493783:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826289.493846:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787826289.493852:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049364864:0@lo:400:kworker.0 00000400:00000100:2.0:1787826289.493872:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049364864 offset 0 length 224: 4 00000100:00100000:2.0:1787826289.493890:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049365888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.493910:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826289.493934:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049364992:0@lo:38:kworker.0 00000100:00100000:2.0:1787826289.493956:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826289.493971:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049365248:0@lo:38:kworker.0 00000100:00100000:2.0:1787826289.493992:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826289.494008:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049365632:0@lo:38:kworker.0 00000100:00100000:2.0:1787826289.494026:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826289.494042:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049365760:0@lo:38:kworker.0 00000100:00100000:2.0:1787826289.494061:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826289.494082:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049365376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.494105:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826289.494123:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826289.494129:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049365504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.494148:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826289.494174:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049365120 00000100:00100000:2.0:1787826289.494181:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049365120 00000100:00100000:2.0:1787826289.494223:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049365888 00000100:00100000:2.0:1787826289.494227:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049365888 00000100:00100000:2.0:1787826289.494241:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049364992 00000100:00100000:2.0:1787826289.494243:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049364992 00000100:00100000:2.0:1787826289.494251:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049365632 00000100:00100000:2.0:1787826289.494254:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049365632 00000100:00100000:2.0:1787826289.494261:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049365760 00000100:00100000:2.0:1787826289.494263:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049365760 00000100:00100000:2.0:1787826289.494274:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787826289.494282:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049365120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.495430:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049365120:12345-0@lo:400:kworker.0 Request processed in 1142us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826289.495442:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787826289.495468:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787826289.495478:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049365888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.495581:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049365888:12345-0@lo:400:kworker.0 Request processed in 51us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826289.495591:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787826289.495609:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1787826289.495614:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049364992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826289.495632:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826289.495738:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049364992:12345-0@lo:38:kworker.0 Request processed in 122us (1780us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826289.495744:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1787826289.495757:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1787826289.495761:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049365632:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826289.495770:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826289.495806:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049365632:12345-0@lo:38:kworker.0 Request processed in 43us (1779us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826289.495812:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1787826289.495824:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1787826289.495828:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049365760:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826289.495838:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826289.495865:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049365760:12345-0@lo:38:kworker.0 Request processed in 35us (1803us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826289.495870:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1787826289.495901:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049365248 00000100:00100000:2.0:1787826289.495907:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049365248 00000100:00100000:2.0:1787826289.495935:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12756 00000100:00100000:2.0:1787826289.495940:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049365248:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826289.495950:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826289.495977:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049365248:12345-0@lo:38:kworker.0 Request processed in 36us (1983us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826289.495982:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12756 00000100:00100000:2.0:1787826289.496004:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049365376 00000100:00100000:2.0:1787826289.496008:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049365376 00000100:00100000:2.0:1787826289.496034:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049365504 00000100:00100000:2.0:1787826289.496039:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049365504 00000100:00100000:2.0:1787826289.496061:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7095 00000100:00100000:2.0:1787826289.496068:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049365376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.496106:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049365376:12345-0@lo:400:kworker.0 Request processed in 39us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826289.496112:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7095 00000100:00100000:2.0:1787826289.496124:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7096 00000100:00100000:2.0:1787826289.496131:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049365504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.496159:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049365504:12345-0@lo:400:kworker.0 Request processed in 30us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826289.496165:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7096 00000100:00080000:2.0:1787826289.496185:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826289.496190:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826289.496238:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049365504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.496251:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049365376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.496285:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049365888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826289.496297:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049365120:0@lo:400:kworker.0 00000100:00100000:1.0:1787826289.498563:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00080000:0.0:1787826289.499270:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826289.499279:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826289.499284:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049364992:0@lo:38:kworker.0 00000100:00080000:0.0:1787826289.499492:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826289.499497:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826289.499501:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049365248:0@lo:38:kworker.0 00000100:00080000:0.0:1787826289.499512:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826289.499516:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826289.499519:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049365632:0@lo:38:kworker.0 00000100:00080000:0.0:1787826289.499543:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826289.499546:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826289.499550:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049365760:0@lo:38:kworker.0 00000100:00100000:3.0:1787826289.501875:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049366016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826289.502009:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826289.502382:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049366016 00000100:00100000:3.0:1787826289.502391:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049366016 00000100:00100000:3.0:1787826289.502438:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5845 00000100:00100000:3.0:1787826289.502447:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049366016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826289.502480:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826289.502529:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049366016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826289.502537:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5845 00000100:00100000:3.0:1787826289.502581:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049366016:0@lo:13:osp-pre-1-1.0 00000100:00000400:3.0:1787826290.516457:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826274/real 1787826274] req@ffff8eb34ddd7480 x1874663049360384/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826290 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826290.516486:0:3618:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8eb34ddd7480 x1874663049360384/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826290 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826290.516494:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787826290.516498:0:3618:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787826290.516502:0:3618:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.147@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787826290.516504:0:3618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787826290.516508:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb34ddd7480 x1874663049360384/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826290 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826290.516517:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb4815e2680 x1874663049362176/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826295 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826290.516533:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb47a424000 x1874663049363712/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826300 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826290.516539:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb47f995180 x1874663049364864/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826305 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787826290.516546:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787826290.516549:0:3618:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787826290.516550:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787826290.516552:0:3618:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1787826290.516576:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049364864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826290.516581:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049360384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826290.516652:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049363712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826290.516660:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049362176:0@lo:400:kworker.0 00010000:00010000:3.0:1787826290.516682:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826290.516988:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826290.516993:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787826290.516996:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826290.517001:0:185677:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8292 00000100:00080000:0.0:1787826290.517009:0:185677:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826290.517036:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477ddf100 x1874663049366144/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826290.517056:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826290.517060:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826290.517061:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826290.517065:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8356 00000100:00080000:0.0:1787826290.517067:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826290.517071:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826290.517085:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477ddf480 x1874663049366272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826290.517110:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826290.517113:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826290.517115:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826290.517119:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8356 00000100:00080000:0.0:1787826290.517121:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826290.517124:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826290.517138:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e71c00 x1874663049366528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826290.517250:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826290.517255:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826290.517256:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826290.517261:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8356 00000100:00080000:0.0:1787826290.517264:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826290.517267:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826290.517279:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e73800 x1874663049366912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826290.517287:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826290.517290:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826290.517291:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826290.517294:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8356 00000100:00080000:0.0:1787826290.517296:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826290.517299:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826290.517309:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e72d80 x1874663049367040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826290.517476:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049366144:0@lo:250:kworker.0 00000400:00000100:0.0:1787826290.517520:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049366144 offset 0 length 520: 4 00000100:00100000:0.0:1787826290.517555:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049366272:0@lo:38:kworker.0 00000100:00100000:0.0:1787826290.517587:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.517609:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049366528:0@lo:38:kworker.0 00000100:00100000:0.0:1787826290.517634:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.517648:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049366912:0@lo:38:kworker.0 00000100:00100000:0.0:1787826290.517666:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.517682:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049367040:0@lo:38:kworker.0 00000100:00100000:0.0:1787826290.517700:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.517728:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049366400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826290.517747:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.517763:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826290.517769:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049366656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826290.517804:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.517833:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049366784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826290.517854:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.517868:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826290.517872:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049367168:0@lo:400:kworker.0 00000100:00100000:0.0:1787826290.517894:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.517914:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049366272 00000100:00100000:0.0:1787826290.517921:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049366272 00000100:00100000:0.0:1787826290.517945:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049366912 00000100:00100000:0.0:1787826290.517947:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049366912 00000100:00100000:0.0:1787826290.517954:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049367040 00000100:00100000:0.0:1787826290.517956:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049367040 00000100:00100000:0.0:1787826290.517964:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049366400 00000100:00100000:0.0:1787826290.517966:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049366400 00000100:00100000:0.0:1787826290.517984:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787826290.517993:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049366400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826290.518040:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049366400:12345-0@lo:400:kworker.0 Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826290.518047:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787826290.518062:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049367168 00000100:00100000:0.0:1787826290.518065:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049367168 00000100:00100000:0.0:1787826290.518080:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787826290.518085:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049367168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826290.518117:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049367168:12345-0@lo:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826290.518123:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787826290.518135:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1787826290.518139:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049366272:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826290.518543:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049366528 00000100:00100000:3.0:1787826290.518548:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049366528 00000100:00100000:3.0:1787826290.518573:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12757 00000100:00100000:3.0:1787826290.518578:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049366528:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826290.518618:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826290.518659:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049366272:12345-0@lo:38:kworker.0 Request processed in 518us (1072us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826290.518666:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1787826290.518680:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1787826290.518684:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049366912:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787826290.518833:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049366656 00000100:00100000:1.0:1787826290.518838:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049366656 00000100:00100000:1.0:1787826290.518875:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049366784 00000100:00100000:1.0:1787826290.518879:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049366784 00000100:00100000:1.0:1787826290.518899:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7097 00000100:00100000:1.0:1787826290.518906:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049366656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826290.518944:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049366656:12345-0@lo:400:kworker.0 Request processed in 39us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826290.518950:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7097 00000100:00100000:1.0:1787826290.518965:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7098 00000100:00100000:1.0:1787826290.518971:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049366784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826290.518998:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049366784:12345-0@lo:400:kworker.0 Request processed in 27us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826290.519004:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7098 00000100:00100000:1.0:1787826290.519024:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00080000:1.0:1787826290.519048:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00020000:3.0:1787826290.519109:0:8415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826290.519141:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049366528:12345-0@lo:38:kworker.0 Request processed in 562us (1506us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826290.519148:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12757 00000100:00100000:3.0:1787826290.521077:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1787826290.521088:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049367040:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826290.521110:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826290.521174:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049367040:12345-0@lo:38:kworker.0 Request processed in 86us (3472us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826290.521181:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1787826290.522427:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049366656:0@lo:400:kworker.0 00000100:00100000:1.0:1787826290.522442:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049366400:0@lo:400:kworker.0 00010000:00020000:0.0:1787826290.523365:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826290.523565:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049366912:12345-0@lo:38:kworker.0 Request processed in 4877us (5895us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826290.523576:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1787826290.523626:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049367168:0@lo:400:kworker.0 00000100:00100000:0.0:1787826290.523638:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049366784:0@lo:400:kworker.0 00000100:00080000:0.0:1787826290.523672:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826290.523677:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826290.523681:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049366272:0@lo:38:kworker.0 00000100:00080000:0.0:1787826290.523693:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826290.523697:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826290.523699:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049366528:0@lo:38:kworker.0 00000100:00080000:0.0:1787826290.523710:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826290.523713:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826290.523716:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049366912:0@lo:38:kworker.0 00000100:00080000:0.0:1787826290.523725:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826290.523728:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826290.523731:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049367040:0@lo:38:kworker.0 00000400:00000100:1.0:1787826291.453506:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042999168 offset 0 length 224: 4 00000100:00100000:1.0:1787826291.453551:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826291.453624:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826291.456560:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042999424 00000100:00100000:2.0:1787826291.456574:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042999424 00000100:00100000:2.0:1787826291.456647:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042999296 00000100:00100000:2.0:1787826291.456651:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042999296 00000100:00100000:2.0:1787826291.456675:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 320 00000100:00100000:2.0:1787826291.456687:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042999424:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826291.456772:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663042999424:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 88us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826291.456793:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 320 00000100:00100000:2.0:1787826291.456811:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1077 00000100:00100000:2.0:1787826291.456816:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042999296:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:2.0:1787826291.456838:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826291.456866:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042999296:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 48us (3241us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826291.456873:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1077 00000100:00080000:1.0:1787826291.457109:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826291.541372:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:0.0:1787826291.551912:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787826292.065768:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:1.0:1787826292.065787:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb46e35b800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:2.0:1787826292.065918:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e35b800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f for lustre-OST0001 00000001:00100000:1.0:1787826292.066142:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:1.0:1787826292.066146:0:194610:0:(genops.c:885:class_export_put()) final put ffff8eb443ea2800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:2.0:1787826292.067182:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3423e9800 for lustre-OST0001 00000020:00000080:0.0:1787826292.067414:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb443ea2800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f for lustre-OST0000 00000020:00000080:0.0:1787826292.067458:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb443ea0800 for lustre-OST0000 00000100:00100000:1.0:1787826292.550321:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826292.550607:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042999808 00000100:00100000:0.0:1787826292.550617:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042999808 00000100:00100000:0.0:1787826292.550697:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 321 00000100:00100000:0.0:1787826292.550709:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663042999808:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826292.550803:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663042999808:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 95us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826292.550811:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 321 00000100:00080000:1.0:1787826292.551045:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:3.0:1787826292.554120:0:3612:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663042999552 offset 0 length 520: 4 00000100:00100000:3.0:1787826292.554169:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826292.554613:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042999680 00000100:00100000:0.0:1787826292.554623:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042999680 00000100:00100000:0.0:1787826292.554673:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1078 00000100:00100000:0.0:1787826292.554681:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2388:x1874663042999680:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:0.0:1787826292.554705:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826292.554784:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2388:x1874663042999680:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 100us (614us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826292.554791:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1078 00000100:00100000:0.0:1787826292.565026:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:0.0:1787826292.566105:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826293.158101:0:196422:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787826293.158107:0:196422:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787826293.158109:0:196422:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787826293.158223:0:196422:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8eb448c99000 00000020:01000004:2.0:1787826293.158239:0:196422:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787826293.158253:0:196422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787826293.158269:0:196422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8eb341a699b8) 00000020:00000080:2.0:1787826293.158286:0:196422:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787826293.321940:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787826293.325161:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787826293.326503:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787826293.327115:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787826293.327540:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787826293.327861:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787826293.328102:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787826293.328543:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787826293.328843:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787826293.329499:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787826293.329807:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787826293.329993:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787826293.330217:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787826293.330855:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787826293.339743:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787826293.348562:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787826293.349141:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787826293.349832:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787826293.350044:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787826293.350247:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787826293.350773:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787826293.351004:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787826293.351242:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787826293.353481:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787826293.353792:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787826293.353998:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787826293.355604:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787826293.356036:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1787826293.356741:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787826293.357566:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787826293.357962:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787826293.358450:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787826293.358785:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787826293.359009:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787826293.359850:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787826293.360190:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787826293.360911:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787826293.361184:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787826293.361930:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787826293.362226:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787826293.365166:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787826293.365867:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787826293.366297:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787826293.366573:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787826293.366835:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787826293.367524:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787826293.368152:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787826293.369301:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787826293.369907:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1787826293.370276:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787826293.371202:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1787826293.371462:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787826293.374982:0:196422:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1787826293.376426:0:196422:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787826293.376630:0:196422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787826293.376638:0:196422:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787826293.376725:0:196422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ceda43 00000020:01000004:1.0:1787826293.376733:0:196422:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787826293.376745:0:196422:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787826293.376750:0:196422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb448c99000 from MGS 00000020:01000004:1.0:1787826293.376753:0:196422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787826293.376772:0:196422:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8eb481d9b370) 00000020:00000080:1.0:1787826293.376783:0:196422:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787826293.376844:0:196422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb448c99000 from MGS, refs=2 00080000:01000000:1.0:1787826293.376849:0:196422:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826293.376854:0:196422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ceda51 00010000:00010000:1.0:1787826293.376965:0:196422:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1787826293.387525:0:196422:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787826293.388884:0:196426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787826293.390922:0:196422:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787826293.390972:0:196422:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787826293.392809:0:196422:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787826293.393072:0:196422:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787826293.393248:0:196422:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787826293.393254:0:196422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787826293.395693:0:196422:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787826293.395705:0:196422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787826293.396236:0:196422:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787826293.396243:0:196422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787826293.397512:0:196422:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787826293.397536:0:196422:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1787826293.397538:0:196422:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1787826293.397542:0:196422:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1787826293.397548:0:196422:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 367, was 0): CONNECTING 00000100:00100000:1.0:1787826293.397553:0:196422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1787826293.590898:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826293.590919:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049367296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826293.591002:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826293.591106:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049367296 00000100:00100000:0.0:1787826293.591114:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049367296 00000100:00100000:2.0:1787826293.591342:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00080000:1.0:1787826293.591491:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826293.591586:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5846 00000100:00100000:0.0:1787826293.591602:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049367296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826293.591633:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826293.591679:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049367296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826293.591768:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049367296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826293.593371:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5846 00010000:00010000:1.0:1787826293.594183:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826294.612499:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826294.612534:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826294.612555:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049367424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826294.612592:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:3.0:1787826294.612628:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826294.612715:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049367424 00000100:00100000:0.0:1787826294.612723:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049367424 00000100:00100000:0.0:1787826294.612800:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5847 00000100:00100000:0.0:1787826294.612811:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049367424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826294.612843:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826294.612888:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049367424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826294.612895:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5847 00000100:00080000:2.0:1787826294.612954:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826294.613289:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049367424:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826295.636482:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826295.636497:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00080000:1.0:1787826295.640875:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826295.640885:0:185677:0:(pinger.c:247:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787826295.640889:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826295.640893:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826295.640898:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826295.640907:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8357 00000100:00080000:1.0:1787826295.640911:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826295.640918:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826295.640961:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477ddd500 x1874663049367552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826295.641025:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826295.641030:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826295.641032:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826295.641035:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8357 00000100:00080000:1.0:1787826295.641038:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826295.641042:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826295.641056:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e73800 x1874663049367808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826295.641085:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826295.641089:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826295.641090:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826295.641094:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8357 00000100:00080000:1.0:1787826295.641096:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826295.641100:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826295.641112:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e71180 x1874663049368192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826295.641120:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826295.641124:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826295.641125:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826295.641128:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8357 00000100:00080000:1.0:1787826295.641130:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826295.641142:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826295.641154:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e72300 x1874663049368320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826295.641192:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049368064:0@lo:400:kworker.0 00000100:00100000:1.0:1787826295.641257:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826295.641321:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826295.641351:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049368448:0@lo:400:kworker.0 00000100:00100000:1.0:1787826295.641378:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826295.641418:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049368064 00000100:00100000:1.0:1787826295.641425:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049368064 00000100:00100000:1.0:1787826295.641467:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7099 00000100:00100000:1.0:1787826295.641476:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049368064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826295.641526:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049368064:12345-0@lo:400:kworker.0 Request processed in 51us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826295.641533:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7099 00000100:00100000:1.0:1787826295.641559:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049368448 00000100:00100000:1.0:1787826295.641563:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049368448 00000100:00100000:1.0:1787826295.641594:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787826295.641600:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049368448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826295.641628:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049368448:12345-0@lo:400:kworker.0 Request processed in 28us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826295.641634:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787826295.641993:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049367552:0@lo:38:kworker.0 00000100:00100000:2.0:1787826295.642024:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826295.642047:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049367808:0@lo:38:kworker.0 00000100:00100000:2.0:1787826295.642071:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826295.642144:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049367680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826295.642173:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826295.642919:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049368192:0@lo:38:kworker.0 00000100:00100000:2.0:1787826295.642955:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826295.642971:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049368320:0@lo:38:kworker.0 00000100:00100000:2.0:1787826295.642993:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826295.643026:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049367552 00000100:00100000:2.0:1787826295.643031:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049367552 00000100:00100000:2.0:1787826295.643047:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049367680 00000100:00100000:2.0:1787826295.643050:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049367680 00000100:00100000:2.0:1787826295.643071:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049368192 00000100:00100000:2.0:1787826295.643073:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049368192 00000100:00100000:2.0:1787826295.643080:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049368320 00000100:00100000:2.0:1787826295.643083:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049368320 00000100:00100000:2.0:1787826295.643092:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787826295.643100:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049367680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826295.643152:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049367680:12345-0@lo:400:kworker.0 Request processed in 52us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826295.643159:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787826295.643175:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1787826295.643179:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049367552:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826295.643197:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826295.643232:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049367552:12345-0@lo:38:kworker.0 Request processed in 51us (1207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826295.643238:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1787826295.643249:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1787826295.643253:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049368192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826295.643262:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826295.643285:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049368192:12345-0@lo:38:kworker.0 Request processed in 31us (329us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826295.643291:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1787826295.643303:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1787826295.643307:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049368320:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826295.643316:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826295.643358:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049368320:12345-0@lo:38:kworker.0 Request processed in 49us (364us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826295.643364:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1787826295.643384:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049367808 00000100:00100000:2.0:1787826295.643388:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049367808 00000100:00100000:2.0:1787826295.643408:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12758 00000100:00100000:2.0:1787826295.643412:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049367808:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826295.643422:0:177386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826295.643447:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049367808:12345-0@lo:38:kworker.0 Request processed in 34us (1375us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826295.643453:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12758 00000100:00080000:2.0:1787826295.643487:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826295.643493:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826295.643496:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049367552:0@lo:38:kworker.0 00000100:00080000:2.0:1787826295.643506:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826295.643509:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826295.643512:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049367808:0@lo:38:kworker.0 00000100:00080000:2.0:1787826295.643520:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826295.643523:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826295.643526:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049368192:0@lo:38:kworker.0 00000100:00080000:2.0:1787826295.643533:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826295.643536:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826295.643538:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049368320:0@lo:38:kworker.0 00000100:00100000:2.0:1787826295.643591:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049367936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826295.643616:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826295.643646:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049367936 00000100:00100000:2.0:1787826295.643649:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049367936 00000100:00100000:2.0:1787826295.643689:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7100 00000100:00100000:2.0:1787826295.643695:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049367936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826295.643727:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049367936:12345-0@lo:400:kworker.0 Request processed in 32us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826295.643733:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7100 00000100:00100000:2.0:1787826295.643769:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049367936:0@lo:400:kworker.0 00000100:00080000:2.0:1787826295.643816:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826295.643820:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826295.646321:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049367680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826295.646417:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049368448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826295.646439:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049368064:0@lo:400:kworker.0 00010000:00010000:1.0:1787826296.660612:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826296.664774:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:0.0:1787826297.594184:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826297.594280:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826297.594376:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043000064 00000100:00100000:2.0:1787826297.594387:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043000064 00000100:00100000:2.0:1787826297.594465:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042999936 00000100:00100000:2.0:1787826297.594468:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042999936 00000100:00100000:2.0:1787826297.594490:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 324 00000100:00100000:2.0:1787826297.594502:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043000064:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826297.594514:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1082 00000100:00100000:3.0:1787826297.594529:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042999936:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:3.0:1787826297.594564:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826297.594603:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043000064:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 102us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826297.594615:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 324 00000100:00100000:3.0:1787826297.594639:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663042999936:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 106us (353us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826297.594649:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1082 00000100:00080000:0.0:1787826297.594986:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826297.685189:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787826297.686923:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826298.711160:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:3.0:1787826298.711221:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826298.711847:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049368576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826298.711944:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826298.712094:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049368576 00000100:00100000:2.0:1787826298.712105:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049368576 00000100:00100000:2.0:1787826298.712182:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5848 00000100:00100000:2.0:1787826298.712195:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049368576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826298.712235:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826298.712293:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049368576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826298.712301:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5848 00000100:00080000:1.0:1787826298.712432:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826298.712521:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049368576:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787826299.732634:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826299.737372:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:3.0:1787826299.737943:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826299.737970:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049368704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826299.738060:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826299.738303:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049368704 00000100:00100000:1.0:1787826299.738315:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049368704 00000100:00100000:1.0:1787826299.738433:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5849 00000100:00100000:1.0:1787826299.738446:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049368704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826299.738487:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826299.738571:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049368704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826299.738579:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5849 00000100:00100000:1.0:1787826299.738643:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049368704:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787826299.738668:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826300.756467:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787826300.756470:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00080000:1.0:1787826300.756481:0:185677:0:(pinger.c:247:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787826300.756486:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826300.756492:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826300.756497:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826300.756508:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8362 00000100:00080000:1.0:1787826300.756513:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826300.756524:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826300.756580:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4815e3800 x1874663049368832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826300.756655:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826300.756660:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826300.756662:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826300.756666:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8362 00000100:00080000:1.0:1787826300.756670:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1787826300.756685:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826290/real 1787826290] req@ffff8eb477ddf100 x1874663049366144/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826300 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826300.756729:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8eb477ddf100 x1874663049366144/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826300 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826300.756755:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049368832:0@lo:38:kworker.0 00000100:00080000:1.0:1787826300.756761:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826300.756781:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb4815e1f80 x1874663049369088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826300.756831:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826300.756835:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826300.756837:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826300.756841:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8362 00000100:00080000:1.0:1787826300.756844:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826300.756848:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826300.756861:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342775f80 x1874663049369472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826300.756871:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826300.756875:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826300.756877:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826300.756881:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8362 00000100:00080000:1.0:1787826300.756883:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826300.756887:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826300.756899:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342774380 x1874663049369600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826300.756933:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049369344:0@lo:400:kworker.0 00000100:00100000:1.0:1787826300.756972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826300.757040:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826300.757047:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049369728:0@lo:400:kworker.0 00000100:00100000:1.0:1787826300.757088:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049369344 00000100:00100000:1.0:1787826300.757098:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049369344 00000100:00100000:1.0:1787826300.757156:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7101 00000100:00100000:1.0:1787826300.757167:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049369344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826300.757211:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826300.757245:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049369344:12345-0@lo:400:kworker.0 Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826300.757246:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787826300.757257:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7101 00000100:00080000:0.0:1787826300.757263:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787826300.757272:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049368960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826300.757273:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049366144:0@lo:250:kworker.0 00000100:00100000:0.0:1787826300.757297:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049369088:0@lo:38:kworker.0 10000000:01000000:1.0:1787826300.757302:0:196422:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:3.0:1787826300.757311:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826300.757341:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826300.757348:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced5c0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.757358:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:00010000:1.0:1787826300.757364:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced5c0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.757365:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049369216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826300.757368:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049369472:0@lo:38:kworker.0 10000000:01000000:1.0:1787826300.757379:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1787826300.757395:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:0.0:1787826300.757396:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.757396:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826300.757410:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3c00/0x878a5eea00ced5b9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced5c0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.757420:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049369600:0@lo:38:kworker.0 00010000:00010000:1.0:1787826300.757433:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced550 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.757442:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced550 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.757448:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787826300.757457:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826300.757464:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.757470:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d65400/0x878a5eea00ced549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced550 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.757486:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049369216 00010000:00010000:1.0:1787826300.757488:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced56c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.757492:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049369216 10000000:00010000:1.0:1787826300.757499:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced56c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.757504:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826300.757509:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.757513:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d65600/0x878a5eea00ced565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced56c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.757525:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced596 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.757532:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced596 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.757538:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7102 10000000:01000000:1.0:1787826300.757539:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826300.757545:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.757550:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d65a00/0x878a5eea00ced58f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced596 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.757551:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049369216:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1787826300.757568:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced5a4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.757580:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced5a4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.757586:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:2.0:1787826300.757588:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826300.757590:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.757597:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481714200/0x878a5eea00ced59d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced5a4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.757601:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049369216:12345-0@lo:400:kworker.0 Request processed in 53us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.757614:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7102 00010000:00010000:1.0:1787826300.757615:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.757625:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.757631:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826300.757635:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.757640:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb47fa8e600/0x878a5eea00ced5c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced5ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.757649:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826300.757657:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced717 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.757665:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced717 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.757671:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787826300.757679:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049369216:0@lo:400:kworker.0 00000100:00100000:3.0:1787826300.757702:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049368832 00000100:00100000:3.0:1787826300.757706:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049368832 00000100:00100000:3.0:1787826300.757731:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049368960 00000100:00100000:3.0:1787826300.757735:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049368960 00000100:00100000:3.0:1787826300.757755:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049369472 00000100:00100000:3.0:1787826300.757757:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049369472 00000100:00100000:3.0:1787826300.757764:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049369600 00000100:00100000:3.0:1787826300.757766:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049369600 00000100:00100000:3.0:1787826300.757777:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787826300.757783:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049368960:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826300.758248:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826300.758313:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049369088 00010000:00010000:1.0:1787826300.758316:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:2.0:1787826300.758321:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049369088 00000100:00100000:2.0:1787826300.758388:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12759 00000100:00100000:2.0:1787826300.758395:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049369088:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826300.758419:0:8415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826300.758478:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049369088:12345-0@lo:38:kworker.0 Request processed in 82us (1151us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826300.758485:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12759 00000100:00100000:2.0:1787826300.758513:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.758549:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049369344:0@lo:400:kworker.0 00000100:00100000:2.0:1787826300.758625:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049369728 00000100:00100000:2.0:1787826300.758629:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049369728 00000100:00100000:2.0:1787826300.758665:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787826300.758672:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049369728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826300.758727:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049369728:12345-0@lo:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.758734:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787826300.758756:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1787826300.758761:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049368832:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826300.758773:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826300.758799:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049368832:12345-0@lo:38:kworker.0 Request processed in 37us (1935us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826300.758806:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1787826300.758825:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1787826300.758829:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049369472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826300.758838:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826300.758864:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049369472:12345-0@lo:38:kworker.0 Request processed in 34us (1468us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826300.758870:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1787826300.758884:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1787826300.758888:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049369600:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826300.758896:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826300.758919:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049369600:12345-0@lo:38:kworker.0 Request processed in 30us (1474us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826300.758924:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00080000:2.0:1787826300.758942:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826300.758966:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049369728:0@lo:400:kworker.0 00000100:00080000:2.0:1787826300.759226:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826300.759233:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826300.759237:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049369088:0@lo:38:kworker.0 00000100:00080000:0.0:1787826300.759437:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826300.759443:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787826300.759447:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826300.759453:0:185677:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8357 00000100:00080000:0.0:1787826300.759459:0:185677:0:(import.c:589:import_select_connection()) MGC192.168.203.147@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787826300.759465:0:185677:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826300.759496:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448d17b80 x1874663049369856/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826300.759499:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826300.759504:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826300.759507:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049369472:0@lo:38:kworker.0 00000100:00080000:2.0:1787826300.759520:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826300.759525:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826300.759529:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049368960:12345-0@lo:400:kworker.0 Request processed in 1741us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.759530:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049369600:0@lo:38:kworker.0 00000100:00080000:2.0:1787826300.759547:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787826300.759549:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:2.0:1787826300.759556:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826300.759560:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049368832:0@lo:38:kworker.0 00000100:00100000:0.0:1787826300.759563:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049368960:0@lo:400:kworker.0 00000100:00020000:2.0:1787826300.759595:0:3616:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8eb448d17b80 x1874663049369856/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787826300.760837:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3000/0x878a5eea00ced710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced717 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.760882:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced74f expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.760893:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced74f expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.760901:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826300.760919:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.760932:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481715c00/0x878a5eea00ced748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced74f expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.760955:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced79c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.760962:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced79c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.760968:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826300.760972:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.760975:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481715a00/0x878a5eea00ced795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced79c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.760990:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced57a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.760996:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced57a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.761002:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826300.761006:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.761009:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d64400/0x878a5eea00ced573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced57a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.761022:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced588 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.761029:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced588 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.761035:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826300.761038:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.761041:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481714c00/0x878a5eea00ced581 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced588 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.761052:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced5b2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.761058:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced5b2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.761063:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826300.761067:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.761070:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00ced5ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced5b2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.761080:0:196422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00ced741 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826300.761087:0:196422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00ced741 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826300.761099:0:196422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826300.761102:0:196422:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826300.761106:0:196422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481715000/0x878a5eea00ced73a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00ced741 expref: -99 pid: 194609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787826300.802814:0:196422:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 368, was 0): CONNECTING 00000100:00080000:1.0:1787826300.802832:0:196422:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1787826300.806647:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826300.806686:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1787826300.806698:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:0:1874663049369856:0@lo:250:kworker.0 00000100:00080000:1.0:1787826300.806920:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) 205ad83e-e455-4070-92a2-f1e25b8f3f40->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826300.806933:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787826300.806938:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826300.806947:0:185677:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8367 00000100:00080000:1.0:1787826300.806954:0:185677:0:(import.c:589:import_select_connection()) MGC192.168.203.147@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787826300.806964:0:185677:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826300.807015:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342777100 x1874663049369984/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826300.807098:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049369984:0@lo:250:kworker.0 00000100:00100000:2.0:1787826300.807207:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.807316:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049369984 00000100:00100000:3.0:1787826300.807347:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049369984 00000100:00100000:3.0:1787826300.807410:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787826300.807421:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3616:x1874663049369984:12345-0@lo:250:kworker.0 00010000:00080000:3.0:1787826300.807454:0:196428:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 205ad83e-e455-4070-92a2-f1e25b8f3f40@0@lo t0 exp 0000000000000000 cur 8367 last 0 00000020:00000080:3.0:1787826300.807497:0:196428:0:(genops.c:1385:class_connect()) connect: client 205ad83e-e455-4070-92a2-f1e25b8f3f40, cookie 0x878a5eea00ceda58 00000100:00080000:3.0:1787826300.807670:0:196428:0:(import.c:65:import_set_state_nolock()) ffff8eb341afb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826300.810121:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+5:3616:x1874663049369984:12345-0@lo:250:kworker.0 Request processed in 2685us (2899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.810141:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826300.810539:0:3616:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.147@tcp: committing for last_committed 0 gen 82 00000100:00080000:2.0:1787826300.810559:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.147@tcp: connect to target with instance 0 00000100:00080000:2.0:1787826300.810572:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787826300.810578:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787826300.810584:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787826300.810588:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787826300.811148:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787826300.811163:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049369984:0@lo:250:kworker.0 00000100:00080000:1.0:1787826300.811203:0:196422:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1787826300.811218:0:196422:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787826300.811281:0:196422:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787826300.811289:0:196422:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000000:3.0:1787826300.811381:0:185677:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.147@tcp 10000000:01000000:3.0:1787826300.811403:0:185677:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1787826300.811407:0:185677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1787826300.811409:0:185677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787826300.811410:0:185677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826300.811411:0:185677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826300.811412:0:185677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000040:01000000:1.0:1787826300.811493:0:196422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787826300.811522:0:196422:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787826300.811526:0:196422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787826300.811528:0:196422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826300.811529:0:196422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826300.811530:0:196422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826300.811531:0:196422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826300.811532:0:196422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826300.811533:0:196422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826300.811536:0:196422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826300.811538:0:196422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826300.811540:0:196422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787826300.811545:0:196422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787826300.811547:0:196422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826300.811549:0:196422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826300.811550:0:196422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826300.811551:0:196422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826300.811552:0:196422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826300.811553:0:196422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826300.811555:0:196422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826300.811556:0:196422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826300.811557:0:196422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826300.811558:0:196422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787826300.811567:0:185677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826300.811569:0:185677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826300.811570:0:185677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826300.811571:0:185677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826300.811700:0:196422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787826300.811730:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049370112:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826300.811881:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787826300.811899:0:185677:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1787826300.811907:0:185677:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1787826300.811909:0:185677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1787826300.811910:0:185677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787826300.811911:0:185677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826300.811912:0:185677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826300.811913:0:185677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826300.811914:0:185677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826300.811915:0:185677:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826300.811917:0:185677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826300.811918:0:185677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787826300.811922:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb345267780 going to sleep for 11 seconds 00000020:01000000:3.0:1787826300.811933:0:185677:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1787826300.811938:0:185677:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1787826300.811940:0:185677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1787826300.811941:0:185677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826300.811942:0:185677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826300.811943:0:185677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826300.811944:0:185677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826300.811945:0:185677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826300.811946:0:185677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826300.811947:0:185677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826300.811948:0:185677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787826300.811952:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049370368:0@lo:253:kworker.0 00000020:01000000:3.0:1787826300.811970:0:185677:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1787826300.811987:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.811996:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049370496:0@lo:253:kworker.0 00000100:00100000:2.0:1787826300.812011:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826300.812016:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049370240:0@lo:253:kworker.0 00000100:00100000:3.0:1787826300.812031:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.812040:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.812063:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049370112 00000100:00100000:2.0:1787826300.812067:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049370368 00000100:00100000:2.0:1787826300.812070:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049370368 00000100:00100000:3.0:1787826300.812071:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049370112 00000100:00100000:2.0:1787826300.812107:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049370496 00000100:00100000:3.0:1787826300.812107:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049370240 00000100:00100000:2.0:1787826300.812110:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049370496 00000100:00100000:3.0:1787826300.812110:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049370240 00000100:00100000:3.0:1787826300.812123:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826300.812150:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787826300.812154:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:196422:x1874663049370112:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826300.812155:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3620:x1874663049370368:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1787826300.812204:0:196428:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787826300.812207:0:196428:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787826300.812210:0:196428:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1787826300.812318:0:196427:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:0.0:1787826300.825480:0:196432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787826300.825771:0:196428:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 335 20000000:01000000:3.0:1787826300.828736:0:196433:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787826300.828744:0:196433:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787826300.828748:0:196433:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787826300.828751:0:196433:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787826300.828975:0:196433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787826300.829197:0:196428:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787826300.829226:0:196428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787826300.829385:0:196427:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787826300.829885:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:196422:x1874663049370112:12345-0@lo:253:mount.lustre.0 Request processed in 17727us (18062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.829939:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787826300.829983:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826300.829994:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3620:x1874663049370240:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787826300.830021:0:196428:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1787826300.830119:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049370112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787826300.830132:0:196422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787826300.830135:0:196422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826300.830137:0:196422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826300.830139:0:196422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826300.830140:0:196422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826300.830141:0:196422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826300.830143:0:196422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826300.830144:0:196422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826300.830146:0:196422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826300.830147:0:196422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826300.830149:0:196422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787826300.830169:0:196422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb448c99000 from lustre-MDT0000 10000000:01000000:2.0:1787826300.830192:0:196422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787826300.830194:0:196422:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787826300.830203:0:196422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8eb448c99000 10000000:01000000:2.0:1787826300.830207:0:196422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787826300.830211:0:196422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8eb448c99000 10000000:01000000:2.0:1787826300.830214:0:196422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787826300.830217:0:196422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb448c99000 from 1 10000000:01000000:2.0:1787826300.830220:0:196422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787826300.830252:0:196422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.830262:0:196422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.830271:0:196422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.830293:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049370624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826300.830678:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.830724:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb345267240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826300.830786:0:196429:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1787826300.830805:0:196429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1787826300.831228:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049370624 00000100:00100000:1.0:1787826300.831241:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049370624 00000100:00100000:0.0:1787826300.833036:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787826300.833056:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3617:x1874663049370496:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787826300.833090:0:196434:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787826300.841126:0:196427:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826300.841147:0:196427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787826300.841417:0:196428:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787826300.841684:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3620:x1874663049370368:12345-0@lo:253:kworker.0 Request processed in 29524us (29692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.841695:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787826300.841745:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787826300.841755:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:196422:x1874663049370624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826300.841769:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.841795:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3800/0x878a5eea00ceda66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceda5f expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.841820:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3800/0x878a5eea00ceda66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceda5f expref: 8 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.841831:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3800/0x878a5eea00ceda66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceda5f expref: 8 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.841840:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3800, rc 0) 00000100:00100000:2.0:1787826300.841870:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:196422:x1874663049370624:12345-0@lo:101:mount.lustre.0 Request processed in 117us (11194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.841876:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1787826300.841922:0:3620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1787826300.841924:0:3620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787826300.841926:0:3620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826300.841927:0:3620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826300.841928:0:3620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826300.841930:0:3620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826300.841931:0:3620:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826300.841933:0:3620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826300.841934:0:3620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787826300.841937:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049370368:0@lo:253:kworker.0 00000100:00100000:2.0:1787826300.841975:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049370624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826300.841991:0:196422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.842001:0:196422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826300.842016:0:196422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787826300.842026:0:196422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.842033:0:196422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826300.842041:0:196422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787826300.842046:0:196422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826300.842051:0:196422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8eb448c99000 10000000:01000000:2.0:1787826300.842054:0:196422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787826300.842058:0:196422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787826300.842060:0:196422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787826300.842083:0:196422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.842090:0:196422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.842100:0:196422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.842118:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049370752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826300.842150:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.842176:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344537f00 going to sleep for 11 seconds 20000000:01000000:1.0:1787826300.842440:0:196432:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826300.842452:0:196432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826300.842486:0:196432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842504:0:196432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826300.842516:0:196432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063832s 00010000:00010000:1.0:1787826300.842521:0:196432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842528:0:196432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842535:0:196432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842542:0:196432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842550:0:196432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826300.842555:0:196432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842565:0:196432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842581:0:196432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842589:0:196432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842595:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64800/0x878a5eea00ceda74 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.842653:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049370752 00000100:00100000:1.0:1787826300.842666:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049370752 00000100:00100000:1.0:1787826300.842747:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787826300.842760:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:196422:x1874663049370752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826300.842778:0:196429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826300.842792:0:196429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64400/0x878a5eea00ceda7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceda6d expref: -99 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842814:0:196429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64400/0x878a5eea00ceda7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceda6d expref: 9 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842825:0:196429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64400/0x878a5eea00ceda7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceda6d expref: 9 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.842837:0:196429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64400, rc 0) 00000100:00100000:1.0:1787826300.842919:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196422:x1874663049370752:12345-0@lo:101:mount.lustre.0 Request processed in 162us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.842928:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787826300.842955:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049370752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826300.842976:0:196422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.842987:0:196422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.843051:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049370880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826300.843086:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.843152:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344537f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.848460:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049370880 00000100:00100000:3.0:1787826300.848475:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049370880 00000100:00100000:3.0:1787826300.848693:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787826300.848706:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196422:x1874663049370880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826300.848941:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196422:x1874663049370880:12345-0@lo:501:mount.lustre.0 Request processed in 237us (5854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.848949:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826300.849388:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049370880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826300.849441:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049371008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826300.849494:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.849874:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344537f00 going to sleep for 11 seconds 20000000:01000000:0.0:1787826300.853656:0:196428:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826300.853685:0:196428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787826300.853882:0:196434:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787826300.854496:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:3620:x1874663049370240:12345-0@lo:253:kworker.0 Request processed in 24500us (42448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.854508:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787826300.856624:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049371008 00000100:00100000:1.0:1787826300.856641:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049371008 20000000:01000000:1.0:1787826300.856657:0:196432:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826300.856662:0:196432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826300.856687:0:196432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856704:0:196432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826300.856724:0:196432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063832s 00010000:00010000:1.0:1787826300.856729:0:196432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856735:0:196432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856742:0:196432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856749:0:196432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856755:0:196432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826300.856760:0:196432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856772:0:196432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856785:0:196432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856793:0:196432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826300.856799:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65a00/0x878a5eea00ceda82 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826300.856871:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787826300.856882:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196422:x1874663049371008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826300.858544:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196422:x1874663049371008:12345-0@lo:503:mount.lustre.0 Request processed in 1658us (9044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.858555:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826300.858708:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049371008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826300.859171:0:196435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196435:1874663049371136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826300.859219:0:196435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.859244:0:196435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344537780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.859314:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049371136 00000100:00100000:3.0:1787826300.859320:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049371136 00000100:00100000:3.0:1787826300.859370:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787826300.859378:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196435:x1874663049371136:12345-0@lo:502:llog_process_th.0 20000000:01000000:2.0:1787826300.859952:0:196434:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826300.859968:0:196434:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787826300.860279:0:196432:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787826300.860285:0:196432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787826300.860308:0:196432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860362:0:196432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826300.860372:0:196432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000088185s 00010000:00010000:3.0:1787826300.860376:0:196432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860383:0:196432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860389:0:196432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860396:0:196432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860402:0:196432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826300.860405:0:196432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860413:0:196432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860424:0:196432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860431:0:196432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.860438:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf38800/0x878a5eea00ceda89 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826300.860610:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:3617:x1874663049370496:12345-0@lo:253:kworker.0 Request processed in 27559us (48575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.860619:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787826300.860772:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:196435:x1874663049371136:12345-0@lo:502:llog_process_th.0 Request processed in 1393us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.860779:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787826300.860861:0:196435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196435:1874663049371136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826300.860891:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826300.860906:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826300.860909:0:196435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787826300.860926:0:196435:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787826300.860930:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826300.860944:0:196435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8eb341a68000) 00000020:00000080:2.0:1787826300.860965:0:196435:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:2.0:1787826300.860972:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787826300.861053:0:196435:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787826300.861060:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00ceda97 00000020:00000080:2.0:1787826300.861270:0:196435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787826300.861274:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826300.861277:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826300.861278:0:196435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787826300.861281:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826300.861283:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826300.861284:0:196435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787826300.861287:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826300.861294:0:196435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8eb47a4319b8) 00000020:00000080:2.0:1787826300.861306:0:196435:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:2.0:1787826300.861309:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787826300.861311:0:196435:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787826300.861313:0:196435:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787826300.861320:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787826300.861395:0:196435:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb448c99000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787826300.861409:0:196435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8eb47a430000) 00000020:00000080:2.0:1787826300.861423:0:196435:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:2.0:1787826300.861489:0:196435:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787826300.861495:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cedaac 00000020:00000080:2.0:1787826300.861602:0:196435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787826300.861610:0:196435:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787826300.861614:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x878a5eea00cedab3 00080000:01000000:2.0:1787826300.861619:0:196435:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787826300.861623:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cedaba 00000020:01000004:3.0:1787826300.862143:0:3617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787826300.862147:0:3617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787826300.862148:0:3617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826300.862150:0:3617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826300.862151:0:3617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826300.862153:0:3617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826300.862154:0:3617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787826300.862156:0:3617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826300.862158:0:3617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787826300.862163:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049370496:0@lo:253:kworker.0 00000020:01000004:0.0:1787826300.862313:0:3620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787826300.862316:0:3620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787826300.862317:0:3620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826300.862318:0:3620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826300.862319:0:3620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826300.862320:0:3620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826300.862322:0:3620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826300.862347:0:3620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826300.862349:0:3620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787826300.862352:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049370240:0@lo:253:kworker.0 00010000:00010000:3.0:1787826300.973622:0:196435:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1787826300.973774:0:196435:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: c0d7758a-4501-4a89-8ec1-407fef4f0c7f idx: 0 lr: 0 srv lr: 347892350976 lx: 0 gen 22 00000001:00080000:3.0:1787826300.973817:0:196435:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 330712483740 srv lr: 347892350976 lx: 0 gen 21 00000001:00000004:3.0:1787826300.973841:0:196435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 82, last_transno is 347892350976 00000001:00080000:3.0:1787826300.974009:0:196435:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1787826300.974064:0:196435:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953ccc0: xid 1874663042992512, transno 347892350981, client gen 22, slot idx 0 00000001:00080000:3.0:1787826300.974075:0:196435:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953c240: xid 1874663042993408, transno 347892350982, client gen 22, slot idx 1 00000001:00080000:3.0:1787826300.974081:0:196435:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953ca80: xid 1874663049354112, transno 347892350983, client gen 21, slot idx 2 00000001:00080000:3.0:1787826300.974085:0:196435:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953c0c0: xid 1874663048748160, transno 330712483739, client gen 21, slot idx 3 00000001:00080000:3.0:1787826300.974088:0:196435:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb34953c3c0: xid 1874663048748416, transno 330712483740, client gen 21, slot idx 4 00000020:00000080:3.0:1787826300.974656:0:196435:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8eb344e60000) 00000020:00000080:3.0:1787826300.974675:0:196435:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:3.0:1787826300.974773:0:196435:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787826300.974781:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cedad6 00000020:00000080:3.0:1787826300.983779:0:196435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787826300.990721:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x878a5eea00cedadd 00000020:00000080:2.0:1787826300.991154:0:196435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787826300.991164:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826300.991170:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826300.991173:0:196435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787826300.991175:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826300.991178:0:196435:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787826300.991179:0:196435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826300.991181:0:196435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826300.991182:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826300.991184:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826300.991185:0:196435:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826300.991187:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826300.991191:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826300.991192:0:196435:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787826300.991196:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787826300.991231:0:196435:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787826300.991246:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826300.991249:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826300.991250:0:196435:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787826300.991252:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826300.991255:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826300.991256:0:196435:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787826300.991258:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826300.991263:0:196435:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:2.0:1787826300.991283:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826300.991297:0:196435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8eb47a434d28) 00000020:00000080:2.0:1787826300.991312:0:196435:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787826300.991316:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826300.991401:0:196435:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787826300.991406:0:196435:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787826300.991411:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cedaeb 00010000:00080000:2.0:1787826300.991507:0:196435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb45ec36000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1787826300.996615:0:196435:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1787826300.999258:0:196435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826300.999274:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787826300.999319:0:196435:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787826300.999386:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cedaf2 00000100:00080000:2.0:1787826300.999398:0:196435:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826300.999405:0:196435:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826300.999595:0:196435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47f995500 x1874663049371264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826300.999624:0:196435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787826300.999726:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049371264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826300.999795:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826300.999899:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049371264 00000100:00100000:2.0:1787826300.999906:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049371264 00000100:00100000:2.0:1787826300.999942:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12760 00000100:00100000:2.0:1787826300.999950:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049371264:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787826300.999975:0:177386:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8367 last 0 00000020:00000080:2.0:1787826301.000008:0:177386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cedaf9 00000004:00100000:2.0:1787826301.000022:0:177386:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826301.000112:0:177386:0:(import.c:65:import_set_state_nolock()) ffff8eb481223800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826301.000171:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049371264:12345-0@lo:38:llog_process_th.0 Request processed in 220us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.000178:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12760 00000100:00100000:2.0:1787826301.000219:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826301.000227:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 4 00000100:00080000:2.0:1787826301.000233:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787826301.000237:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787826301.000240:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787826301.000246:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049371264:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787826301.000308:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826301.000314:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826301.000316:0:196435:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787826301.000319:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826301.000321:0:196435:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787826301.000354:0:196435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826301.000356:0:196435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826301.000357:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826301.000361:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826301.000362:0:196435:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826301.000365:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826301.000369:0:196435:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787826301.000372:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826301.000374:0:196435:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787826301.000377:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826301.000380:0:196435:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:2.0:1787826301.000400:0:196435:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787826301.000403:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826301.000417:0:196435:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8eb45eb84d28) 00000100:00100000:0.0:1787826301.001622:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049371392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826301.001676:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1787826301.001798:0:196435:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000100:00100000:2.0:1787826301.001822:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049371392 00000100:00100000:2.0:1787826301.001828:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049371392 00000100:00100000:2.0:1787826301.001862:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12761 00000100:00100000:2.0:1787826301.001870:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049371392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826301.001902:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:2.0:1787826301.001949:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049371392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.001956:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12761 00000020:00000080:2.0:1787826301.001978:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826301.002076:0:196435:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787826301.002083:0:196435:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787826301.002090:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cedb07 00010000:00080000:2.0:1787826301.002123:0:196435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb45a03b000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1787826301.002344:0:196435:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1787826301.005092:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049371392:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1787826301.008410:0:196435:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787826301.008462:0:196435:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787826301.009142:0:196435:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 80, last_idx 81 00000040:00080000:2.0:1787826301.010089:0:196435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826301.010119:0:196435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].82, 64 off13440 00000040:00080000:2.0:1787826301.010254:0:196435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x148:0x0].1, 64 off8256 00000040:00080000:2.0:1787826301.011162:0:196441:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 82 synced_idx: 0 lgh_last_idx: 82 00000040:00080000:2.0:1787826301.011168:0:196441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x144:0x0] at index 81 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1787826301.011298:0:196441:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 81, last_idx 82 00000040:00080000:2.0:1787826301.011348:0:196441:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x144:0x0] at index 81 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1787826301.011631:0:196441:0:(llog.c:805:llog_process_thread()) index: 82, lh_last_idx: 82 synced_idx: 82 lgh_last_idx: 82 00000040:00080000:2.0:1787826301.011635:0:196441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x148:0x0] at index 82 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787826301.012143:0:196435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826301.012157:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787826301.012194:0:196435:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787826301.012215:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cedb0e 00000100:00080000:3.0:1787826301.012226:0:196435:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826301.012231:0:196435:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb45a03b000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826301.012265:0:196435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb48162bb80 x1874663049371520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826301.012294:0:196435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787826301.012552:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826301.012556:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826301.012559:0:196435:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787826301.012562:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787826301.012564:0:196435:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1787826301.012566:0:196435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826301.012568:0:196435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826301.012569:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787826301.012572:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826301.012573:0:196435:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787826301.012576:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787826301.012580:0:196435:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787826301.012584:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826301.012585:0:196435:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787826301.012589:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787826301.012593:0:196435:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:3.0:1787826301.012616:0:196435:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787826301.012619:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826301.012630:0:196435:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8eb344e619b8) 00000020:00000080:3.0:1787826301.012648:0:196435:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:3.0:1787826301.012653:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787826301.012746:0:196435:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787826301.012753:0:196435:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787826301.012760:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cedb1c 00010000:00080000:3.0:1787826301.012789:0:196435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb349083800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1787826301.016090:0:196435:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1787826301.016175:0:196435:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787826301.016190:0:196435:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1787826301.016548:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049371520:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787826301.016620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.017125:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049371520 00000100:00100000:3.0:1787826301.017134:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049371520 00000100:00100000:3.0:1787826301.017176:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22603 00000100:00100000:3.0:1787826301.017184:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1874663049371520:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787826301.017212:0:43900:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8367 last 0 00000020:00000080:3.0:1787826301.017240:0:43900:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cedb23 00002000:00100000:3.0:1787826301.017253:0:43900:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8eb349086000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787826301.017257:0:43900:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787826301.017260:0:43900:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000040:00080000:2.0:1787826301.017790:0:196435:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 80, last_idx 81 00002000:00080000:3.0:1787826301.018164:0:43900:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787826301.018191:0:43900:0:(import.c:65:import_set_state_nolock()) ffff8eb349080000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826301.018267:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049371520:12345-0@lo:8:llog_process_th.0 Request processed in 1080us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.018276:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22603 00000100:00100000:2.0:1787826301.019034:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826301.019045:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:2.0:1787826301.019053:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787826301.019060:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787826301.019062:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45a03b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787826301.019087:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787826301.019094:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049371520:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1787826301.019166:0:196441:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787826301.019229:0:196441:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8367845903226ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787826301.019236:0:196441:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787826301.021816:0:196423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1787826301.022040:0:196435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826301.022075:0:196435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].82, 64 off13440 00000040:00080000:3.0:1787826301.022227:0:196435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14a:0x0].1, 64 off8256 00000100:00100000:3.0:1787826301.023247:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826301.023265:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049371648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826301.023575:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787826301.024686:0:196435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826301.024700:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787826301.024750:0:196435:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787826301.024771:0:196435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cedb2a 00000100:00080000:3.0:1787826301.024779:0:196435:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826301.024784:0:196435:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8eb349083800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826301.024809:0:196435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb48162b800 x1874663049371776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826301.024836:0:196435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787826301.024884:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826301.024888:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826301.024891:0:196435:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787826301.024894:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826301.024897:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826301.024898:0:196435:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787826301.024901:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787826301.024902:0:196435:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787826301.024904:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826301.024906:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826301.024907:0:196435:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787826301.024909:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826301.024912:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826301.024913:0:196435:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787826301.024917:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787826301.024946:0:196435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196435:1874663049371904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826301.025003:0:196435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.025030:0:196435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.025150:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049371904 00000100:00100000:1.0:1787826301.025157:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049371904 00000100:00100000:1.0:1787826301.025202:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826301.025212:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:196435:x1874663049371904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826301.025370:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:196435:x1874663049371904:12345-0@lo:502:llog_process_th.0 Request processed in 159us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.025378:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826301.025562:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049371776:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787826301.025599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.025892:0:196435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196435:1874663049371904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826301.025923:0:196435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826301.025928:0:196435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826301.025930:0:196435:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787826301.025934:0:196435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1787826301.026647:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049371776 00000100:00100000:3.0:1787826301.026655:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049371776 00000100:00100000:3.0:1787826301.026690:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22604 00000100:00100000:3.0:1787826301.026696:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3616:x1874663049371776:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787826301.026734:0:179223:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8367 last 0 00000020:00000080:3.0:1787826301.026759:0:179223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cedb31 00002000:00100000:3.0:1787826301.026771:0:179223:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8eb46e2a1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787826301.026775:0:179223:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787826301.026778:0:179223:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787826301.026843:0:179223:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787826301.026867:0:179223:0:(import.c:65:import_set_state_nolock()) ffff8eb46e2a3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826301.026936:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049371776:12345-0@lo:8:llog_process_th.0 Request processed in 238us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.026943:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22604 00000100:00100000:3.0:1787826301.026979:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826301.026987:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787826301.026995:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787826301.026999:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787826301.027002:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb349083800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787826301.027011:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787826301.027015:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049371776:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787826301.027078:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049372032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826301.027108:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787826301.027293:0:196422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787826301.027596:0:196422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787826301.027610:0:196422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.027620:0:196422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826301.027628:0:196422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb448c99000 from 1 10000000:01000000:0.0:1787826301.027630:0:196422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826301.027656:0:196422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.027670:0:196422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.027679:0:196422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.027695:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826301.027740:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.027764:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab240 going to sleep for 11 seconds 00000040:00080000:1.0:1787826301.027844:0:196443:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 82 synced_idx: 0 lgh_last_idx: 82 00000040:00080000:1.0:1787826301.027850:0:196443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x146:0x0] at index 81 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1787826301.028043:0:196443:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 81, last_idx 82 00000040:00080000:1.0:1787826301.028067:0:196443:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x146:0x0] at index 81 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1787826301.028198:0:196443:0:(llog.c:805:llog_process_thread()) index: 82, lh_last_idx: 82 synced_idx: 82 lgh_last_idx: 82 00000040:00080000:1.0:1787826301.028201:0:196443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14a:0x0] at index 82 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1787826301.028218:0:196443:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787826301.028241:0:196443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8367854915187ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787826301.028246:0:196443:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787826301.028288:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049372160 00000100:00100000:1.0:1787826301.028294:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049372160 00000100:00100000:1.0:1787826301.028366:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787826301.028375:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:196422:x1874663049372160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826301.028387:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.028400:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedb38 expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.028424:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 9 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.028444:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 9 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.028454:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65a00, rc 0) 00000100:00100000:1.0:1787826301.028500:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196422:x1874663049372160:12345-0@lo:101:mount.lustre.0 Request processed in 126us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.028507:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787826301.028553:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826301.028568:0:196422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.028577:0:196422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.029133:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372288:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787826301.029171:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.029196:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f7fdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.029279:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049372288 00000100:00100000:1.0:1787826301.029284:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049372288 00000100:00100000:1.0:1787826301.029314:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826301.029320:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196422:x1874663049372288:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787826301.029365:0:196429:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787826301.029378:0:196429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787826301.029381:0:196429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787826301.029384:0:196429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787826301.029386:0:196429:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 338 00000100:00100000:1.0:1787826301.029456:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196422:x1874663049372288:12345-0@lo:256:mount.lustre.0 Request processed in 135us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.029463:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826301.029499:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372288:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787826301.030120:0:196422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826301.030135:0:196422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.030145:0:196422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826301.030152:0:196422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb448c99000 from 1 10000000:01000000:1.0:1787826301.030156:0:196422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826301.030180:0:196422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.030187:0:196422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.030195:0:196422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.030209:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826301.030240:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.030256:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f7fdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.030279:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049372416 00000100:00100000:1.0:1787826301.030284:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049372416 00000100:00100000:1.0:1787826301.030308:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826301.030314:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:196422:x1874663049372416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826301.030343:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.030356:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65600/0x878a5eea00cedb4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedb46 expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.030375:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65600/0x878a5eea00cedb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedb46 expref: 10 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.030388:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65600/0x878a5eea00cedb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedb46 expref: 10 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.030395:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65600, rc 0) 00000100:00100000:1.0:1787826301.030424:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196422:x1874663049372416:12345-0@lo:101:mount.lustre.0 Request processed in 111us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.030429:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826301.030466:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826301.030476:0:196422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.030484:0:196422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.030533:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826301.030555:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.030568:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.030580:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049372544 00000100:00100000:1.0:1787826301.030584:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049372544 00000100:00100000:1.0:1787826301.030604:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826301.030611:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196422:x1874663049372544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826301.032599:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049371648 00000100:00100000:2.0:1787826301.032612:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049371648 00000100:00080000:2.0:1787826301.032650:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826301.032688:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049372032 00000100:00100000:2.0:1787826301.032692:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049372032 00000100:00100000:2.0:1787826301.032734:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5850 00000100:00100000:2.0:1787826301.032743:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049371648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826301.032770:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826301.032903:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5851 00000100:00100000:0.0:1787826301.032912:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049372032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826301.032937:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826301.033030:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049371648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 288us (9455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.033037:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5850 00000100:00080000:2.0:1787826301.033056:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826301.033123:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196422:x1874663049372544:12345-0@lo:501:mount.lustre.0 Request processed in 2510us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.033132:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826301.033183:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826301.033229:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826301.033278:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.033310:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.033550:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049371648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826301.033617:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049372672 00000100:00100000:2.0:1787826301.033621:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049372672 00000100:00100000:2.0:1787826301.033651:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787826301.033658:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196422:x1874663049372672:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826301.033762:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196422:x1874663049372672:12345-0@lo:503:mount.lustre.0 Request processed in 104us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.033768:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787826301.033843:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049372672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826301.034179:0:196445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196445:1874663049372800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826301.034214:0:196445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.034244:0:196445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.034284:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049372800 00000100:00100000:2.0:1787826301.034289:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049372800 00000100:00100000:2.0:1787826301.034515:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787826301.034525:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196445:x1874663049372800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826301.034901:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196445:x1874663049372800:12345-0@lo:502:llog_process_th.0 Request processed in 378us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.034909:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787826301.035127:0:196445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196445:1874663049372800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826301.035151:0:196445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826301.035159:0:196445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826301.035161:0:196445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787826301.035167:0:196445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb448c99000 00000020:00000080:2.0:1787826301.035169:0:196445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787826301.035176:0:196445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826301.035178:0:196445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826301.035179:0:196445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787826301.035181:0:196445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826301.035183:0:196445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826301.035184:0:196445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787826301.035187:0:196445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb448c99000 00000020:00000080:2.0:1787826301.035189:0:196445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787826301.035260:0:196445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196445:1874663049372928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826301.035296:0:196445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.035419:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049372928 00000100:00100000:3.0:1787826301.035423:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049372928 00000100:00100000:3.0:1787826301.035522:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787826301.035529:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196445:x1874663049372928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826301.035603:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196445:x1874663049372928:12345-0@lo:502:llog_process_th.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.035609:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787826301.036530:0:196445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47295a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.036553:0:196445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196445:1874663049372928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826301.036578:0:196445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826301.036583:0:196445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826301.036585:0:196445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787826301.036589:0:196445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787826301.037021:0:196422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1787826301.037045:0:196422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787826301.037060:0:196422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.037070:0:196422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826301.037117:0:196422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787826301.037120:0:196422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8eb448c99000 10000000:01000000:3.0:1787826301.037122:0:196422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8eb448c99000 10000000:01000000:3.0:1787826301.037126:0:196422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787826301.037130:0:196422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb448c99000 from 1 10000000:01000000:3.0:1787826301.037133:0:196422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787826301.037157:0:196422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.037165:0:196422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.037174:0:196422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.037188:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049373056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826301.037229:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.037251:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.037543:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049373056 00000100:00100000:3.0:1787826301.037551:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049373056 00000100:00100000:3.0:1787826301.037584:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787826301.037593:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:196422:x1874663049373056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826301.037604:0:196428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.037617:0:196428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf39400/0x878a5eea00cedb5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedb54 expref: -99 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.037639:0:196428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf39400/0x878a5eea00cedb5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedb54 expref: 11 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.037649:0:196428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf39400/0x878a5eea00cedb5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedb54 expref: 11 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.037661:0:196428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39400, rc 0) 00000100:00100000:3.0:1787826301.037697:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196422:x1874663049373056:12345-0@lo:101:mount.lustre.0 Request processed in 105us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.037704:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787826301.037764:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049373056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826301.037777:0:196422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.037787:0:196422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.037838:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049373184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826301.037866:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.037884:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.038019:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049373184 00000100:00100000:2.0:1787826301.038023:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049373184 00000100:00100000:2.0:1787826301.038051:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787826301.038058:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196422:x1874663049373184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826301.038166:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196422:x1874663049373184:12345-0@lo:501:mount.lustre.0 Request processed in 109us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.038173:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787826301.038551:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049372032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5638us (11440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.038562:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5851 00000004:00080000:0.0:1787826301.039170:0:196423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787826301.039276:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049372032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826301.039622:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049373184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826301.039669:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049373312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826301.039736:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.039768:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.039826:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049373312 00000100:00100000:2.0:1787826301.039832:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049373312 00000100:00100000:2.0:1787826301.039874:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787826301.039883:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196422:x1874663049373312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826301.040781:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196422:x1874663049373312:12345-0@lo:503:mount.lustre.0 Request processed in 895us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.040790:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787826301.041106:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049373312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826301.056227:0:196446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196446:1874663049373440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826301.056438:0:196446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.056520:0:196446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.058462:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049373440 00000100:00100000:3.0:1787826301.058475:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049373440 00000100:00100000:3.0:1787826301.058536:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787826301.058546:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196446:x1874663049373440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826301.058704:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196446:x1874663049373440:12345-0@lo:502:llog_process_th.0 Request processed in 160us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.059082:0:196446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196446:1874663049373440:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787826301.059168:0:196446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787826301.059211:0:196446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8eb48145cd28) 00000020:00000080:1.0:1787826301.059238:0:196446:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787826301.059386:0:196446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb448c99000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787826301.059390:0:196446:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb448c99000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787826301.059393:0:196446:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb448c99000 4 00010000:00080000:1.0:1787826301.059433:0:196446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb348a38000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:1.0:1787826301.061048:0:196446:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1787826301.061277:0:196446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787826301.061312:0:196446:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787826301.061347:0:196446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x878a5eea00cedb69 00000100:00080000:1.0:1787826301.061357:0:196446:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787826301.061362:0:196446:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb348a38000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826301.061394:0:196446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb342775880 x1874663049373568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826301.061420:0:196446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787826301.065053:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787826301.065107:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049373568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826301.065170:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826301.066012:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049373568 00000100:00100000:2.0:1787826301.066021:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049373568 00000100:00100000:2.0:1787826301.066068:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1787826301.066076:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049373568:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826301.066153:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049373568:12345-0@lo:38:llog_process_th.0 Request processed in 76us (982us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787826301.066160:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1787826301.066202:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826301.066210:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb348a38000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826301.066214:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787826301.066217:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049373568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826301.066868:0:196446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481628700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196446:1874663049373696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826301.066930:0:196446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.066956:0:196446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.066997:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049373696 00000100:00100000:2.0:1787826301.067002:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049373696 00000100:00100000:2.0:1787826301.067040:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826301.067048:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196446:x1874663049373696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826301.067582:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196446:x1874663049373696:12345-0@lo:502:llog_process_th.0 Request processed in 533us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.067590:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787826301.073485:0:196446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481628700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196446:1874663049373696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826301.073590:0:196446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196446:1874663049373824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826301.073664:0:196446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.073752:0:196446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1aba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.084313:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049373824 00000100:00100000:1.0:1787826301.084339:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049373824 00000100:00100000:1.0:1787826301.084398:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787826301.084409:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196446:x1874663049373824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826301.084582:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196446:x1874663049373824:12345-0@lo:502:llog_process_th.0 Request processed in 174us (10918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.084590:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787826301.084671:0:196446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:196446:1874663049373824:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787826301.084705:0:196446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787826301.084912:0:196422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787826301.084941:0:196422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787826301.084962:0:196422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.084975:0:196422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826301.085022:0:196422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787826301.085024:0:196422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826301.085026:0:196422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826301.085027:0:196422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826301.085028:0:196422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826301.085030:0:196422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826301.085031:0:196422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826301.085033:0:196422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826301.085035:0:196422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826301.085036:0:196422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787826301.085039:0:196422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787826301.085041:0:196422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826301.085042:0:196422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826301.085043:0:196422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826301.085044:0:196422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826301.085045:0:196422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826301.085047:0:196422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826301.085047:0:196422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826301.085049:0:196422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826301.085050:0:196422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826301.085050:0:196422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787826301.085070:0:196422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787826301.085096:0:196422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049373952:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787826301.085134:0:196422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.085161:0:196422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34e1ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.087986:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049373952 00000100:00100000:0.0:1787826301.088001:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049373952 00000100:00100000:0.0:1787826301.088059:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787826301.088068:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196422:x1874663049373952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787826301.088115:0:196427:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787826301.088130:0:196427:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787826301.094630:0:196427:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826301.094651:0:196427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787826301.094909:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:196422:x1874663049373952:12345-0@lo:253:mount.lustre.0 Request processed in 6836us (9769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.094922:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787826301.095012:0:196422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:196422:1874663049373952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787826301.095025:0:196422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787826301.095028:0:196422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826301.095029:0:196422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826301.095031:0:196422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826301.095032:0:196422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826301.095033:0:196422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826301.095034:0:196422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826301.095035:0:196422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826301.095037:0:196422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826301.095038:0:196422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826301.095039:0:196422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787826301.095052:0:196422:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787826301.095917:0:196432:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787826301.095922:0:196432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787826301.095940:0:196432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.095957:0:196432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 10 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.095965:0:196432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.096002:0:196432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 10 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.096018:0:196432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 10 pid: 196427 timeout: 8467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.096032:0:196432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196432:1874663049374080:0@lo:104: 00000100:00100000:1.0:1787826301.096095:0:196432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.096136:0:196432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.096258:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787826301.096275:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049374080 00000100:00100000:0.0:1787826301.096281:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049374080 00000100:00100000:0.0:1787826301.096354:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4773 00000100:00100000:0.0:1787826301.096364:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48169e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:196432:x1874663049374080:12345-0@lo:104: 00010000:00010000:0.0:1787826301.096378:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.096422:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826301.096429:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48169e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:196432:x1874663049374080:12345-0@lo:104: Request processed in 67us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.096435:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4773 00010000:00010000:1.0:1787826301.097293:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826301.097300:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097313:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1787826301.097317:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097428:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826301.097437:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826301.097443:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826301.097481:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097488:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826301.097507:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097513:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedb38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedb3f expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097529:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826301.097530:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826301.097532:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826301.097544:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049374208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826301.097587:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.097632:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049374208 00000100:00100000:1.0:1787826301.097638:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049374208 00010000:00010000:1.0:1787826301.097659:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 11 pid: 196427 timeout: 8467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.097681:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12229 00000100:00100000:1.0:1787826301.097688:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:3617:x1874663049374208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826301.097700:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.097705:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 11 pid: 196427 timeout: 8467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097729:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 11 pid: 196427 timeout: 8467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097744:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097751:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787826301.097764:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001842395s 00010000:00010000:1.0:1787826301.097769:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097776:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097784:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097790:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097795:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826301.097800:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097807:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097815:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097824:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826301.097856:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:3617:x1874663049374208:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.097862:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12229 00000100:00100000:1.0:1787826301.097895:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049374208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826301.097921:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedb3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cedb38 expref: 10 pid: 196427 timeout: 8467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.097931:0:196432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196432:1874663049374080:0@lo:104: 00010000:00010000:1.0:1787826301.097942:0:196432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097950:0:196432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097956:0:196432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.097962:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65400/0x878a5eea00cedb70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826301.104317:0:196422:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 330712484068 00000040:01000000:2.0:1787826301.106034:0:196422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787826301.106103:0:196453:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 330712484068 00000020:00080000:1.0:1787826301.106107:0:196453:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484068 00000040:01000000:2.0:1787826301.106360:0:196454:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787826301.115046:0:196454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787826301.115129:0:196454:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1787826301.115507:0:196422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1787826301.116475:0:196455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196455:1874663049374336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826301.116546:0:196455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.116577:0:196455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.116699:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049374336 00000100:00100000:3.0:1787826301.116706:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049374336 00000100:00100000:3.0:1787826301.116763:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12762 00000100:00100000:3.0:1787826301.116772:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196455:x1874663049374336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826301.116850:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196455:x1874663049374336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.116857:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12762 00000100:00100000:1.0:1787826301.117035:0:196455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196455:1874663049374336:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787826301.117064:0:196455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787826301.117089:0:196455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196455:1874663049374464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826301.117119:0:196455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.117144:0:196455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.117186:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049374464 00000100:00100000:3.0:1787826301.117190:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049374464 00000100:00100000:3.0:1787826301.117226:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12763 00000100:00100000:3.0:1787826301.117233:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196455:x1874663049374464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826301.118014:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196455:x1874663049374464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 778us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.118024:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12763 00000100:00100000:1.0:1787826301.118172:0:196455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196455:1874663049374464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826301.118241:0:196455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196455:1874663049374592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826301.118272:0:196455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.118300:0:196455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.119554:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049374592 00000100:00100000:3.0:1787826301.119566:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049374592 00000100:00100000:3.0:1787826301.119625:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12764 00000100:00100000:3.0:1787826301.119635:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196455:x1874663049374592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826301.119742:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196455:x1874663049374592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 108us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.119750:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12764 00000100:00100000:1.0:1787826301.119832:0:196455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196455:1874663049374592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826301.119931:0:196455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196455:1874663049374720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826301.119997:0:196455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.120028:0:196455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.120493:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049374720 00000100:00100000:0.0:1787826301.120500:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049374720 00000100:00100000:0.0:1787826301.120533:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12765 00000100:00100000:0.0:1787826301.120541:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196455:x1874663049374720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826301.120754:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196455:x1874663049374720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 213us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.120762:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12765 00000100:00100000:1.0:1787826301.120867:0:196455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196455:1874663049374720:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1787826301.125526:0:196422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787826301.125572:0:196422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826301.126586:0:196455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787826301.126669:0:196455:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787826301.126674:0:196455:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1787826301.126940:0:196422:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787826301.126951:0:196422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787826301.127014:0:196422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826301.127959:0:196422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787826301.129241:0:196422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787826301.129296:0:196422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787826301.129497:0:196422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787826301.130087:0:196422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x85:0x0] (8/32) registered 00010000:00080000:2.0:1787826301.136153:0:196422:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 347892350983 00010000:00080000:3.0:1787826301.138132:0:196456:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 196456 00010000:02000000:3.0:1787826301.138151:0:196456:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1787826301.138155:0:196456:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1787826301.138158:0:196456:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1787826301.138247:0:196422:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787826301.138265:0:196422:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787826301.138284:0:196422:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787826301.138300:0:196422:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787826301.151273:0:196422:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826301.151753:0:196422:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787826301.783210:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826301.786721:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 10000000:01000000:3.0:1787826301.919778:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826301.919786:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb448c99000 from 339 10000000:01000000:3.0:1787826301.919791:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826301.919834:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.919845:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.919856:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.919882:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049374848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826301.919951:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.919998:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb343764cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.920056:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049374848 00000100:00100000:0.0:1787826301.920064:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049374848 00000100:00100000:0.0:1787826301.920116:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787826301.920125:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:6488:x1874663049374848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826301.920138:0:196428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.920154:0:196428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedb77 expref: -99 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.920176:0:196428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 11 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.920187:0:196428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 11 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.920195:0:196428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569c00, rc 0) 00000100:00100000:0.0:1787826301.920240:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049374848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.920246:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826301.920495:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049374848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826301.920511:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.920519:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.920572:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049374976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787826301.920602:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.920632:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb343764cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.920681:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049374976 00000100:00100000:0.0:1787826301.920686:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049374976 00000100:00100000:0.0:1787826301.920723:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787826301.920730:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049374976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826301.920744:0:196434:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787826301.920763:0:196434:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826301.920766:0:196434:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 339 00000100:00100000:0.0:1787826301.920841:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049374976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.920848:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787826301.920968:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049374976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787826301.921011:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787826301.921018:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.921025:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826301.921033:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787826301.921036:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb44908e800 from 52 10000000:01000000:3.0:1787826301.921037:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787826301.921054:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.921060:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.921067:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.921080:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826301.921103:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.921123:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb343764cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.921168:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049375104 00000100:00100000:0.0:1787826301.921172:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049375104 00000100:00100000:0.0:1787826301.921204:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787826301.921212:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:6488:x1874663049375104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826301.921222:0:196428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.921233:0:196428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a568e00/0x878a5eea00cedb8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedb85 expref: -99 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.921249:0:196428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a568e00/0x878a5eea00cedb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedb85 expref: 12 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.921258:0:196428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a568e00/0x878a5eea00cedb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedb85 expref: 12 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.921266:0:196428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568e00, rc 0) 00000100:00100000:0.0:1787826301.921301:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049375104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.921307:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787826301.921417:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826301.921429:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb8c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.921437:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedb8c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.921489:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.921516:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826301.921537:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049375232 00000100:00100000:2.0:1787826301.921541:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049375232 00000100:00100000:2.0:1787826301.921560:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787826301.921566:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049375232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.921663:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049375232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.921670:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787826301.921691:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.921712:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.921742:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.921782:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826301.928247:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.928443:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049375360 00000100:00100000:2.0:1787826301.928451:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049375360 00000100:00100000:2.0:1787826301.928519:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787826301.928530:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049375360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.928671:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049375360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (6887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.928679:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787826301.928748:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787826301.930095:0:196493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1787826301.930386:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1787826301.930411:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787826301.930422:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb8c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.930433:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb8c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826301.930443:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787826301.930446:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787826301.930449:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787826301.930481:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.930489:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.930499:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.930523:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481628700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826301.930580:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.930617:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3437649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.936221:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049375488 00000100:00100000:2.0:1787826301.936235:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049375488 00000100:00100000:2.0:1787826301.936286:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787826301.936295:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+12:6488:x1874663049375488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826301.936312:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.936345:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce3200/0x878a5eea00cedb9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedb93 expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.936371:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce3200/0x878a5eea00cedb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedb93 expref: 13 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.936383:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce3200/0x878a5eea00cedb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedb93 expref: 13 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.936391:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce3200, rc 0) 00000100:00100000:2.0:1787826301.936470:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049375488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.936477:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826301.941671:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481628700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826301.941699:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb9a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.941722:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedb9a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.941802:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826301.941858:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.941900:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ede5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.941945:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049375616 00000100:00100000:2.0:1787826301.941963:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049375616 00000100:00100000:2.0:1787826301.942010:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787826301.942020:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049375616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.942156:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049375616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.942163:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787826301.942316:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342775c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826301.942378:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826301.942421:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826301.942439:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3437640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.942509:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049375744 00000100:00100000:1.0:1787826301.942514:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049375744 00000100:00100000:1.0:1787826301.942536:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826301.942542:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049375744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826301.949185:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049375744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6632us (6754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.949200:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787826301.949355:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826301.950261:0:196495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1787826301.950513:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1787826301.950540:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787826301.950551:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb9a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.950563:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb9a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826301.950572:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787826301.950575:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb44908e800 from 7 10000000:01000000:0.0:1787826301.950578:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826301.950612:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.950625:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.950635:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.950657:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826301.950719:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.950758:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.950842:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049375872 00000100:00100000:1.0:1787826301.950849:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049375872 00000100:00100000:1.0:1787826301.950929:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826301.950940:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+13:6488:x1874663049375872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826301.950966:0:196429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.950979:0:196429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64c00/0x878a5eea00cedba8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedba1 expref: -99 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.951001:0:196429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64c00/0x878a5eea00cedba8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedba1 expref: 14 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.951012:0:196429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64c00/0x878a5eea00cedba8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedba1 expref: 14 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.951020:0:196429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64c00, rc 0) 00000100:00100000:1.0:1787826301.951059:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049375872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.951065:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826301.977130:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049375872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826301.977158:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedba8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.977170:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedba8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.977247:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826301.977305:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.977379:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ede5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.977441:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049376000 00000100:00100000:0.0:1787826301.977448:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049376000 00000100:00100000:0.0:1787826301.977495:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787826301.977507:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049376000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826301.977634:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049376000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.977641:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787826301.977833:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826301.977863:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826301.977906:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.977929:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ede5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.977969:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049376128 00000100:00100000:0.0:1787826301.977973:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049376128 00000100:00100000:0.0:1787826301.978001:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787826301.978007:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049376128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826301.978089:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049376128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.978096:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787826301.978160:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826301.980718:0:196499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787826301.982622:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787826301.982665:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787826301.982676:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedba8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.982689:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedba8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826301.982698:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787826301.982713:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb34df96000 from 52 10000000:01000000:0.0:1787826301.982717:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826301.982751:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.982759:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.982769:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826301.982793:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826301.982857:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826301.982900:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.996236:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049376256 00000100:00100000:2.0:1787826301.996255:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049376256 00000100:00100000:2.0:1787826301.996311:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826301.996321:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+14:6488:x1874663049376256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826301.996358:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.996378:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce2e00/0x878a5eea00cedbb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedbaf expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.996407:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce2e00/0x878a5eea00cedbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedbaf expref: 15 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.996419:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce2e00/0x878a5eea00cedbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedbaf expref: 15 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.996428:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2e00, rc 0) 00000100:00100000:2.0:1787826301.996504:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049376256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (13647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.996511:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826301.996566:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826301.996583:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.996593:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.996657:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.996681:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826301.996721:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.996739:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049376384 00000100:00100000:2.0:1787826301.996742:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049376384 00000100:00100000:2.0:1787826301.996766:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826301.996773:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049376384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.996878:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049376384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.996885:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826301.996917:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.996941:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.997147:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826301.997168:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.997179:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049376512 00000100:00100000:2.0:1787826301.997182:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049376512 00000100:00100000:2.0:1787826301.997282:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826301.997290:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049376512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826301.997396:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049376512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.997402:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826301.999693:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826302.000807:0:196503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1787826302.000929:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1787826302.001029:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826302.001041:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.001051:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826302.001060:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787826302.001063:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb34df96000 from 336 10000000:01000000:2.0:1787826302.001066:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826302.001100:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.001108:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.001118:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.001142:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826302.001206:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826302.001313:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ede5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.001801:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049376640 00000100:00100000:0.0:1787826302.001808:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049376640 00000100:00100000:0.0:1787826302.001858:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787826302.001868:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+15:6488:x1874663049376640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826302.001881:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.001893:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a568600/0x878a5eea00cedbc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedbbd expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.001916:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a568600/0x878a5eea00cedbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedbbd expref: 16 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.001931:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a568600/0x878a5eea00cedbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedbbd expref: 16 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.001939:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568600, rc 0) 00000100:00100000:0.0:1787826302.002126:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049376640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 258us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.002133:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787826302.002204:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826302.002219:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.002227:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.002274:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.002309:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.002352:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.002366:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049376768 00000100:00100000:1.0:1787826302.002369:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049376768 00000100:00100000:1.0:1787826302.002393:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787826302.002400:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049376768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826302.002413:0:196428:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826302.002428:0:196428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826302.002432:0:196428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787826302.002435:0:196428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787826302.002437:0:196428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787826302.002439:0:196428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 339 00000100:00100000:1.0:1787826302.002513:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049376768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.002520:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787826302.002552:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787826302.002621:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826302.002627:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.002635:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826302.002647:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787826302.002649:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1787826302.002651:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787826302.002668:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.002675:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.002682:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.002695:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.002728:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.002741:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.002747:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049376896 00000100:00100000:3.0:1787826302.002752:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049376896 00000100:00100000:3.0:1787826302.002791:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787826302.002799:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+16:6488:x1874663049376896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826302.002807:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.002821:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf38a00/0x878a5eea00cedbd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedbcb expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.002840:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf38a00/0x878a5eea00cedbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedbcb expref: 17 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.002849:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf38a00/0x878a5eea00cedbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedbcb expref: 17 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.002859:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38a00, rc 0) 00000100:00100000:3.0:1787826302.002903:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049376896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.002909:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787826302.003109:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049376896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826302.003120:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.003128:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.003173:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.003200:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.003214:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.003224:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049377024 00000100:00100000:1.0:1787826302.003227:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049377024 00000100:00100000:1.0:1787826302.003261:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787826302.003268:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049377024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.003408:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049377024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.003415:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787826302.003441:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.003464:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.003500:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.003519:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.003530:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049377152 00000100:00100000:1.0:1787826302.003533:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049377152 00000100:00100000:1.0:1787826302.003646:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787826302.003653:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049377152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.004260:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049377152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 605us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.004268:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787826302.004315:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826302.008065:0:196504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1787826302.011511:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1787826302.011558:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787826302.011570:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.011582:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826302.011592:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1787826302.011595:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb34df96000 from 1 10000000:01000000:1.0:1787826302.011598:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787826302.011636:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.011644:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.011654:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.011678:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.011757:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.011833:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.016733:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049377280 00000100:00100000:2.0:1787826302.016748:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049377280 00000100:00100000:2.0:1787826302.016842:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787826302.016853:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+17:6488:x1874663049377280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826302.016871:0:196428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826302.016890:0:196428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb481ce2a00/0x878a5eea00cedbe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedbd9 expref: -99 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.016917:0:196428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481ce2a00/0x878a5eea00cedbe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedbd9 expref: 18 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.016928:0:196428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb481ce2a00/0x878a5eea00cedbe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedbd9 expref: 18 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.016938:0:196428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481ce2a00, rc 0) 00000100:00100000:2.0:1787826302.017022:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049377280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (5264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.017029:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787826302.017107:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826302.017126:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.017135:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826302.017152:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787826302.017158:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.017165:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826302.017178:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787826302.017180:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb34df96000 from 7 10000000:01000000:3.0:1787826302.017183:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826302.017204:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.017212:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.017220:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826302.017237:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826302.017271:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826302.017539:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb343764f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.020092:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049377408 00000100:00100000:0.0:1787826302.020105:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049377408 00000100:00100000:0.0:1787826302.020164:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826302.020174:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+18:6488:x1874663049377408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826302.020190:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.020206:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a569400/0x878a5eea00cedbee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedbe7 expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.020230:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a569400/0x878a5eea00cedbee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedbe7 expref: 19 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.020240:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a569400/0x878a5eea00cedbee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedbe7 expref: 19 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.020248:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569400, rc 0) 00000100:00100000:0.0:1787826302.020313:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049377408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.020320:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826302.020461:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826302.020478:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.020488:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.020558:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.020591:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.020633:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.020645:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049377536 00000100:00100000:1.0:1787826302.020650:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049377536 00000100:00100000:1.0:1787826302.020684:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787826302.020692:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049377536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.020887:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049377536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.020894:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826302.021428:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.021461:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.021507:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.021576:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.022774:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049377664 00000100:00100000:2.0:1787826302.022784:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049377664 00000100:00100000:2.0:1787826302.022832:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787826302.022841:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049377664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826302.023336:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049377664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 481us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.023346:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787826302.023520:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826302.025760:0:196509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787826302.025959:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787826302.025986:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826302.025997:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.026010:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826302.026020:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787826302.026023:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb47bfd6800 from 52 10000000:01000000:2.0:1787826302.026026:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826302.026061:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.026069:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.026079:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826302.026100:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826302.026161:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826302.026268:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.027465:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049377792 00000100:00100000:3.0:1787826302.027476:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049377792 00000100:00100000:3.0:1787826302.027531:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787826302.027542:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:6488:x1874663049377792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826302.027558:0:196429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.027574:0:196429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf39200/0x878a5eea00cedbfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedbf5 expref: -99 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.027599:0:196429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf39200/0x878a5eea00cedbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedbf5 expref: 20 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.027610:0:196429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf39200/0x878a5eea00cedbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedbf5 expref: 20 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.027623:0:196429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39200, rc 0) 00000100:00100000:3.0:1787826302.027684:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049377792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.027691:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826302.028556:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826302.028577:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbfc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.028588:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbfc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.028666:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.028720:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.028753:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.028769:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049377920 00000100:00100000:0.0:1787826302.028774:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049377920 00000100:00100000:0.0:1787826302.028804:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826302.028813:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049377920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.028930:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049377920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.028937:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826302.028986:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049377920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.029013:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.029050:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.029065:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.029076:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049378048 00000100:00100000:0.0:1787826302.029079:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049378048 00000100:00100000:0.0:1787826302.029100:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787826302.029106:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049378048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.029180:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049378048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.029187:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787826302.029226:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826302.030234:0:196510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1787826302.033598:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1787826302.033635:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826302.033647:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbfc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.033660:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbfc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826302.033671:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787826302.033675:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1787826302.033678:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787826302.033727:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.033736:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.033746:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.033771:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.033840:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.033917:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.034090:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049378176 00000100:00100000:0.0:1787826302.034097:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049378176 00000100:00100000:0.0:1787826302.034148:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787826302.034158:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:6488:x1874663049378176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826302.034171:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826302.034183:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a568400/0x878a5eea00cedc0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedc03 expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.034211:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a568400/0x878a5eea00cedc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedc03 expref: 21 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.034221:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a568400/0x878a5eea00cedc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedc03 expref: 21 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.034228:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568400, rc 0) 00000100:00100000:0.0:1787826302.034277:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049378176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.034284:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787826302.034382:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826302.034396:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc0a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.034404:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedc0a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.034455:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.034481:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.034502:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.034620:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049378304 00000100:00100000:0.0:1787826302.034624:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049378304 00000100:00100000:0.0:1787826302.034650:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787826302.034656:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049378304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.034796:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049378304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.034803:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787826302.036750:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.036807:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.036880:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.036924:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb348c3b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.036979:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049378432 00000100:00100000:0.0:1787826302.036987:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049378432 00000100:00100000:0.0:1787826302.037039:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787826302.037049:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049378432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.039646:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049378432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2589us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.039659:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787826302.040074:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826302.041137:0:196512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1787826302.041293:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1787826302.041399:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787826302.041412:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc0a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.041422:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc0a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826302.041431:0:6488:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787826302.041433:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb47bfd6800 from 7 10000000:01000000:0.0:1787826302.041436:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826302.041470:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.041478:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.041486:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.041505:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.041561:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.041600:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.041664:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049378560 00000100:00100000:1.0:1787826302.041671:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049378560 00000100:00100000:1.0:1787826302.041726:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826302.041735:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:6488:x1874663049378560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826302.041750:0:196428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.041761:0:196428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65c00/0x878a5eea00cedc18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedc11 expref: -99 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.041784:0:196428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65c00/0x878a5eea00cedc18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedc11 expref: 22 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.041796:0:196428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65c00/0x878a5eea00cedc18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedc11 expref: 22 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.041805:0:196428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65c00, rc 0) 00000100:00100000:1.0:1787826302.041842:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049378560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.041848:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787826302.041922:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826302.041935:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc18 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.041944:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedc18 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.042252:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.042282:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.042310:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.042366:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049378688 00000100:00100000:2.0:1787826302.042371:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049378688 00000100:00100000:2.0:1787826302.042398:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787826302.042406:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049378688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826302.042521:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049378688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.042528:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787826302.043067:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.043100:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.043139:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.043171:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826302.043288:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049378816 00000100:00100000:2.0:1787826302.043294:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049378816 00000100:00100000:2.0:1787826302.043408:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787826302.043416:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049378816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826302.043501:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049378816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.043509:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787826302.046190:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826302.048422:0:196514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787826302.048608:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787826302.048633:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826302.048644:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc18 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.048655:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc18 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826302.048666:0:6488:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1787826302.048669:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8eb46a873370 from 1 10000000:01000000:1.0:1787826302.048672:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787826302.048722:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.048730:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.048741:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826302.048765:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.048827:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.048905:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826302.048996:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049378944 00000100:00100000:3.0:1787826302.049003:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049378944 00000100:00100000:3.0:1787826302.049079:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787826302.049091:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049378944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826302.049104:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.049118:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cedc26 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedc1f expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.049139:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cedc26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedc1f expref: 23 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.049149:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cedc26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedc1f expref: 23 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826302.049157:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38c00, rc 0) 00000100:00100000:3.0:1787826302.049299:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049378944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826302.049306:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787826302.049481:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049378944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826302.049495:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc26 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.049504:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedc26 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826302.049522:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787826302.049526:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc26 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.049534:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc26 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826302.049540:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787826302.049542:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8eb46a873370 from 1 10000000:01000000:0.0:1787826302.049544:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787826302.049560:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.049573:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.049580:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.049594:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049379072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.049623:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826302.049767:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049379072 00000100:00100000:1.0:1787826302.049773:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049379072 00000100:00100000:1.0:1787826302.049803:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787826302.049810:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049379072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826302.049819:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826302.049829:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedc34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedc2d expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.049844:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedc2d expref: 24 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.049852:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedc2d expref: 24 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.049863:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65a00, rc 0) 00000100:00100000:1.0:1787826302.049889:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049379072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.049895:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787826302.050000:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826302.050014:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049379072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826302.050026:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826302.050033:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826302.050080:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049379200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826302.050104:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826302.056597:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826302.057076:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049379200 00000100:00100000:1.0:1787826302.057086:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049379200 00000100:00100000:1.0:1787826302.057154:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787826302.057165:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049379200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826302.057375:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049379200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (7257us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826302.057383:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787826302.057871:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049379200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787826302.057915:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787826302.057924:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826302.057935:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:02000400:2.0:1787826302.293382:0:193620:0:(service.c:2875:ptlrpc_watchdog_fire()) mdt00_002: service thread pid 187906 was inactive for 41.548 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: 00000100:00100000:3.0:1787826302.719172:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826302.719220:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826302.719385:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043000448 00000100:00100000:0.0:1787826302.719396:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043000448 00000100:00100000:0.0:1787826302.719461:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 327 00000100:00100000:0.0:1787826302.719473:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663043000448:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826302.719557:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663043000448:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 86us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826302.719564:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 327 00000100:00100000:1.0:1787826302.719839:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043000192 00000100:00100000:1.0:1787826302.719844:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043000192 00000100:00100000:1.0:1787826302.719873:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:1.0:1787826302.719880:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2388:x1874663043000192:12345-192.168.203.47@tcp:250:kworker.0 00010000:00080000:1.0:1787826302.719902:0:196427:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f40147eb-9b53-47d4-b77c-99ceedd9664c@192.168.203.47@tcp t0 exp 0000000000000000 cur 8369 last 0 00000020:00000080:1.0:1787826302.719934:0:196427:0:(genops.c:1385:class_connect()) connect: client f40147eb-9b53-47d4-b77c-99ceedd9664c, cookie 0x878a5eea00cedc3b 00000100:00080000:1.0:1787826302.720074:0:196427:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826302.720124:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+5:2388:x1874663043000192:12345-192.168.203.47@tcp:250:kworker.0 Request processed in 243us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826302.720131:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:3.0:1787826302.720991:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826302.732951:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043000320 00000100:00100000:2.0:1787826302.732966:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043000320 00000100:00100000:2.0:1787826302.733035:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1087 00000100:00100000:2.0:1787826302.733044:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1874663043000320:12345-192.168.203.47@tcp:38:kworker.0 00010000:00080000:2.0:1787826302.733078:0:187904:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'c0d7758a-4501-4a89-8ec1-407fef4f0c7f' at ffff8eb34b9e0000, cookie 0x878a5eea00cedac1 00010000:00080000:2.0:1787826302.733084:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp recovering/t347892350982 exp ffff8eb34b9e0000 cur 8369 last 1787826300 00010000:02000400:2.0:1787826302.733093:0:187904:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1787826302.733100:0:187904:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1787826302.733127:0:187904:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787826302.733276:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb3434f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826302.733373:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043000320:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 328us (12385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826302.733380:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1087 00000100:00100000:0.0:1787826302.756098:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826302.756193:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042993408 00000100:00100000:3.0:1787826302.756202:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042993408 00000100:00100000:3.0:1787826302.756265:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1088 00000100:00100000:3.0:1787826302.756278:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663042993408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00080000:3.0:1787826302.756299:0:188992:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350984, current: 347892350982, replaying 00010000:00010000:3.0:1787826302.756310:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826302.756385:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedc42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f219 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826302.757104:0:188992:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 672us 00000004:00200000:1.0:1787826302.793751:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00000004:00080000:1.0:1787826302.793781:0:188992:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200027cd1:0x2:0x0], cookie = 0x878a5eea00ced9c5 00000004:00080000:1.0:1787826302.793784:0:188992:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x878a5eea00ced9c5 in new mfd 00010000:00010000:1.0:1787826302.793932:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedc42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f219 expref: 8 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.793949:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb34d1bd100) 00010000:00010000:1.0:1787826302.793951:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826302.793956:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedc42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f219 expref: 8 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826302.793975:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39e00, rc 0) 00000100:00100000:1.0:1787826302.794174:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2388:x1874663042993408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 37898us (38084us total) trans 347892350982 rc 301/301 00000100:00100000:1.0:1787826302.794184:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1088 00000100:00100000:1.0:1787826302.801620:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826302.802095:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042995200 00000100:00100000:2.0:1787826302.802106:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042995200 00000100:00100000:2.0:1787826302.802173:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1089 00000100:00100000:2.0:1787826302.802183:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2388:x1874663042995200:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00080000:2.0:1787826302.802203:0:187904:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350984, current: 347892350984, replaying 00000100:00100000:2.0:1787826302.802218:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2388:x1874663042995200:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 37us (609us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826302.802224:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1089 00010000:00080000:3.0:1787826302.802739:0:196456:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1787826302.804820:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:2.0:1787826302.805853:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826303.828801:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826303.828883:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826303.828905:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049379328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826303.828974:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.829085:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00000100:00100000:0.0:1787826303.829149:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049379328 00000100:00100000:0.0:1787826303.829157:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049379328 00000100:00100000:0.0:1787826303.829222:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5852 00000100:00100000:0.0:1787826303.829232:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049379328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826303.829260:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826303.829305:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049379328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.829312:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5852 00000100:00080000:3.0:1787826303.829474:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826303.829508:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049379328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826304.192456:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826304.192537:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043000576 00000100:00100000:1.0:1787826304.192548:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043000576 00000100:00100000:1.0:1787826304.192606:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:1.0:1787826304.192617:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+5:159735:x1874663043000576:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826304.192634:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826304.192651:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f22e expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.192679:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 6 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.192702:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 6 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.192712:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64a00, rc 0) 00000100:00100000:1.0:1787826304.192774:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+6:159735:x1874663043000576:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 159us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.192782:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:1.0:1787826304.196409:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826304.196444:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043000704 00000100:00100000:1.0:1787826304.196463:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043000704 00000100:00100000:1.0:1787826304.196520:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:1.0:1787826304.196531:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+6:159735:x1874663043000704:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826304.196556:0:196427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1787826304.196572:0:196427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826304.196576:0:196427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787826304.196578:0:196427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787826304.196582:0:196427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787826304.196584:0:196427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 339 00000100:00100000:3.0:1787826304.198945:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+6:159735:x1874663043000704:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 Request processed in 2406us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826304.198960:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:2.0:1787826304.208219:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826304.208361:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043000832 00000100:00100000:1.0:1787826304.208371:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043000832 00000100:00100000:1.0:1787826304.208426:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:1.0:1787826304.208437:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+6:159735:x1874663043000832:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826304.208519:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826304.208537:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64e00/0x878a5eea00cedc57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f235 expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.208562:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64e00/0x878a5eea00cedc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f235 expref: 7 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.208572:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64e00/0x878a5eea00cedc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f235 expref: 7 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.208580:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64e00, rc 0) 00000100:00100000:1.0:1787826304.208633:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+7:159735:x1874663043000832:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 199us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.208641:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:2.0:1787826304.218757:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826304.218831:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043000960 00000100:00100000:0.0:1787826304.218841:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043000960 00000100:00100000:0.0:1787826304.218896:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:0.0:1787826304.218907:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+7:159735:x1874663043000960:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826304.219101:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159735:x1874663043000960:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 195us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826304.219110:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:1.0:1787826304.229640:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826304.229776:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043001088 00000100:00100000:2.0:1787826304.229785:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043001088 00000100:00100000:2.0:1787826304.229862:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:2.0:1787826304.229873:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159735:x1874663043001088:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826304.230036:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159735:x1874663043001088:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 163us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826304.230044:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:3.0:1787826304.237538:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826304.238428:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043001216 00000100:00100000:1.0:1787826304.238440:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043001216 00000100:00100000:1.0:1787826304.238539:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:1.0:1787826304.238552:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+8:159735:x1874663043001216:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826304.238568:0:196428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826304.238585:0:196428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d64000/0x878a5eea00cedc5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f23c expref: -99 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.238613:0:196428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d64000/0x878a5eea00cedc5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f23c expref: 9 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.238624:0:196428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d64000/0x878a5eea00cedc5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f23c expref: 9 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.238634:0:196428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d64000, rc 0) 00000100:00100000:1.0:1787826304.238701:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159735:x1874663043001216:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 152us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.238708:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:0.0:1787826304.255676:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826304.256064:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043001344 00000100:00100000:1.0:1787826304.256074:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043001344 00000100:00100000:1.0:1787826304.256131:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:1.0:1787826304.256141:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159735:x1874663043001344:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826304.256276:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159735:x1874663043001344:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 135us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.256284:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:1.0:1787826304.264209:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826304.264278:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043001472 00000100:00100000:3.0:1787826304.264290:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043001472 00000100:00100000:1.0:1787826304.264738:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:1.0:1787826304.264752:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159735:x1874663043001472:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826304.264895:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159735:x1874663043001472:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 147us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.264904:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:3.0:1787826304.282798:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826304.282917:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043001600 00000100:00100000:1.0:1787826304.282927:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043001600 00000100:00100000:1.0:1787826304.283081:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:1.0:1787826304.283094:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159735:x1874663043001600:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826304.283111:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826304.283129:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb480d65e00/0x878a5eea00cedc65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f243 expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.283156:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb480d65e00/0x878a5eea00cedc65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f243 expref: 10 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.283168:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb480d65e00/0x878a5eea00cedc65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f243 expref: 10 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826304.283178:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65e00, rc 0) 00000100:00100000:1.0:1787826304.283240:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663043001600:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 149us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.283247:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:1.0:1787826304.291017:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826304.291204:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043001728 00000100:00100000:3.0:1787826304.291215:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043001728 00000100:00100000:3.0:1787826304.291275:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:3.0:1787826304.291287:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663043001728:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826304.291566:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663043001728:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 279us (558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826304.291574:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:0.0:1787826304.857783:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787826304.858367:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826304.858604:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049379456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826304.858924:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826304.860029:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049379456 00000100:00100000:3.0:1787826304.860040:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049379456 00000100:00100000:3.0:1787826304.860110:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:3.0:1787826304.860122:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049379456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826304.860190:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826304.860255:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049379456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826304.860262:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000100:00080000:2.0:1787826304.860390:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826304.860448:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049379456:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1787826305.613145:0:196708:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787826305.876539:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 0 seconds 00010000:00010000:0.0:1787826305.877471:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826306.389551:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049379584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826306.390974:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049379712:0@lo:400:kworker.0 00000100:00100000:0.0:1787826306.391032:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.391115:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049379712 00000100:00100000:1.0:1787826306.391123:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049379712 00000100:00100000:1.0:1787826306.391168:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787826306.391178:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049379712:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787826306.391239:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826306.391244:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826306.391247:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826306.391253:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8367 00000100:00080000:2.0:1787826306.391257:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826306.391262:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826306.391283:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb47f997800 x1874663049379840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826306.391539:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049379712:12345-0@lo:400:kworker.0 Request processed in 361us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.391547:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787826306.391585:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049379968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.391612:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.391670:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049379968 00000100:00100000:1.0:1787826306.391685:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049379968 00000100:00100000:1.0:1787826306.391710:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787826306.391717:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049379968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.391750:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049379968:12345-0@lo:400:kworker.0 Request processed in 34us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.391756:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787826306.391793:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049379968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.391833:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049379840:0@lo:38:kworker.0 00000100:00100000:1.0:1787826306.391857:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.391901:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049379840 00000100:00100000:1.0:1787826306.391905:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049379840 00000100:00100000:1.0:1787826306.391926:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1787826306.391931:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049379840:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787826306.391952:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8373 last 0 00000020:00000080:1.0:1787826306.391985:0:187904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x878a5eea00cedc6c 00000004:00100000:1.0:1787826306.391999:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826306.392120:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb44908f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826306.392157:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874663049379840:12345-0@lo:38:kworker.0 Request processed in 225us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.392164:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00010000:00080000:1.0:1787826306.392195:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb47f997800 x1874663049379840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826306.392206:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 82 00000100:00080000:1.0:1787826306.393208:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8eb47f997800 x1874663049379840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826321 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826306.393218:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787826306.393223:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826306.393226:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787826306.393231:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049379840:0@lo:38:kworker.0 00000100:00100000:3.0:1787826306.393280:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.393698:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049379584 00000100:00100000:3.0:1787826306.393705:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049379584 00000100:00100000:3.0:1787826306.393747:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12766 00000100:00100000:3.0:1787826306.393755:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049379584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826306.393783:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:3.0:1787826306.393912:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049379584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.393919:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12766 00000100:00100000:0.0:1787826306.394063:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049379712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826306.394232:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049379584:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1787826306.394478:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826306.394484:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826306.394487:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826306.394607:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8367 00000100:00080000:2.0:1787826306.394615:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787826306.394620:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826306.394647:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e72d80 x1874663049380096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826306.394697:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049380096:0@lo:38:kworker.0 00000100:00100000:1.0:1787826306.394739:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826306.394800:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049380096 00000100:00100000:0.0:1787826306.394806:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049380096 00000100:00100000:0.0:1787826306.394833:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12767 00000100:00100000:0.0:1787826306.394838:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1874663049380096:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826306.394861:0:8415:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8eb34b9e1800, cookie 0x878a5eea00cedac8 00010000:00080000:0.0:1787826306.394866:0:8415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8eb34b9e1800 cur 8373 last 1787826300 00000004:00100000:0.0:1787826306.394885:0:8415:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826306.394913:0:8415:0:(import.c:65:import_set_state_nolock()) ffff8eb343211000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787826306.394993:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826306.394997:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826306.394999:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826306.395003:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8367 00000100:00080000:2.0:1787826306.395005:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826306.395008:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb450c26000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826306.395019:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e71180 x1874663049380480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826306.395051:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049380480:0@lo:38:kworker.0 00000100:00100000:1.0:1787826306.395079:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826306.395119:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049380096:12345-0@lo:38:kworker.0 Request processed in 279us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826306.395125:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12767 00010000:00080000:0.0:1787826306.395392:0:196456:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787826306.395403:0:196456:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 347892350984 00000020:00080000:0.0:1787826306.395407:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826306.395410:0:196456:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 347892350984, next_transno: 347892350984 00010000:00080000:0.0:1787826306.395414:0:196456:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892350984) 00000020:00080000:0.0:1787826306.395416:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826306.395425:0:196456:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1874663042995200 t347892350984 from 192.168.203.47@tcp req@ffff8eb342775f80 x1874663042995200/t0(347892350984) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:658/0 lens 528/0 e 0 to 0 dl 1787826313 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826306.395944:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 82 00000100:00080000:1.0:1787826306.395956:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787826306.395961:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1787826306.395964:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350983 gen 2 00000100:00080000:1.0:1787826306.395968:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff8eb48165c000 from lustre-MDT0000_UUID committed 347892350983 last 0 00000100:00080000:1.0:1787826306.395972:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1787826306.396047:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049380480 00000100:00100000:1.0:1787826306.396052:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049380480 00000100:00100000:1.0:1787826306.396078:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1787826306.396083:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049380480:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787826306.396101:0:187905:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8373 last 0 00000020:00000080:1.0:1787826306.396136:0:187905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x878a5eea00cedc73 00000004:00100000:1.0:1787826306.396145:0:187905:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826306.396166:0:187905:0:(import.c:65:import_set_state_nolock()) ffff8eb4770dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826306.396213:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874663049380480:12345-0@lo:38:kworker.0 Request processed in 128us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.396220:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1787826306.396261:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049380096:0@lo:38:kworker.0 00010000:00080000:1.0:1787826306.396288:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb476e71180 x1874663049380480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826306.396297:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 82 00000100:00080000:1.0:1787826306.397143:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8eb476e71180 x1874663049380480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826321 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826306.397153:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787826306.397157:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826306.397160:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787826306.397164:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049380480:0@lo:38:kworker.0 00010000:00080000:1.0:1787826306.397194:0:196743:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1787826306.397198:0:196743:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1787826306.397203:0:196743:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:0.0:1787826306.397765:0:196456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.397782:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.397800:0:196456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.397814:0:196456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.397821:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.397828:0:196456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398216:0:196456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398224:0:196456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398231:0:196456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398237:0:196456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826306.398241:0:196456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398248:0:196456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398260:0:196456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb47f8fec00) 00010000:00010000:0.0:1787826306.398264:0:196456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826306.398268:0:196456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398274:0:196456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cedc7a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826306.398292:0:196456:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fddf66c0 reply state 00000000ef7b4a07 transno 347892350984 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398303:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.398308:0:196456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fed00) 00010000:00010000:0.0:1787826306.398311:0:196456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826306.398314:0:196456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787826306.398444:0:196456:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787826306.398464:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826306.398468:0:196456:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 347892350985 00000020:00080000:0.0:1787826306.398472:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826306.398475:0:196456:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 347892350985 00010000:00010000:1.0:1787826306.399309:0:196743:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 3/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced9d3 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787826306.399722:0:196743:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00010000:00010000:1.0:1787826306.399738:0:196743:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ced9e1 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787826306.399748:0:196743:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 2(512) 00000100:00080000:2.0:1787826306.399855:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826306.399861:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826306.399865:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826306.399872:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8367 00000100:00080000:2.0:1787826306.399876:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787826306.399883:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826306.399907:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e73800 x1874663049380864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826306.399980:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049380608:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787826306.400036:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.400068:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049380608 00000100:00100000:1.0:1787826306.400070:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049380736:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787826306.400074:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049380608 00000100:00100000:1.0:1787826306.400089:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.400104:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049380864:0@lo:38:kworker.0 00000100:00100000:3.0:1787826306.400114:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049380736 00000100:00100000:3.0:1787826306.400117:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049380736 00000100:00100000:1.0:1787826306.400125:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.400148:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12768 00000100:00100000:3.0:1787826306.400158:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3616:x1874663049380608:12345-0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787826306.400167:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049380864 00000100:00100000:1.0:1787826306.400170:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049380864 00010000:00080000:3.0:1787826306.400181:0:177386:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8eb342775c00 x1874663049380608/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:662/0 lens 328/0 e 0 to 0 dl 1787826317 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826306.400192:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1787826306.400195:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3616:x1874663049380608:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 40us (160us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826306.400196:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049380864:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826306.400201:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12768 00000100:00100000:3.0:1787826306.400209:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12769 00010000:00080000:1.0:1787826306.400216:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8373 last 0 00000100:00100000:3.0:1787826306.400216:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3616:x1874663049380736:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787826306.400222:0:177386:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8eb342775180 x1874663049380736/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:662/0 lens 328/0 e 0 to 0 dl 1787826317 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826306.400230:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3616:x1874663049380736:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 17us (141us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826306.400235:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12769 00000020:00000080:1.0:1787826306.400249:0:187904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x878a5eea00cedc88 00000004:00100000:1.0:1787826306.400263:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826306.400292:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826306.400359:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874663049380864:12345-0@lo:38:kworker.0 Request processed in 150us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.400366:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:1.0:1787826306.400406:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 82 00000100:00080000:1.0:1787826306.401184:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8eb476e73800 x1874663049380864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826321 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826306.401194:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787826306.401198:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826306.401201:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787826306.401206:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049380864:0@lo:38:kworker.0 00000020:00080000:1.0:1787826306.401273:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787826306.401278:0:196456:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892350985 00000100:00080000:2.0:1787826306.401377:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787826306.401382:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826306.401384:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb348a38000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826306.401391:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb348a38000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826306.401404:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e70000 x1874663049381376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826306.401436:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049380224:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.401478:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.401503:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049381248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.401523:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.401544:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826306.401549:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049380352:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.401569:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.401603:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049380224 00000100:00100000:2.0:1787826306.401607:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049380224 00000100:00100000:2.0:1787826306.401642:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049381248 00000100:00100000:2.0:1787826306.401645:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049381248 00000100:00100000:2.0:1787826306.401661:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049380352 00000100:00100000:2.0:1787826306.401664:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049380352 00000100:00100000:2.0:1787826306.401698:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7103 00000100:00100000:2.0:1787826306.401706:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049380224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.401747:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049380224:12345-0@lo:400:kworker.0 Request processed in 42us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.401754:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7103 00000100:00100000:2.0:1787826306.401767:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7104 00000100:00100000:2.0:1787826306.401774:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049381248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.401799:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049381248:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.401805:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7104 00000100:00100000:2.0:1787826306.401815:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7105 00000100:00100000:2.0:1787826306.401821:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049380352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.401846:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049380352:12345-0@lo:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.401851:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7105 00000100:00080000:2.0:1787826306.401870:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826306.401874:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826306.401902:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049380352:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.401912:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049380224:0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.401922:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049381248:0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.402135:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049381120:0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.402168:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.402187:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826306.402192:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049380992:0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.402216:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.402242:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049380992 00000100:00100000:1.0:1787826306.402245:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049380992 00000100:00100000:1.0:1787826306.402272:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787826306.402279:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049380992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.402312:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049380992:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.402318:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787826306.402453:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049380992:0@lo:400:kworker.0 00000100:00100000:1.0:1787826306.402470:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049381376:0@lo:38:kworker.0 00000100:00100000:1.0:1787826306.402497:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.402537:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049381376 00000100:00100000:1.0:1787826306.402540:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049381376 00000100:00100000:1.0:1787826306.402561:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1787826306.402566:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049381376:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787826306.402584:0:187904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8373 last 0 00000020:00000080:1.0:1787826306.402616:0:187904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x878a5eea00cedc8f 00000004:00100000:1.0:1787826306.402628:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826306.402650:0:187904:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826306.402696:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049381376:12345-0@lo:38:kworker.0 Request processed in 129us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826306.402702:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00080000:1.0:1787826306.402737:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 82 00000100:00080000:1.0:1787826306.402744:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787826306.402748:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787826306.402750:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb348a38000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787826306.402754:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049381376:0@lo:38:kworker.0 00000100:00100000:2.0:1787826306.402814:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049381120 00000100:00100000:2.0:1787826306.402819:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049381120 00000100:00100000:2.0:1787826306.402860:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7106 00000100:00100000:2.0:1787826306.402867:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049381120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826306.402906:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049381120:12345-0@lo:400:kworker.0 Request processed in 40us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.402912:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7106 00000100:00100000:2.0:1787826306.402939:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049381120:0@lo:400:kworker.0 00000100:00080000:1.0:1787826306.402990:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826306.404802:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826306.404903:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663042995712 00000100:00100000:2.0:1787826306.404910:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663042995712 00000100:00100000:2.0:1787826306.405049:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1094 00000100:00100000:2.0:1787826306.405059:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:2388:x1874663042995712:12345-192.168.203.47@tcp:36:rm.0 00010000:00080000:2.0:1787826306.405077:0:187905:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 347892350985, current: 347892350985, replaying 00000100:00100000:2.0:1787826306.405092:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:2388:x1874663042995712:12345-192.168.203.47@tcp:36:rm.0 Request processed in 35us (298us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787826306.405099:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1094 00000020:00080000:0.0:1787826306.405151:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826306.405156:0:196456:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 347892350985, next_transno: 347892350985 00010000:00080000:0.0:1787826306.405159:0:196456:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (347892350985) 00000020:00080000:0.0:1787826306.405162:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826306.405170:0:196456:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1874663042995712 t347892350985 from 192.168.203.47@tcp req@ffff8eb47f997800 x1874663042995712/t0(347892350985) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:662/0 lens 512/0 e 0 to 0 dl 1787826317 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826306.405250:0:196456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405265:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405280:0:196456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405293:0:196456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405300:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405307:0:196456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405423:0:196456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405432:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405438:0:196456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405653:0:196456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405660:0:196456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405667:0:196456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405683:0:196456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826306.405686:0:196456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405694:0:196456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405706:0:196456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x3:0x0].0x0 (ffff8eb480de3c00) 00010000:00010000:0.0:1787826306.405709:0:196456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826306.405713:0:196456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405719:0:196456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00cedca4 lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405741:0:196456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405746:0:196456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405751:0:196456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405755:0:196456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826306.405758:0:196456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405763:0:196456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405770:0:196456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb480de3400) 00010000:00010000:0.0:1787826306.405772:0:196456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826306.405775:0:196456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405785:0:196456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedc96 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826306.405796:0:196456:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000157f04 reply state 0000000035af2ace transno 347892350985 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405806:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.405812:0:196456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fed00) 00010000:00010000:0.0:1787826306.405814:0:196456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826306.405816:0:196456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787826306.405884:0:196456:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787826306.405899:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826306.405901:0:196456:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892350986 00000020:00080000:0.0:1787826306.405905:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826306.405907:0:196456:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 347892350986 00000001:00080000:0.0:1787826306.405978:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350984 is committed 00010000:00010000:3.0:1787826306.406498:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.406507:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.406513:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.406518:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826306.406521:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.406528:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.406545:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fed00) 00010000:00010000:3.0:1787826306.406548:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826306.406551:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.406556:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00cedc81 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826306.411773:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826306.411864:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043001856 00000100:00100000:1.0:1787826306.411874:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043001856 00000100:00100000:1.0:1787826306.411936:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 330 00000100:00100000:1.0:1787826306.411948:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2388:x1874663043001856:12345-192.168.203.47@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1787826306.411971:0:187904:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb48162b100 x1874663043001856/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:662/0 lens 224/0 e 0 to 0 dl 1787826317 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826306.411996:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2388:x1874663043001856:12345-192.168.203.47@tcp:400:ldlm_lock_repla.0 Request processed in 52us (232us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826306.412004:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 330 00000020:00080000:3.0:1787826306.412048:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826306.412053:0:196456:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 347892350986 00010000:00080000:3.0:1787826306.412056:0:196456:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1787826306.412059:0:196456:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787826306.412066:0:196456:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826306.412069:0:196456:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826306.412077:0:196456:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8eb342775c00 x1874663049380608/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:662/0 lens 328/0 e 0 to 0 dl 1787826317 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826306.412095:0:196456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826306.412121:0:196456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cedcab lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced9cc expref: -99 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.412144:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cedcab lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 8 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.412157:0:196456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cedcab lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 8 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.412164:0:196456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39600, rc 0) 00010000:00080000:3.0:1787826306.412223:0:196456:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826306.412232:0:196456:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826306.412234:0:196456:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787826306.412239:0:196456:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8eb342775180 x1874663049380736/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:662/0 lens 328/0 e 0 to 0 dl 1787826317 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787826306.412249:0:196456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826306.412262:0:196456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedcb2 lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ced9da expref: -99 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.412275:0:196456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedcb2 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ced9da expref: 8 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.412285:0:196456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedcb2 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced9da expref: 8 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.412291:0:196456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39e00, rc 0) 00010000:00080000:3.0:1787826306.412314:0:196456:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787826306.412320:0:196456:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00010000:1.0:1787826306.412531:0:3616:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 3/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826306.412543:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049380608:0@lo:101:ldlm_lock_repla.0 00010000:00010000:1.0:1787826306.412557:0:3616:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787826306.412564:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787826306.412590:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb342777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049380736:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787826306.412614:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049381504:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1787826306.412646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.412723:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049381504 00000100:00100000:3.0:1787826306.412727:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049381504 00000100:00100000:3.0:1787826306.412764:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12770 00000100:00100000:3.0:1787826306.412772:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3616:x1874663049381504:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1787826306.412783:0:177386:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb348ffce00 x1874663049381504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:662/0 lens 224/0 e 0 to 0 dl 1787826317 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826306.412837:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3616:x1874663049381504:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 66us (190us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826306.412843:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12770 00010000:00080000:2.0:1787826306.415190:0:196456:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1787826306.416653:0:196456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 82, last_transno is 352187318272 00000001:00100000:0.0:1787826306.420428:0:196423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787826306.420448:0:196423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00080000:0.0:1787826306.420494:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350985 is committed 00000001:00080000:3.0:1787826306.420886:0:196456:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1787826306.420934:0:196456:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1787826306.420950:0:196456:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.47@tcp: req@ffff8eb48162b100 x1874663043001856/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:662/0 lens 224/0 e 0 to 0 dl 1787826317 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787826306.421059:0:196456:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8eb348ffce00 x1874663049381504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:662/0 lens 224/0 e 0 to 0 dl 1787826317 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1787826306.421131:0:196456:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:1.0:1787826306.424987:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.425006:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.425014:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.425021:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826306.425026:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.425034:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.425053:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8fed00) 00010000:00010000:1.0:1787826306.425057:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826306.425062:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.425068:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cedc9d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826306.425780:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787826306.425804:0:3616:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8eb348fff480 x1874663049381504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826322 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826306.425818:0:3616:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8eb348fff480 x1874663049381504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826322 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826306.425827:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787826306.425854:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1787826306.425862:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000054477fe0): req@ffff8eb47758f100 x1874663049354112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 1 dl 1787826276 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787826306.425884:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009738ef7f): req@ffff8eb34ddd4000 x1874663049360000/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826288 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826306.425979:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049381504:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1787826306.427124:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826306.427176:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4817adc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826306.427268:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049354112 00000100:00100000:1.0:1787826306.427280:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049354112 00000100:00100000:1.0:1787826306.429477:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12771 00000100:00100000:1.0:1787826306.429501:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187966:x1874663049354112:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1787826306.429547:0:8415:0:(tgt_handler.c:3156:tgt_check_resent()) @@@ reconstruct resent RPC req@ffff8eb448cd4000 x1874663049354112/t347892350983(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:662/0 lens 1312/4320 e 0 to 0 dl 1787826317 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:1.0:1787826306.429585:0:8415:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb349210208 index 0: rc = 0 00000020:00080000:1.0:1787826306.429594:0:8415:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb349210208 index 1: rc = 0 00000020:00080000:1.0:1787826306.429600:0:8415:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb349210208 index 2: rc = 0 00000020:00080000:1.0:1787826306.429603:0:8415:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb349210208 index 3: rc = 0 00000020:00080000:1.0:1787826306.429606:0:8415:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb349210208 index 4: rc = 0 00000020:00080000:1.0:1787826306.429608:0:8415:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb349210208 index 5: rc = 0 00000020:00080000:1.0:1787826306.429611:0:8415:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb349210208 index 6: rc = 0 00000100:00100000:1.0:1787826306.429704:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187966:x1874663049354112:12345-0@lo:1000:osp_up0-1.0 Request processed in 214us (2585us total) trans 347892350983 rc 0/0 00000100:00100000:1.0:1787826306.429713:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12771 00000004:00080000:1.0:1787826306.429769:0:187966:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350983 committed transno 347892350983 00000100:00100000:1.0:1787826306.429789:0:187966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049354112:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787826306.429815:0:187966:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb348d2e6c0 version 6 rpc_version 6 00000020:00100000:1.0:1787826306.429839:0:187966:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826306.429844:0:187966:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb348ffc380 x1874663049381888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826306.429870:0:187966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049381888:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787826306.430108:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.430130:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb462795900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826306.430145:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049381888 00000100:00100000:1.0:1787826306.430151:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049381888 00000100:00100000:1.0:1787826306.430184:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12772 00000100:00100000:1.0:1787826306.430190:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187966:x1874663049381888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787826306.431749:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826306.431773:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049381632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826306.431829:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.432568:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826306.439851:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049381632 00000100:00100000:0.0:1787826306.439865:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049381632 00000100:00100000:0.0:1787826306.439917:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049360000 00000100:00100000:0.0:1787826306.439920:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049360000 00000100:00100000:0.0:1787826306.439939:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12773 00000100:00100000:0.0:1787826306.439948:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3619:x1874663049381632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826306.439983:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445625856 avail 1299386368 00000100:00100000:0.0:1787826306.440061:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3619:x1874663049381632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (8232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826306.440068:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12773 00000100:00100000:0.0:1787826306.440086:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12774 00000100:00100000:0.0:1787826306.440093:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3620:x1874663049360000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826306.440104:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445625856 avail 1299386368 00000100:00100000:0.0:1787826306.440141:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3620:x1874663049360000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (7575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826306.440151:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12774 00000100:00100000:0.0:1787826306.440203:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049381632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826306.442523:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049360000:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1787826306.449509:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318273 is committed 00000100:00100000:0.0:1787826306.449702:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187966:x1874663049381888:12345-0@lo:1000:osp_up0-1.0 Request processed in 19508us (19589us total) trans 352187318273 rc 0/0 00000100:00100000:0.0:1787826306.449713:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12772 00000004:00080000:2.0:1787826306.449799:0:187966:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318273 committed transno 352187318273 00000100:00100000:2.0:1787826306.449803:0:187966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318273 gen 2 00000100:00100000:2.0:1787826306.449820:0:187966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049381888:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787826306.449846:0:187966:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb348d2e6c0 version 7 rpc_version 7 00000020:00100000:2.0:1787826306.449876:0:187966:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826306.449883:0:187966:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb476e70000 x1874663049382144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826306.449904:0:187966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049382144:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826306.449948:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.449980:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4589040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826306.450119:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049382144 00000100:00100000:0.0:1787826306.450126:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049382144 00000100:00100000:0.0:1787826306.450171:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12775 00000100:00100000:0.0:1787826306.450180:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187966:x1874663049382144:12345-0@lo:1000:osp_up0-1.0 00000004:00000080:3.0:1787826306.455654:0:196456:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb65b87f4be10 00100000:10000000:3.0:1787826306.455668:0:196456:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:0.0:1787826306.456168:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187966:x1874663049382144:12345-0@lo:1000:osp_up0-1.0 Request processed in 5985us (6215us total) trans 352187318274 rc 0/0 00000100:00100000:0.0:1787826306.456180:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12775 00000100:00100000:3.0:1787826306.456308:0:187966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049382144:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787826306.457011:0:196444:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x17e7:0x0] 00000100:00100000:3.0:1787826306.457045:0:196444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196444:1874663049382272:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787826306.457088:0:196444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.457111:0:196444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826306.457130:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049382272 00000100:00100000:3.0:1787826306.457136:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049382272 00000100:00100000:3.0:1787826306.457174:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22605 00000100:00100000:3.0:1787826306.457183:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:196444:x1874663049382272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787826306.457210:0:43895:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6273 -> diff = -154 00002000:02000040:3.0:1787826306.457214:0:43895:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6120 to 0x2c0000401:6273) 00010000:00010000:0.0:1787826306.457522:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.457538:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.457551:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826306.457569:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000522d7046 reply state 000000000698535c transno 17179869984 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.457581:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.457593:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:0.0:1787826306.457596:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826306.457599:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787826306.457603:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x1:0x0]: returning size 4096 00000004:00080000:0.0:1787826306.457612:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x2:0x0] 00010000:00010000:0.0:1787826306.457641:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.457649:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.457658:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.457685:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826306.457690:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x2:0x0] 00010000:00010000:0.0:1787826306.457695:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826306.457703:0:187906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787826306.457775:0:187906:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787826306.457788:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160572:x1874663042994304:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 45712568us (45712754us total) trans 17179869984 rc 0/0 00000100:00100000:0.0:1787826306.457796:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1046 00000100:02000400:0.0:1787826306.457811:0:187906:0:(service.c:2915:ptlrpc_watchdog_update()) mdt00_002: service thread pid 187906 completed after 45.712s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources). 00010000:00010000:2.0:1787826306.457939:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826306.457956:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.457965:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2800 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826306.457971:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826306.457979:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.458006:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.458013:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826306.458030:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 1/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.458038:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481ce2800/0x878a5eea00ced9cc lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedcab expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.458055:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.458057:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.458059:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826306.458187:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049382400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826306.458231:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.458277:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049382400 00000100:00100000:2.0:1787826306.458282:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049382400 00000100:00100000:2.0:1787826306.459485:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4234 00000100:00100000:2.0:1787826306.459502:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb450a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3617:x1874663049382400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826306.459520:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826306.459544:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39600/0x878a5eea00cedcab lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ced9cc expref: 9 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.459562:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb34d1bdb00) 00010000:00010000:2.0:1787826306.459570:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826306.459622:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb450a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3617:x1874663049382400:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.459632:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4234 00000004:00080000:2.0:1787826306.460155:0:196442:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x18a2:0x0] 00000100:00100000:2.0:1787826306.460185:0:196442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196442:1874663049382528:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787826306.460218:0:196442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.460241:0:196442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a4ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826306.460259:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049382528 00000100:00100000:2.0:1787826306.460264:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049382528 00000100:00100000:2.0:1787826306.460294:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22606 00000100:00100000:2.0:1787826306.460300:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:196442:x1874663049382528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787826306.460322:0:179226:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6337 -> diff = -31 00002000:02000040:2.0:1787826306.460342:0:179226:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6307 to 0x280000401:6337) 00002000:00010000:2.0:1787826306.460637:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.460644:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460659:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18c1:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.460663:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.460669:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460695:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460704:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460717:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460735:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826306.460827:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.460832:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460839:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18c0:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.460842:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.460845:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460853:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460860:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460867:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460879:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787826306.460912:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.460916:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460924:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18bf:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.460926:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.460930:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460938:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460944:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460951:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.460963:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787826306.460996:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.461001:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461009:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18be:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.461012:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.461016:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461025:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461033:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461040:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461052:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787826306.461082:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.461087:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461094:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18bd:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.461097:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.461100:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461108:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461114:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461121:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461132:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1787826306.461165:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.461169:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461177:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18bc:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.461179:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.461182:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461190:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461198:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461204:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461212:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1787826306.461243:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.461248:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461255:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18bb:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.461258:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.461262:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461270:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461277:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461284:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.461292:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1787826306.462580:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.462592:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462605:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ba:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.462609:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.462614:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462625:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462635:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462642:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462652:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1787826306.462728:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.462734:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462742:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b9:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.462745:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.462750:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462759:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462768:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462775:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462784:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1787826306.462819:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.462824:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462832:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b8:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.462834:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.462838:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462847:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462855:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462862:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462871:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1787826306.462904:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.462908:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462916:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b7:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.462919:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.462922:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462931:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462939:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462946:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.462954:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1787826306.462989:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.462994:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463002:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b6:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.463005:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.463009:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463016:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463024:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463030:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463044:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1787826306.463077:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.463082:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463089:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b5:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.463091:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.463095:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463103:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463111:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463118:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463125:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1787826306.463153:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.463158:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463165:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b4:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.463168:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.463171:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463179:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463186:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463193:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463200:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1787826306.463231:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.463235:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463241:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b3:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.463244:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.463248:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463255:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463261:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463267:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.463274:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1787826306.464461:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.464471:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464483:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b2:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.464487:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.464491:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464501:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464509:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464517:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464526:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1787826306.464580:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.464586:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464594:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b1:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.464597:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.464601:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464609:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464617:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464625:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464634:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1787826306.464665:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.464681:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464690:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b0:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.464693:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.464697:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464706:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464715:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464723:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464732:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:2.0:1787826306.464765:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.464770:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464779:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18af:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.464782:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.464786:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464795:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464803:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464811:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464826:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:2.0:1787826306.464861:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.464866:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464875:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ae:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.464878:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.464883:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464893:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464901:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464908:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464916:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1787826306.464949:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.464955:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464962:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ad:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.464965:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.464969:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464977:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464985:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.464991:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465000:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:2.0:1787826306.465031:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465037:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465045:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ac:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465048:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465052:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465061:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465068:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465075:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465083:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:2.0:1787826306.465141:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465146:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465154:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ab:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465157:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465160:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465168:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465175:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465182:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465189:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:2.0:1787826306.465223:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465228:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465236:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18aa:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465238:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465242:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465250:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465257:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465264:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465271:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:2.0:1787826306.465304:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465309:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465317:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a9:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465320:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465343:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465434:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465443:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465450:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465459:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:2.0:1787826306.465495:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465500:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465508:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a8:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465510:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465514:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465522:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465528:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465535:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465548:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:2.0:1787826306.465581:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465587:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465594:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a7:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465597:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465601:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465610:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465649:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465656:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465665:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:2.0:1787826306.465710:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465714:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465722:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a6:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465726:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465729:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465738:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465745:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465752:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465759:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:2.0:1787826306.465793:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465798:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465805:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a5:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465808:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465811:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465820:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465828:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465836:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465844:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00010000:2.0:1787826306.465881:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465886:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465893:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a4:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465895:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465899:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465907:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465913:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465920:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465926:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00002000:00010000:2.0:1787826306.465956:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.465961:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465969:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a3:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.465972:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826306.465977:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465985:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.465993:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.466000:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.466008:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/31 locks to regular blp list, 31 blwis in pool 00002000:00080000:2.0:1787826306.466033:0:179226:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6306 00000100:00100000:2.0:1787826306.466123:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:196442:x1874663049382528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5819us (5902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.466132:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22606 00010000:00010000:2.0:1787826306.468680:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 30 total in blp. (30 blwis in pool) 00010000:00010000:2.0:1787826306.468694:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468706:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.468711:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468722:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468743:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468750:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028f0ef1c/0x878a5eea00cedcc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468779:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:2.0:1787826306.468783:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468789:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.468792:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468798:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468808:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468816:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097518bd0/0x878a5eea00cedcc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468834:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:2.0:1787826306.468838:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468843:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.468845:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468853:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468862:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468869:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf116cb/0x878a5eea00cedcce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468881:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:2.0:1787826306.468885:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468892:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.468895:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468908:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468917:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468923:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8c95c3d/0x878a5eea00cedcd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468935:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:2.0:1787826306.468938:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468944:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.468947:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468953:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468962:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468969:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b951e62/0x878a5eea00cedcdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468984:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:2.0:1787826306.468988:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.468994:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.468997:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469004:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469013:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469019:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055233f7a/0x878a5eea00cedce3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469030:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:2.0:1787826306.469033:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469038:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.469040:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469052:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469061:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469067:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074886e75/0x878a5eea00cedcea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469079:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:2.0:1787826306.469083:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469088:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.469091:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469099:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469108:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469114:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cedcf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469131:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:2.0:1787826306.469134:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469140:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.469143:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469150:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469159:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469166:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cedcf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469176:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:2.0:1787826306.469179:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469186:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.469189:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469202:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469210:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469216:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f68f1d85/0x878a5eea00cedcff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469227:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:2.0:1787826306.469230:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469236:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.469239:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469246:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469256:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469263:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cedd06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469279:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:2.0:1787826306.469282:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469288:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.469291:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469298:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469307:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.469313:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028c0e5d2/0x878a5eea00cedd0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470542:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:2.0:1787826306.470553:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470563:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470566:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470579:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470594:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470601:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cedd14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470617:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:2.0:1787826306.470621:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470626:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470628:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470635:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470643:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470649:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505397b4/0x878a5eea00cedd1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470665:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:2.0:1787826306.470668:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470686:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470689:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470696:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470704:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470711:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cedd22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470721:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1787826306.470725:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470731:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470733:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470746:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470755:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470761:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cedd29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470772:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1787826306.470775:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470781:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470785:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470793:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470802:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470809:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cedd30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470825:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1787826306.470829:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470835:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470838:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470844:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470853:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470860:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cedd37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470872:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1787826306.470875:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470881:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470884:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470896:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470906:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470913:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cedd3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470924:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1787826306.470928:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470934:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470937:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470944:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470953:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470960:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a851f9d/0x878a5eea00cedd45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470976:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1787826306.470980:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470986:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.470989:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.470996:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471005:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471013:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cedd4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471023:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1787826306.471027:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471033:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.471036:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471048:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471058:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471065:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cedd53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471076:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1787826306.471080:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471086:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.471089:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471096:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471105:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471113:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b89b7300/0x878a5eea00cedd5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471128:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1787826306.471132:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471138:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.471140:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471148:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471157:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471163:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cedd61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471175:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787826306.471178:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471185:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.471188:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471200:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471210:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471217:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cedd68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471229:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787826306.471233:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471239:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.471242:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471249:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471258:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471266:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cedd6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471282:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787826306.471285:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.471291:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.471874:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471885:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471891:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471897:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826306.471901:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471907:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471918:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:3.0:1787826306.471921:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826306.471925:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471931:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedcb9 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471961:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826306.471968:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471975:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.471979:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471986:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.471997:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472008:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cedd7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472021:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826306.472024:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472030:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.472034:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472041:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472049:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472056:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cedd84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472067:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826306.472071:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472077:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.472081:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472088:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472096:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472104:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cedd8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472114:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.472117:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472123:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.472126:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472133:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472142:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472149:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cedd92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472159:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.472161:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.472162:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.472214:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1881:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.472221:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472233:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1881:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.472238:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1881:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.472244:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472258:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472266:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472273:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472290:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.472298:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.472301:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472313:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.472316:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472348:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472359:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472366:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c71547e3/0x878a5eea00cedd99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.472381:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.472383:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.472385:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.472657:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1880:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.472663:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.473189:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.473199:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.473212:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.473219:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cedd76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.473237:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.473239:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.473241:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.473249:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.475630:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1880:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.475637:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1880:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.475646:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.475663:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.475685:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.475694:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826306.475996:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826306.476030:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043002112 00000100:00100000:3.0:1787826306.476039:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043002112 00000100:00100000:3.0:1787826306.476081:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:3.0:1787826306.476090:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345737c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160572:x1874663043002112:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1787826306.476751:0:196442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196442:1874663049382528:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787826306.476765:0:196442:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x18c1:0x0] from OST, last_created [0x280000401:0x18c1:0x0]last_used is [0x280000401:0x18a2:0x0] 00000100:00100000:2.0:1787826306.476825:0:196442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196442:1874663049382784:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787826306.476867:0:196442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.476892:0:196442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826306.476910:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049382784 00000100:00100000:2.0:1787826306.476915:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049382784 00000100:00100000:2.0:1787826306.476945:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22607 00000100:00100000:2.0:1787826306.476952:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:196442:x1874663049382784:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787826306.476983:0:8723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 6338 00000100:00100000:3.0:1787826306.477636:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345737c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:160572:x1874663043002112:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 1544us (1641us total) trans 352187318275 rc 0/0 00000100:00100000:3.0:1787826306.477645:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5 00010000:00010000:3.0:1787826306.477909:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.477921:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.477927:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.477940:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.477945:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.477955:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.477972:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.477980:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1f60fb1/0x878a5eea00cedda0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.477997:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.477999:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.478001:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.478070:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.478076:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478085:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187f:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.478089:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.478095:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478105:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478113:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478120:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478133:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.478139:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.478143:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478150:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.478153:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478159:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478168:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478175:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aa262b0/0x878a5eea00cedda7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478191:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.478193:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.478195:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.478231:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.478235:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478243:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187e:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.478246:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.478250:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478259:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478266:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478273:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478285:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.478291:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.478295:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478302:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fa00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.478306:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478312:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.478341:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481564:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000b3828e/0x878a5eea00ceddae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481631:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.481633:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.481636:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.481744:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.481752:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481765:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187d:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.481770:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.481775:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481789:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481799:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481806:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481823:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.481832:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.481837:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481845:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.481849:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481857:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481873:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481881:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000dacb76/0x878a5eea00ceddb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481900:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.481902:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.481904:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.481946:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.481952:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481959:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187c:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.481963:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.481967:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481982:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481990:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.481997:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482011:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.482018:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.482022:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482029:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.482032:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482039:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482049:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482056:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001353fd5c/0x878a5eea00ceddbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482067:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.482069:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.482071:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.482107:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.482112:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482119:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187b:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.482122:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.482125:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482133:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482141:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482148:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482161:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.482167:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.482170:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482181:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.482184:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482192:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482203:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482209:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004832bbfc/0x878a5eea00ceddc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482223:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.482225:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.482226:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.482263:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.482268:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482275:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187a:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.482278:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.482282:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482289:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482297:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482304:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.482315:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.482320:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.482341:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.483473:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.483479:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.483488:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.483503:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.483510:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e707c8/0x878a5eea00ceddca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.483528:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.483530:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.483532:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826306.484530:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049382656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826306.484610:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826306.485443:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049382656 00000100:00100000:2.0:1787826306.485452:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049382656 00000100:00100000:2.0:1787826306.485498:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:2.0:1787826306.485507:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049382656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826306.485529:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826306.485580:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3618:x1874663049382656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826306.485587:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000100:00100000:2.0:1787826306.485684:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049382400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826306.485709:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787826306.485885:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1787826306.485984:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1879:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.485993:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486007:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1879:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.486012:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1879:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.486018:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486031:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486041:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486050:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486067:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.486075:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.486080:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486087:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ec00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.486091:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486100:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486114:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486121:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003af69368/0x878a5eea00ceddd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486141:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.486142:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.486144:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.486184:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1878:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.486189:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486198:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1878:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.486201:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1878:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.486205:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486213:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486221:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486227:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486239:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.486246:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.486250:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486255:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.486258:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486266:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486276:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.486282:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011bd7665/0x878a5eea00ceddd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826306.486847:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049382656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787826306.487205:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.487208:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.487210:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.487272:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1877:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.487279:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487290:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1877:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.487300:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1877:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.487305:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487316:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487343:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487694:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487713:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826306.487834:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1876:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.487840:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487848:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1876:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.487852:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1876:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.487856:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487870:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487878:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487885:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487896:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787826306.487930:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1875:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.487935:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487942:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1875:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.487945:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1875:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.487949:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487957:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487965:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487977:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.487992:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787826306.488001:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826306.488005:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488012:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fc00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.488016:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488024:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488038:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488045:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005abf2577/0x878a5eea00cedddf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488060:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826306.488063:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488075:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.488078:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488085:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488095:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488103:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b91170/0x878a5eea00cedde6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488118:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.488122:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488129:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fe00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.488132:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488139:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488148:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488156:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c2c92eb/0x878a5eea00cedded lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488167:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.488169:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.488170:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.488209:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1874:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.488214:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488222:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1874:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.488225:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1874:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.488229:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488238:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488246:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488253:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488265:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.488272:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.488276:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488284:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.488287:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488294:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488305:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488312:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7e08bc5/0x878a5eea00ceddf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.488343:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.488584:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.489079:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826306.489162:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787826306.490443:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.490447:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.490546:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1873:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.490554:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490569:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1873:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.490573:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1873:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.490580:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490597:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490608:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490616:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490634:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.490643:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.490647:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490655:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.490660:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490668:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490696:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.490704:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e51285c8/0x878a5eea00ceddfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.491764:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.491768:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.491771:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.491910:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1872:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.491917:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.491928:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1872:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.491933:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1872:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.491938:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.491953:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.491963:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.491970:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.491983:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826306.492004:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826306.492011:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826306.492020:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1871:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.492023:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.492025:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.492028:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.492038:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492038:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1871:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.492041:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1871:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.492045:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.492051:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492053:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.492060:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4789fb4/0x878a5eea00cede02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492061:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492068:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.492075:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826306.492078:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492082:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787826306.492083:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ee00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.492087:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492088:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.492094:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.492103:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.492110:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f3bc46/0x878a5eea00cede09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.492122:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.492122:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1870:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.492124:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.492126:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.492127:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492212:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1870:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.492216:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1870:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.492221:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492231:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492239:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492246:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492266:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826306.492305:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.492311:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492319:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186f:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.492395:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.492399:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492408:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492416:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492423:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492441:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787826306.492448:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826306.492452:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492459:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.492462:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492469:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492480:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492488:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000257df0ab/0x878a5eea00cede10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492501:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.492504:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492511:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.492514:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492527:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492536:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492544:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8e1e7ab/0x878a5eea00cede17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492555:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.492557:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.492558:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.492596:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.492601:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492609:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186e:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.492612:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.492616:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492625:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492633:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492641:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492653:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826306.492659:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.492663:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492681:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ece00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.492684:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492692:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492703:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492710:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c5fbb05/0x878a5eea00cede1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492723:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.492724:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.492726:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.492763:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.492768:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492776:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186d:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.492779:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.492783:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492859:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492868:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492875:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492886:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826306.492921:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.492925:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492933:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186c:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.492936:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.492940:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492955:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492963:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492970:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492983:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787826306.492988:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826306.492992:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.492999:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.493002:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493010:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493020:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493027:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007598ffa3/0x878a5eea00cede25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493040:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.493044:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493050:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.493054:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493061:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493071:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493078:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff49a089/0x878a5eea00cede2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.493089:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.493091:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.493092:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.493566:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.493572:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.494933:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.494943:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.494958:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186b:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.494963:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.494969:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.494980:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.494990:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.494998:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495019:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826306.495060:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.495065:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495072:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186a:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.495075:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.495078:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495087:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495094:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495101:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495116:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787826306.495125:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826306.495130:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495217:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ecc00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.495221:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495229:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495245:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495252:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028fa0c76/0x878a5eea00cede33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495271:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826306.495275:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495287:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.495290:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495298:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495307:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495313:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd802470/0x878a5eea00cede3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.495540:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.495886:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.495889:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.495891:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.495953:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1869:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.495960:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495970:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1869:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.495973:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1869:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.495977:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495987:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.495997:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496004:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496020:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826306.496058:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1868:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.496063:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496072:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1868:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.496075:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1868:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.496078:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496086:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496093:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496099:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496114:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787826306.496218:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1787826306.496222:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1867:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826306.496224:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496227:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496233:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.496235:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1867:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:2.0:1787826306.496237:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496238:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1867:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.496242:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496245:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496251:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496258:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496259:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496266:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496267:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4691a5a/0x878a5eea00cede41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496282:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787826306.496288:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826306.496292:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496298:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826306.496303:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496310:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496317:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826306.496321:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496412:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826306.496417:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496425:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496436:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496443:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007d9825f/0x878a5eea00cede4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826306.496455:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.496457:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.496458:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.496465:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.496866:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496876:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb0a5d/0x878a5eea00cede48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496893:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.496894:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.496896:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826306.496949:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1866:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.496954:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496963:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1866:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.496966:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1866:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.496969:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496978:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496991:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.496998:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497013:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826306.497050:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1865:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.497055:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497063:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1865:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.497066:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1865:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.497069:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497078:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497086:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497093:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497109:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787826306.497244:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1864:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.497250:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497258:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1864:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.497261:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1864:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.497265:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497273:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497281:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497288:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497350:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787826306.497390:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1863:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.497395:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497402:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1863:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.497405:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1863:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.497409:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497417:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497424:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497432:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497472:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787826306.497479:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497486:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724edc00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826306.497490:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497498:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497511:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497519:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6caf631/0x878a5eea00cede56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497534:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826306.497537:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497543:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eca00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826306.497547:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497554:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497563:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497571:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000537977c1/0x878a5eea00cede5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497583:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826306.497586:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497592:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826306.497595:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497602:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497611:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497620:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ccf4852/0x878a5eea00cede64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497631:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826306.497634:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497640:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ede00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826306.497643:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497650:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497660:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.497666:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826306.497668:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826306.497681:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826306.497711:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787826306.497716:0:43895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015bd651c/0x878a5eea00cede6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826306.497767:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1862:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826306.497772:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497779:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1862:0x0].0x0 since=8373s v=(0 0) 00010000:00010000:3.0:1787826306.497782:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826306.497786:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497862:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497870:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497877:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826306.497888:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826306.498219:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826306.498224:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.498231:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826306.498235:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.498243:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.498255:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.498262:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e486ab/0x878a5eea00cede72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826306.498276:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826306.498277:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826306.498279:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826306.498284:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.498838:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826306.498844:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787826306.499167:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705668 is committed 00002000:00080000:3.0:1787826306.499401:0:43895:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6119 00000100:00100000:3.0:1787826306.499498:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:196444:x1874663049382272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 42312us (42405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.499507:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22605 00000100:00100000:2.0:1787826306.500843:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:196442:x1874663049382784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23884us (23967us total) trans 38654705668 rc 0/0 00000100:00100000:2.0:1787826306.500859:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22607 00000100:00100000:2.0:1787826306.500912:0:196442:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 2 00000100:00100000:2.0:1787826306.500920:0:196442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196442:1874663049382784:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787826306.500935:0:196442:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x18c1:0x0]-[0x280000401:0x18e1:0x0] 00000100:00100000:1.0:1787826306.502952:0:196444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196444:1874663049382272:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787826306.502969:0:196444:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1881:0x0] from OST, last_created [0x2c0000401:0x1881:0x0]last_used is [0x2c0000401:0x17e7:0x0] 00000100:00100000:1.0:1787826306.503032:0:196444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196444:1874663049383040:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787826306.503084:0:196444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826306.503121:0:196444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be53840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826306.503441:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049383040 00000100:00100000:2.0:1787826306.503448:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049383040 00000100:00100000:2.0:1787826306.503491:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22608 00000100:00100000:2.0:1787826306.503500:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:196444:x1874663049383040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787826306.503535:0:43904:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6274 00000100:00100000:1.0:1787826306.503877:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049382912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826306.503910:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826306.503985:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049382912 00000100:00100000:3.0:1787826306.503990:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049382912 00000100:00100000:3.0:1787826306.504020:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000100:00100000:3.0:1787826306.504027:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049382912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826306.504040:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143936 pending 896 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826306.504086:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049382912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.504092:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00000100:00100000:3.0:1787826306.504130:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049382912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826306.508275:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:196444:x1874663049383040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4770us (5184us total) trans 4294975537 rc 0/0 00000100:00100000:2.0:1787826306.508287:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22608 00000100:00100000:1.0:1787826306.508408:0:196444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196444:1874663049383040:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787826306.508424:0:196444:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1881:0x0]-[0x2c0000401:0x18a1:0x0] 00000020:00000004:0.0:1787826306.569566:0:196762:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826306.569873:0:196762:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787826306.900588:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787826306.903984:0:187942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:2.0:1787826307.494962:0:196812:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826307.495213:0:196812:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787826307.835606:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826307.835672:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826307.835693:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043002368 00000100:00100000:1.0:1787826307.835705:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043002368 00000100:00100000:3.0:1787826307.835726:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826307.835765:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043002496 00000100:00100000:1.0:1787826307.835769:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043002496 00000100:00100000:1.0:1787826307.835813:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 331 00000100:00100000:1.0:1787826307.835825:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043002368:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826307.835839:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043002240 00000100:00100000:0.0:1787826307.835844:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043002240 00000100:00100000:0.0:1787826307.835884:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:0.0:1787826307.835892:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043002240:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826307.835911:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043002368:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826307.835919:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 331 00000100:00100000:0.0:1787826307.835928:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043002240:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826307.835935:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:1.0:1787826307.835942:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 332 00000100:00100000:1.0:1787826307.835952:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043002496:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826307.835980:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043002496:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826307.835988:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 332 00010000:00010000:1.0:1787826307.925992:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826308.948710:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826308.948847:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049383168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826308.948918:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826308.948995:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049383168 00000100:00100000:2.0:1787826308.949003:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049383168 00000100:00100000:2.0:1787826308.949070:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5856 00000100:00100000:2.0:1787826308.949081:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049383168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826308.949108:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00080000:0.0:1787826308.950538:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826308.954892:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049383168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5804us (5963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826308.954907:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5856 00000100:00100000:1.0:1787826308.956141:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049383168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826309.410069:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826309.410841:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043002624 00000100:00100000:1.0:1787826309.410852:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043002624 00000100:00080000:0.0:1787826309.410995:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826309.411762:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1095 00000100:00100000:1.0:1787826309.411779:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:160988:x1874663043002624:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826309.411799:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826309.411821:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cede79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f24a expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826309.411885:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00cede80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826309.411899:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00cede80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826309.411912:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00cede80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826309.411960:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787826309.411963:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826309.411982:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00cede80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826309.412005:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cede79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f24a expref: 9 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826309.412026:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00cede80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f24a expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826309.412034:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826309.412037:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826309.412041:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb480d65400, rc 0) 00000100:00100000:1.0:1787826309.412111:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:160988:x1874663043002624:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 339us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826309.412119:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1095 00000100:00100000:3.0:1787826309.416827:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826309.417770:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043002752 00000100:00100000:1.0:1787826309.417782:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043002752 00000100:00100000:1.0:1787826309.417845:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1096 00000100:00100000:1.0:1787826309.417855:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:160988:x1874663043002752:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:1.0:1787826309.417894:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00000100:00100000:1.0:1787826309.417968:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:160988:x1874663043002752:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 114us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826309.417976:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1096 00000100:00100000:3.0:1787826309.420150:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826309.420393:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043002880 00000100:00100000:2.0:1787826309.420403:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043002880 00000100:00100000:2.0:1787826309.420458:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1097 00000100:00100000:2.0:1787826309.420469:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160988:x1874663043002880:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826309.420507:0:188682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:2.0:1787826309.420576:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:160988:x1874663043002880:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 108us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826309.420583:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1097 00000100:00100000:3.0:1787826309.427754:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826309.427869:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043003008 00000100:00100000:2.0:1787826309.427879:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043003008 00000100:00100000:2.0:1787826309.427926:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22609 00000100:00100000:2.0:1787826309.427934:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2388:x1874663043003008:12345-192.168.203.47@tcp:8:lfs.0 00010000:00080000:2.0:1787826309.427966:0:43903:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp t0 exp 0000000000000000 cur 8376 last 0 00000020:00000080:2.0:1787826309.427995:0:43903:0:(genops.c:1385:class_connect()) connect: client c0d7758a-4501-4a89-8ec1-407fef4f0c7f, cookie 0x878a5eea00cede87 00002000:00100000:2.0:1787826309.428007:0:43903:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c0d7758a-4501-4a89-8ec1-407fef4f0c7f/ffff8eb3434f2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787826309.428018:0:43903:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787826309.428088:0:43903:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787826309.428117:0:43903:0:(import.c:65:import_set_state_nolock()) ffff8eb47f952000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826309.428187:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043003008:12345-192.168.203.47@tcp:8:lfs.0 Request processed in 252us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826309.428195:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22609 00000100:00100000:3.0:1787826309.440166:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826309.440717:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043003136 00000100:00100000:0.0:1787826309.440727:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043003136 00000100:00100000:0.0:1787826309.440821:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5857 00000100:00100000:0.0:1787826309.440833:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160988:x1874663043003136:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826309.440862:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826309.440946:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160988:x1874663043003136:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 114us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826309.440954:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5857 00000100:00080000:1.0:1787826309.441040:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826309.448077:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826309.448178:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043003264 00000100:00100000:1.0:1787826309.448188:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043003264 00000100:00100000:1.0:1787826309.448231:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22610 00000100:00100000:1.0:1787826309.448240:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2388:x1874663043003264:12345-192.168.203.47@tcp:8:lfs.0 00010000:00080000:1.0:1787826309.448286:0:43906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp t0 exp 0000000000000000 cur 8376 last 0 00000020:00000080:1.0:1787826309.448316:0:43906:0:(genops.c:1385:class_connect()) connect: client c0d7758a-4501-4a89-8ec1-407fef4f0c7f, cookie 0x878a5eea00cede8e 00002000:00100000:1.0:1787826309.448362:0:43906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c0d7758a-4501-4a89-8ec1-407fef4f0c7f/ffff8eb47f9a7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787826309.448380:0:43906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787826309.448438:0:43906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787826309.448466:0:43906:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826309.448530:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043003264:12345-192.168.203.47@tcp:8:lfs.0 Request processed in 290us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826309.448538:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22610 00000100:00100000:2.0:1787826309.452431:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826309.452554:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043003392 00000100:00100000:3.0:1787826309.452564:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043003392 00000100:00100000:3.0:1787826309.452634:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5858 00000100:00100000:3.0:1787826309.452648:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160988:x1874663043003392:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826309.452682:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826309.452754:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:160988:x1874663043003392:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 110us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826309.452762:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5858 00000100:00080000:1.0:1787826309.453129:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826309.972532:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826309.972561:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049383296:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826309.972579:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826309.972627:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.972937:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049383296 00000100:00100000:3.0:1787826309.972945:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049383296 00000100:00100000:3.0:1787826309.973012:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1787826309.973022:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049383296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826309.973045:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826309.973100:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049383296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826309.973106:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1787826309.973154:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049383296:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787826309.973320:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826311.009271:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826311.516247:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049383424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516317:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516381:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049383936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516408:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516427:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049384448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516451:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516467:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049384960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516491:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516512:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826311.516518:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049383808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516541:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516554:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049384320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516574:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516590:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049384832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516611:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516651:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049383552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516677:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516700:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049384064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516720:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516733:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049384576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516754:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516771:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826311.516777:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049383680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516794:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516807:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049384192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516821:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516828:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049384704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.516847:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826311.516872:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049383936 00000100:00100000:0.0:1787826311.516878:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049383936 00000100:00100000:0.0:1787826311.516917:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049384832 00000100:00100000:0.0:1787826311.516920:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049384832 00000100:00100000:0.0:1787826311.516938:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049384064 00000100:00100000:0.0:1787826311.516940:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049384064 00000100:00100000:0.0:1787826311.516955:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049384704 00000100:00100000:0.0:1787826311.516958:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049384704 00000100:00100000:0.0:1787826311.516976:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7107 00000100:00100000:0.0:1787826311.516984:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049383936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517030:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049383936:12345-0@lo:400:kworker.0 Request processed in 47us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517038:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7107 00000100:00100000:0.0:1787826311.517053:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7108 00000100:00100000:0.0:1787826311.517059:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049384832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517082:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049384832:12345-0@lo:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517087:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7108 00000100:00100000:0.0:1787826311.517097:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7109 00000100:00100000:0.0:1787826311.517103:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049384064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517131:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049384064:12345-0@lo:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517137:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7109 00000100:00100000:0.0:1787826311.517148:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7110 00000100:00100000:0.0:1787826311.517154:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049384704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517179:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049384704:12345-0@lo:400:kworker.0 Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517188:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7110 00000100:00100000:0.0:1787826311.517206:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049384448 00000100:00100000:0.0:1787826311.517209:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049384448 00000100:00100000:0.0:1787826311.517228:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049384960 00000100:00100000:0.0:1787826311.517231:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049384960 00000100:00100000:0.0:1787826311.517241:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049384320 00000100:00100000:0.0:1787826311.517243:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049384320 00000100:00100000:0.0:1787826311.517253:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049383552 00000100:00100000:0.0:1787826311.517255:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049383552 00000100:00100000:0.0:1787826311.517266:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049383680 00000100:00100000:0.0:1787826311.517268:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049383680 00000100:00100000:0.0:1787826311.517277:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049384192 00000100:00100000:0.0:1787826311.517280:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049384192 00000100:00100000:0.0:1787826311.517291:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787826311.517298:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049384448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517352:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049384448:12345-0@lo:400:kworker.0 Request processed in 54us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517359:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787826311.517371:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787826311.517377:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049384960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517403:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049384960:12345-0@lo:400:kworker.0 Request processed in 26us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517409:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787826311.517419:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787826311.517425:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049384320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517449:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049384320:12345-0@lo:400:kworker.0 Request processed in 24us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517455:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787826311.517466:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787826311.517472:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049383552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517497:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049383552:12345-0@lo:400:kworker.0 Request processed in 26us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517502:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787826311.517513:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787826311.517519:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049383680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517546:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049383680:12345-0@lo:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517551:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787826311.517562:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787826311.517568:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049384192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517593:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049384192:12345-0@lo:400:kworker.0 Request processed in 26us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517598:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787826311.517621:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049383808 00000100:00100000:0.0:1787826311.517625:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049383808 00000100:00100000:0.0:1787826311.517666:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049384576 00000100:00100000:0.0:1787826311.517670:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049384576 00000100:00100000:0.0:1787826311.517690:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12776 00000100:00100000:0.0:1787826311.517696:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049383808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517733:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049383808:12345-0@lo:400:kworker.0 Request processed in 37us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517738:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12776 00000100:00100000:0.0:1787826311.517749:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12777 00000100:00100000:0.0:1787826311.517756:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049384576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517783:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049384576:12345-0@lo:400:kworker.0 Request processed in 28us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826311.517795:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12777 00000100:00100000:0.0:1787826311.517850:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049383680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517862:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049384192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517871:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049384704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517880:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049383552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517888:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049384064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517897:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049384576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517934:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049383808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517944:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049384320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517953:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049384832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517962:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049383936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517970:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049384448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826311.517978:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049384960:0@lo:400:kworker.0 00000100:00100000:3.0:1787826311.518374:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049385088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826311.518410:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826311.518432:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826311.518437:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049385216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826311.518458:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826311.518479:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049385088 00000100:00100000:3.0:1787826311.518483:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049385088 00000100:00100000:3.0:1787826311.518513:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5860 00000100:00100000:3.0:1787826311.518520:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049385088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826311.518540:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826311.518573:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049385088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826311.518579:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5860 00000100:00100000:3.0:1787826311.518597:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049385216 00000100:00100000:3.0:1787826311.518600:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049385216 00000100:00100000:3.0:1787826311.518618:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12778 00000100:00100000:3.0:1787826311.518623:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049385216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826311.518656:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:3.0:1787826311.518684:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049385216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826311.518690:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12778 00000100:00100000:3.0:1787826311.518719:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049385216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826311.518730:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049385088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826311.518871:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049383424 00000100:00100000:1.0:1787826311.518876:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049383424 00000100:00100000:1.0:1787826311.518906:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787826311.518913:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049383424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826311.518952:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049383424:12345-0@lo:400:kworker.0 Request processed in 40us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.518957:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787826311.518995:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826311.519000:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826311.519002:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826311.519015:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049385344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826311.519040:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826311.519068:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049385344 00000100:00100000:1.0:1787826311.519071:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049385344 00000100:00100000:1.0:1787826311.519093:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12779 00000100:00100000:1.0:1787826311.519098:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3617:x1874663049385344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826311.519114:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00000100:00100000:1.0:1787826311.519146:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3617:x1874663049385344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826311.519152:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12779 00000100:00100000:1.0:1787826311.519180:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049385344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826311.519204:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049383424:0@lo:400:kworker.0 00000100:00100000:1.0:1787826311.520128:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826311.520143:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049385472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826311.520181:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826311.520848:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049385472 00000100:00100000:3.0:1787826311.520856:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049385472 00000100:00100000:3.0:1787826311.520899:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:3.0:1787826311.520908:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049385472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826311.520931:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826311.520984:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049385472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826311.520991:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00000100:00100000:1.0:1787826311.521299:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049385472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826312.021127:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826312.026853:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00100000:3.0:1787826312.030986:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00080000:3.0:1787826312.031003:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975537 is committed 00000001:00080000:0.0:1787826312.031092:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318275 is committed 00000001:00080000:0.0:1787826312.031099:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318274 is committed 00000100:00100000:0.0:1787826312.957659:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826312.957713:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826312.957750:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826312.957784:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826312.957811:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826312.957837:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043003648 00000100:00100000:0.0:1787826312.957846:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043003648 00000100:00100000:0.0:1787826312.957901:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043003776 00000100:00100000:0.0:1787826312.957904:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043003776 00000100:00100000:0.0:1787826312.957927:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 339 00000100:00100000:0.0:1787826312.957937:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2392:x1874663043003648:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826312.958003:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2392:x1874663043003648:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826312.958010:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 339 00000100:00100000:0.0:1787826312.958027:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 340 00000100:00100000:0.0:1787826312.958033:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043003776:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826312.958063:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043003776:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826312.958069:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 340 00000100:00080000:0.0:1787826312.958086:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826312.958091:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826312.958150:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043003904 00000100:00100000:3.0:1787826312.958155:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043003904 00000100:00100000:3.0:1787826312.958190:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043004032 00000100:00100000:3.0:1787826312.958193:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043004032 00000100:00100000:3.0:1787826312.958215:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7111 00000100:00100000:3.0:1787826312.958222:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043003904:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826312.958249:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043003904:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826312.958255:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7111 00000100:00100000:3.0:1787826312.958267:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7112 00000100:00100000:3.0:1787826312.958276:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043004032:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826312.958298:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043004032:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826312.958303:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7112 00000100:00080000:0.0:1787826312.958458:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826312.958461:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826312.958532:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043003520 00000100:00100000:1.0:1787826312.958537:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043003520 00000100:00100000:1.0:1787826312.958576:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 74 00000100:00100000:1.0:1787826312.958584:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043003520:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826312.958610:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043003520:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826312.958616:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 74 00010000:00010000:0.0:1787826313.044638:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826314.068538:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826314.068595:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826314.068616:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049385600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826314.068693:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826314.069050:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049385600 00000100:00100000:3.0:1787826314.069058:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049385600 00000100:00100000:3.0:1787826314.069168:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5862 00000100:00100000:3.0:1787826314.069182:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049385600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826314.069213:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826314.069266:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049385600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826314.069277:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5862 00000100:00100000:1.0:1787826314.070229:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049385600:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787826314.078779:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1787826314.943079:0:197005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1787826315.093606:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826315.093758:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049385728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826315.093830:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826315.093948:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049385728 00000100:00100000:2.0:1787826315.093957:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049385728 00000100:00100000:2.0:1787826315.094032:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5863 00000100:00100000:2.0:1787826315.094043:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049385728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826315.094072:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826315.094119:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049385728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826315.094126:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00000100:00080000:1.0:1787826315.094178:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826315.094216:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049385728:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826316.116529:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826316.628825:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049385856:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.628925:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.628986:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049386368:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629016:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629035:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049386880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629062:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629081:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049387392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629104:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629135:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826316.629141:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049385984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629167:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629187:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049386496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629209:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629224:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049387008:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629251:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629288:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049386112:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629313:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629359:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049386624:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629398:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629415:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049387136:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629437:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629455:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826316.629461:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049386240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629480:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629498:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049386752:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629519:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629531:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049387264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629551:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.629590:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049385856 00000100:00100000:1.0:1787826316.629609:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049385856 00000100:00100000:1.0:1787826316.629671:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787826316.629682:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049385856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629744:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049385856:12345-0@lo:400:kworker.0 Request processed in 63us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.629751:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787826316.629800:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049386880 00000100:00100000:1.0:1787826316.629805:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049386880 00000100:00100000:1.0:1787826316.629838:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049387392 00000100:00100000:1.0:1787826316.629841:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049387392 00000100:00100000:1.0:1787826316.629854:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049385984 00000100:00100000:1.0:1787826316.629856:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049385984 00000100:00100000:1.0:1787826316.629868:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049386112 00000100:00100000:1.0:1787826316.629870:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049386112 00000100:00100000:1.0:1787826316.629881:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049386624 00000100:00100000:1.0:1787826316.629883:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049386624 00000100:00100000:1.0:1787826316.629893:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049386752 00000100:00100000:1.0:1787826316.629895:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049386752 00000100:00100000:1.0:1787826316.629911:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787826316.629916:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049386880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.629951:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049386880:12345-0@lo:400:kworker.0 Request processed in 34us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.629958:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787826316.629972:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787826316.629979:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049387392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630009:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049387392:12345-0@lo:400:kworker.0 Request processed in 31us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630022:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787826316.630036:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787826316.630043:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049385984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630070:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049385984:12345-0@lo:400:kworker.0 Request processed in 28us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630075:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787826316.630086:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787826316.630092:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049386112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630127:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049386112:12345-0@lo:400:kworker.0 Request processed in 35us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630134:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787826316.630147:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787826316.630153:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049386624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630180:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049386624:12345-0@lo:400:kworker.0 Request processed in 28us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630186:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787826316.630198:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787826316.630204:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049386752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630234:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049386752:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630241:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787826316.630272:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049387008 00000100:00100000:1.0:1787826316.630276:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049387008 00000100:00100000:1.0:1787826316.630301:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049386240 00000100:00100000:1.0:1787826316.630304:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049386240 00000100:00100000:1.0:1787826316.630322:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12780 00000100:00100000:1.0:1787826316.630368:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049387008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630405:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049387008:12345-0@lo:400:kworker.0 Request processed in 39us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630412:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12780 00000100:00100000:1.0:1787826316.630425:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12781 00000100:00100000:1.0:1787826316.630431:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1874663049386240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630462:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1874663049386240:12345-0@lo:400:kworker.0 Request processed in 31us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630469:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12781 00000100:00100000:1.0:1787826316.630501:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049386368 00000100:00100000:1.0:1787826316.630505:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049386368 00000100:00100000:1.0:1787826316.630536:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049386496 00000100:00100000:1.0:1787826316.630540:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049386496 00000100:00100000:1.0:1787826316.630567:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049387136 00000100:00100000:1.0:1787826316.630571:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049387136 00000100:00100000:1.0:1787826316.630590:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049387264 00000100:00100000:1.0:1787826316.630593:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049387264 00000100:00100000:1.0:1787826316.630626:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7113 00000100:00100000:1.0:1787826316.630632:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049386368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630666:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049386368:12345-0@lo:400:kworker.0 Request processed in 35us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630673:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7113 00000100:00100000:1.0:1787826316.630684:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7114 00000100:00100000:1.0:1787826316.630690:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049386496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630714:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049386496:12345-0@lo:400:kworker.0 Request processed in 26us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630720:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7114 00000100:00100000:1.0:1787826316.630729:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7115 00000100:00100000:1.0:1787826316.630733:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049387136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630754:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049387136:12345-0@lo:400:kworker.0 Request processed in 21us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630759:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7115 00000100:00100000:1.0:1787826316.630767:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7116 00000100:00100000:1.0:1787826316.630773:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049387264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630795:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049387264:12345-0@lo:400:kworker.0 Request processed in 23us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.630801:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7116 00000100:00080000:1.0:1787826316.630821:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826316.630825:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826316.630828:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826316.630830:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826316.630865:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318274 gen 2 00000004:00080000:1.0:1787826316.630871:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318274 committed transno 352187318274 00000020:00080000:1.0:1787826316.630878:0:3619:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8eb481252cc0 refcount 2 committed 0 result 0 batchid 12884910964 00000020:00080000:1.0:1787826316.630882:0:3619:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb449176900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb4812529c0 00000020:00080000:1.0:1787826316.630885:0:3619:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027cd2:0x1:0x0].1 00000020:00080000:1.0:1787826316.630888:0:3619:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb449176300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb46e2b0c00 00000020:00080000:1.0:1787826316.630890:0:3619:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f5a:0x1:0x0].1 00000100:00100000:1.0:1787826316.630951:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049386240:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630967:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049386752:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630977:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975537 gen 2 00000100:00100000:1.0:1787826316.630986:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049387264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.630997:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049386112:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631006:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049386624:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631016:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049387136:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631053:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049385984:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631063:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049386496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631074:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049387008:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631083:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049385856:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631093:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049386368:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631104:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049386880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826316.631115:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049387392:0@lo:400:kworker.0 00000020:00080000:3.0:1787826316.631388:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 12884910964 committed batchid 8589939132 00000020:00080000:3.0:1787826316.631482:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 8589939132 00000100:00100000:2.0:1787826316.632772:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826316.632798:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049387648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826316.632878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826316.632937:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049387648 00000100:00100000:2.0:1787826316.632947:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049387648 00000100:00100000:2.0:1787826316.632998:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12782 00000100:00100000:2.0:1787826316.633007:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1874663049387648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826316.633049:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00000100:00100000:2.0:1787826316.633105:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1874663049387648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826316.633112:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12782 00000100:00100000:2.0:1787826316.633167:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049387648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826316.634760:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049387776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826316.634845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826316.635500:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049387776 00000100:00100000:0.0:1787826316.635511:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049387776 00000100:00100000:0.0:1787826316.635571:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5864 00000100:00100000:0.0:1787826316.635584:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049387776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826316.635631:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826316.635698:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049387776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826316.635705:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5864 00000100:00100000:1.0:1787826316.636222:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049387520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826316.636271:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826316.636306:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826316.636312:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049387904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826316.636355:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826316.636632:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049387904 00000100:00100000:0.0:1787826316.636638:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049387904 00000100:00100000:0.0:1787826316.636668:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5865 00000100:00100000:0.0:1787826316.636677:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049387904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826316.636704:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826316.636747:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049387904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826316.636753:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5865 00000100:00100000:1.0:1787826316.638728:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049387520 00000100:00100000:1.0:1787826316.638746:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049387520 00000001:02000400:3.0:1787826316.638843:0:197054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1787826316.639431:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049387776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826316.640375:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12783 00000100:00100000:1.0:1787826316.640465:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049387520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826316.640518:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:1.0:1787826316.640634:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049387520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (4361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826316.640642:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12783 00000100:00100000:1.0:1787826316.640731:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049387904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826316.640750:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049387520:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787826317.141360:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826318.075108:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.075165:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.075206:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.075228:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.075251:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.075278:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043004160 00000100:00100000:1.0:1787826318.075288:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043004160 00000100:00100000:1.0:1787826318.075374:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:1.0:1787826318.075384:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043004160:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826318.075448:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043004160:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 65us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826318.075457:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:1.0:1787826318.075492:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043004288 00000100:00100000:1.0:1787826318.075496:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043004288 00000100:00100000:1.0:1787826318.075544:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043004416 00000100:00100000:1.0:1787826318.075548:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043004416 00000100:00100000:1.0:1787826318.075578:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 347 00000100:00100000:1.0:1787826318.075585:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2390:x1874663043004288:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826318.075628:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2390:x1874663043004288:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826318.075635:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 347 00000100:00100000:1.0:1787826318.075649:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 348 00000100:00100000:1.0:1787826318.075657:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043004416:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826318.075685:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043004416:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826318.075691:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 348 00000100:00100000:1.0:1787826318.075715:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043004544 00000100:00100000:1.0:1787826318.075719:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043004544 00000100:00080000:0.0:1787826318.075764:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826318.075769:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826318.075771:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826318.075880:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043004672 00000100:00100000:1.0:1787826318.075884:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043004672 00000100:00100000:3.0:1787826318.079615:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7117 00000100:00100000:3.0:1787826318.079639:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043004544:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826318.079724:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043004544:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 97us (4558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826318.079732:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7117 00000100:00100000:3.0:1787826318.083253:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7118 00000100:00100000:3.0:1787826318.083285:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043004672:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826318.083396:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043004672:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 124us (8142us total) trans 0 rc 0/0 00000100:00080000:0.0:1787826318.085315:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826318.091541:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7118 00010000:00010000:3.0:1787826318.164504:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826318.551702:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.551802:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043004800 00000100:00100000:2.0:1787826318.551813:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043004800 00000100:00100000:2.0:1787826318.551877:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1098 00000100:00100000:2.0:1787826318.551888:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:161456:x1874663043004800:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826318.552119:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00000100:00100000:2.0:1787826318.552236:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:161456:x1874663043004800:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 349us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826318.552244:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1098 00000100:00100000:2.0:1787826318.555426:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.555681:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043004928 00000100:00100000:0.0:1787826318.555696:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043004928 00000100:00100000:0.0:1787826318.555777:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1099 00000100:00100000:0.0:1787826318.555792:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161456:x1874663043004928:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826318.555848:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:0.0:1787826318.555954:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161456:x1874663043004928:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 164us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826318.555966:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1099 00000100:00100000:2.0:1787826318.559688:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.559858:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043005056 00000100:00100000:0.0:1787826318.559871:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043005056 00000100:00100000:0.0:1787826318.559936:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5866 00000100:00100000:0.0:1787826318.559945:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161456:x1874663043005056:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826318.559985:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826318.560063:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161456:x1874663043005056:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 119us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826318.560068:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5866 00000100:00100000:1.0:1787826318.562945:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.563159:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043005184 00000100:00100000:2.0:1787826318.563173:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043005184 00000100:00100000:2.0:1787826318.563358:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5867 00000100:00100000:2.0:1787826318.563374:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161456:x1874663043005184:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:2.0:1787826318.563418:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826318.563512:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161456:x1874663043005184:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 143us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826318.563521:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5867 00000100:00100000:1.0:1787826318.612966:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.613074:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043005312 00000100:00100000:2.0:1787826318.613088:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043005312 00000100:00100000:2.0:1787826318.613165:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1100 00000100:00100000:2.0:1787826318.613177:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:161472:x1874663043005312:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826318.613201:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.613236:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cede95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f251 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613319:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613368:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613397:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613414:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613421:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613428:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613852:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613864:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613872:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826318.613919:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1787826318.613924:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826318.613948:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613964:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613972:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613983:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613990:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.613997:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.614001:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614009:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614024:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:2.0:1787826318.614028:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.614033:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614039:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cede9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614058:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614064:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614070:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614076:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.614080:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614086:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614093:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8eb472775500) 00010000:00010000:2.0:1787826318.614095:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.614098:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614104:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedea3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614143:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cede95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 9 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614159:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.614167:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:2.0:1787826318.614170:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826318.614172:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511e00, rc 0) 00000100:00100000:2.0:1787826318.614279:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:161472:x1874663043005312:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1102us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826318.614288:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1100 00000100:00100000:3.0:1787826318.630806:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.630954:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043005568 00000100:00100000:2.0:1787826318.630970:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043005568 00000100:00100000:2.0:1787826318.631053:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1101 00000100:00100000:2.0:1787826318.631067:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:161472:x1874663043005568:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826318.631098:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.631127:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cedeb1 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f258 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.631261:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.631280:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.631295:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.631310:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.631322:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedcb2 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ced9da expref: 6 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.631620:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 4/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.631741:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedcb2 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00ced9da expref: 6 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826318.631762:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049388032:0@lo:104: 00000100:00100000:2.0:1787826318.631832:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826318.631880:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450cee240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826318.632012:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049388032 00000100:00100000:3.0:1787826318.632020:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049388032 00000100:00100000:3.0:1787826318.632084:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4774 00000100:00100000:3.0:1787826318.632094:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:187905:x1874663049388032:12345-0@lo:104: 00010000:00010000:3.0:1787826318.632110:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.632202:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826318.632221:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:187905:x1874663049388032:12345-0@lo:104: Request processed in 118us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826318.632229:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4774 00010000:00010000:3.0:1787826318.632259:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826318.632269:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.632279:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38e00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826318.632285:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 4/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826318.632295:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 4/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.632360:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.632367:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826318.632880:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187905:1874663049388032:0@lo:104: 00010000:00010000:2.0:1787826318.632904:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.632981:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 1/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.632990:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf38e00/0x878a5eea00ced9da lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedcb2 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.633015:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826318.633017:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826318.633019:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826318.634477:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049388160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826318.634566:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826318.635219:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049388160 00000100:00100000:1.0:1787826318.635231:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049388160 00010000:00010000:1.0:1787826318.635277:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedcb2 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x878a5eea00ced9da expref: 7 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826318.635360:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12230 00000100:00100000:1.0:1787826318.635381:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049388160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826318.635400:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826318.636645:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39e00/0x878a5eea00cedcb2 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00ced9da expref: 7 pid: 196456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.636673:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0xf7117594 (ffff8eb34d1bd500) 00010000:00010000:0.0:1787826318.636679:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.636691:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.636699:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 4/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.636737:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826318.636836:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049388160:12345-0@lo:103:ldlm_bl.0 Request processed in 1464us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826318.636845:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12230 00010000:00010000:2.0:1787826318.636981:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.636991:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826318.637183:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049388288:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826318.637246:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826318.637281:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450ceed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826318.637458:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049388288 00000100:00100000:3.0:1787826318.637468:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049388288 00000100:00100000:3.0:1787826318.637530:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12784 00000100:00100000:3.0:1787826318.637542:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:187905:x1874663049388288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826318.637652:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:187905:x1874663049388288:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826318.637659:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12784 00000100:00100000:1.0:1787826318.637984:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049388160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826318.638103:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187905:1874663049388288:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787826318.638183:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedec6 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638199:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedec6 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638223:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedec6 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638239:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638247:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638255:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638261:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826318.638267:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638276:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638291:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:0.0:1787826318.638295:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826318.638299:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638307:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cedeb8 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638357:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638366:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638372:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638378:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826318.638381:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638388:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638396:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0xf7117594 (ffff8eb34d1bd500) 00010000:00010000:0.0:1787826318.638399:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826318.638402:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638408:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cedebf lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638599:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cedeb1 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f258 expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638619:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedec6 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f258 expref: 9 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.638632:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:0.0:1787826318.638635:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826318.638705:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568000, rc 0) 00000100:00100000:0.0:1787826318.638781:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:161472:x1874663043005568:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 7717us (8145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826318.638790:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1101 00000100:00100000:0.0:1787826318.641008:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.641109:0:187915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043005696 00000100:00100000:1.0:1787826318.641121:0:187915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043005696 00000100:00100000:1.0:1787826318.641199:0:187915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:1.0:1787826318.641221:0:187915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161472:x1874663043005696:12345-192.168.203.47@tcp:900:lfs.0 00000100:00100000:1.0:1787826318.641352:0:187915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161472:x1874663043005696:12345-192.168.203.47@tcp:900:lfs.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826318.641361:0:187915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:1.0:1787826318.644028:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.644127:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043005952 00000100:00100000:2.0:1787826318.644598:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043005952 00000100:00100000:2.0:1787826318.645284:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1102 00000100:00100000:2.0:1787826318.645301:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:161472:x1874663043005952:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826318.645360:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.645392:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cedecd lrc: 2/0,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f25f expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826318.645972:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787826318.646116:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cedecd lrc: 1/0,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f25f expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.646796:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb472775500) 00010000:00010000:2.0:1787826318.646802:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826318.646811:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510400/0x878a5eea00cedecd lrc: 0/0,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f25f expref: 7 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.646851:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00000100:00100000:2.0:1787826318.646995:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:161472:x1874663043005952:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1697us (2981us total) trans 17179869986 rc 301/301 00000100:00100000:2.0:1787826318.647007:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1102 00000100:00100000:2.0:1787826318.663736:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.663785:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043006208 00000100:00100000:3.0:1787826318.663799:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043006208 00000100:00100000:3.0:1787826318.663876:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:3.0:1787826318.663890:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:161472:x1874663043006208:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:3.0:1787826318.664195:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:161472:x1874663043006208:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 307us (473us total) trans 17179869987 rc 0/0 00000100:00100000:3.0:1787826318.664203:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:0.0:1787826318.699675:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.699787:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043006464 00000100:00100000:1.0:1787826318.699800:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043006464 00000100:00100000:1.0:1787826318.699887:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1103 00000100:00100000:1.0:1787826318.699900:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:161476:x1874663043006464:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826318.699935:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826318.699969:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00cededb lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f266 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826318.700128:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:188682:1874663049388416:0@lo:900:mdt00_003.0 00000100:00100000:1.0:1787826318.700204:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826318.700250:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460285180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826318.700777:0:187915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049388416 00000100:00100000:2.0:1787826318.700784:0:187915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049388416 00000100:00100000:2.0:1787826318.700834:0:187915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787826318.700844:0:187915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:188682:x1874663049388416:12345-0@lo:900:mdt00_003.0 00000100:00100000:2.0:1787826318.700929:0:187915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:188682:x1874663049388416:12345-0@lo:900:mdt00_003.0 Request processed in 86us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826318.700938:0:187915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787826318.701099:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:188682:1874663049388416:0@lo:900:mdt00_003.0 00000100:00100000:1.0:1787826318.701193:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049388544:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826318.701248:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826318.701279:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826318.701400:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049388544 00000100:00100000:2.0:1787826318.701405:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049388544 00000100:00100000:2.0:1787826318.701455:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12785 00000100:00100000:2.0:1787826318.701464:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049388544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826318.701565:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049388544:12345-0@lo:1000:mdt00_003.0 Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826318.701572:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12785 00000100:00100000:3.0:1787826318.701665:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049388544:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787826318.701741:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.701752:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.701763:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826318.701778:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4815e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049388672:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826318.701808:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826318.701832:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826318.702056:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049388672 00000100:00100000:2.0:1787826318.702061:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049388672 00000100:00100000:2.0:1787826318.702100:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12786 00000100:00100000:2.0:1787826318.702108:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049388672:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826318.702118:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.702150:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cedee9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cedee2 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.702180:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cedee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cedee2 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.702198:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cedee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedee2 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.702208:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:2.0:1787826318.702211:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826318.702216:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00000100:00100000:2.0:1787826318.702310:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049388672:12345-0@lo:101:mdt00_003.0 Request processed in 203us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826318.702318:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12786 00000100:00100000:0.0:1787826318.704066:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4815e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049388672:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826318.704105:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedee9 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.704144:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedee9 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826318.704177:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787826318.704188:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedee9 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.704197:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedee9 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.705097:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.705117:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.705144:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.705165:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.705172:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.705180:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826318.705432:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ffdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049388800:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826318.705661:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826318.705714:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344537cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826318.705968:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049388800 00000100:00100000:2.0:1787826318.705977:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049388800 00000100:00100000:2.0:1787826318.706045:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12787 00000100:00100000:2.0:1787826318.706057:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049388800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826318.706162:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049388800:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826318.706170:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12787 00000100:00100000:1.0:1787826318.706374:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ffdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049388800:0@lo:1000:mdt00_003.0 00000004:00080000:1.0:1787826318.706946:0:188682:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x36b:0x0], count =23 00000004:00080000:1.0:1787826318.706957:0:188682:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x36b:0x0]+23 in llog 00000004:00080000:1.0:1787826318.706976:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x382:0x0], index 0: 0 00010000:00010000:1.0:1787826318.707196:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00cedefe lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.708319:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00cedefe lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.708362:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00cedefe lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.708434:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709203:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709286:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709294:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826318.709299:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709309:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709581:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb348b07800) 00010000:00010000:1.0:1787826318.709595:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826318.709602:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709610:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00cedef0 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826318.709811:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062166278 reply state 000000007aba26a4 transno 17179869988 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709829:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709837:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x679fc7b1 (ffff8eb348b07f00) 00010000:00010000:1.0:1787826318.709839:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826318.709843:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826318.709915:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00cededb lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f266 expref: 10 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709949:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00cedefe lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f266 expref: 9 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826318.709957:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2:0x0].0x0 (ffff8eb348b07100) 00010000:00010000:1.0:1787826318.709960:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826318.709962:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356600, rc 0) 00000100:00100000:1.0:1787826318.710151:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:161476:x1874663043006464:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 10252us (10491us total) trans 17179869988 rc 0/0 00000100:00100000:1.0:1787826318.710162:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1103 00000100:00100000:1.0:1787826318.727944:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.730413:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043006720 00000100:00100000:3.0:1787826318.730436:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043006720 00000100:00100000:3.0:1787826318.730543:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:3.0:1787826318.730557:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:161476:x1874663043006720:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826318.731003:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:161476:x1874663043006720:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 446us (3072us total) trans 17179869989 rc 0/0 00000100:00100000:3.0:1787826318.731013:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:2.0:1787826318.739615:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.742920:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043006976 00000100:00100000:0.0:1787826318.742944:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043006976 00000100:00100000:0.0:1787826318.743044:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1104 00000100:00100000:0.0:1787826318.743059:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:161476:x1874663043006976:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826318.743096:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826318.743130:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf0c lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f26d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.743311:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.743363:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.743378:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.743394:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.743402:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.743410:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826318.743861:0:187905:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x36c:0x0], count =22 00000004:00080000:0.0:1787826318.743872:0:187905:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x36c:0x0]+22 in llog 00000004:00080000:0.0:1787826318.743884:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x382:0x0], index 1: 0 00010000:00010000:0.0:1787826318.744066:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedf21 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744077:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedf21 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744085:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedf21 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744123:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744131:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744139:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744145:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826318.744150:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744158:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744170:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8feb00) 00010000:00010000:0.0:1787826318.744173:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826318.744178:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744183:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf13 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826318.744203:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003130cb7b reply state 000000008674f870 transno 17179869990 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744213:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744219:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x94c295fa (ffff8eb47f8fed00) 00010000:00010000:0.0:1787826318.744222:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826318.744225:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826318.744265:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf0c lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f26d expref: 14 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744290:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedf21 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f26d expref: 13 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.744298:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x3:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:0.0:1787826318.744300:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826318.744303:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569000, rc 0) 00000100:00100000:0.0:1787826318.744456:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+14:161476:x1874663043006976:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1399us (5244us total) trans 17179869990 rc 0/0 00000100:00100000:0.0:1787826318.744465:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1104 00000100:00100000:1.0:1787826318.747804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.747970:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043007232 00000100:00100000:3.0:1787826318.747983:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043007232 00000100:00100000:3.0:1787826318.748057:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:3.0:1787826318.748072:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+14:161476:x1874663043007232:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826318.750059:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+15:161476:x1874663043007232:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 1977us (2257us total) trans 17179869991 rc 0/0 00000100:00100000:3.0:1787826318.750076:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:0.0:1787826318.756612:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.756766:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043007488 00000100:00100000:2.0:1787826318.756781:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043007488 00000100:00100000:2.0:1787826318.756863:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1105 00000100:00100000:2.0:1787826318.756876:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+15:161476:x1874663043007488:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.756912:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.756946:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cedf2f lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f274 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.757104:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.757122:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.757145:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.757161:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.757168:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.757175:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.757833:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x383:0x0], index 0: 0 00010000:00010000:2.0:1787826318.758013:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cedf44 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758026:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cedf44 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758035:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cedf44 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758076:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758089:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758096:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758103:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.758108:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758116:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758131:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb472775500) 00010000:00010000:2.0:1787826318.758134:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.758140:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758146:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedf36 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.758165:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ba956b1 reply state 00000000f01d5080 transno 17179869992 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758177:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758183:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xc1e56442 (ffff8eb472775f00) 00010000:00010000:2.0:1787826318.758186:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.758189:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.758247:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cedf2f lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f274 expref: 18 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758271:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cedf44 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f274 expref: 17 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.758280:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x4:0x0].0x0 (ffff8eb472775a00) 00010000:00010000:2.0:1787826318.758282:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.758285:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511800, rc 0) 00000100:00100000:2.0:1787826318.758419:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+18:161476:x1874663043007488:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1544us (1831us total) trans 17179869992 rc 0/0 00000100:00100000:2.0:1787826318.758429:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1105 00000100:00100000:0.0:1787826318.761165:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.765929:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043007744 00000100:00100000:3.0:1787826318.765950:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043007744 00000100:00100000:3.0:1787826318.766050:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:3.0:1787826318.766062:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+18:161476:x1874663043007744:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826318.766510:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+19:161476:x1874663043007744:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 448us (5359us total) trans 17179869993 rc 0/0 00000100:00100000:3.0:1787826318.766519:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:1.0:1787826318.774999:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.775099:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043008000 00000100:00100000:3.0:1787826318.775113:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043008000 00000100:00100000:3.0:1787826318.775195:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1106 00000100:00100000:3.0:1787826318.775207:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+19:161476:x1874663043008000:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:3.0:1787826318.775465:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826318.775600:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cedf52 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f27b expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.775745:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.775760:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.775773:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.775784:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xef08328a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.775791:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.775798:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.777720:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x383:0x0], index 1: 0 00010000:00010000:2.0:1787826318.777951:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cedf67 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.777969:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cedf67 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.777982:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cedf67 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.778027:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.778036:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.778044:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.778055:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.778060:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.778068:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.778082:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693400) 00010000:00010000:2.0:1787826318.778086:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.778091:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.778097:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cedf59 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.778113:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8816aa3 reply state 0000000086fc4c21 transno 17179869994 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.778126:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.780304:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xef08328a (ffff8eb481693700) 00010000:00010000:2.0:1787826318.780317:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.780365:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.780457:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cedf52 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f27b expref: 22 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.780763:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cedf67 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f27b expref: 21 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.780779:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x5:0x0].0x0 (ffff8eb472775500) 00010000:00010000:2.0:1787826318.780782:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.780785:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511200, rc 0) 00000100:00100000:2.0:1787826318.780891:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+22:161476:x1874663043008000:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 5685us (5904us total) trans 17179869994 rc 0/0 00000100:00100000:2.0:1787826318.780902:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1106 00000100:00100000:0.0:1787826318.789980:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.790197:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043008256 00000100:00100000:3.0:1787826318.790221:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043008256 00000100:00100000:3.0:1787826318.790302:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:3.0:1787826318.790316:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+22:161476:x1874663043008256:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826318.790980:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+23:161476:x1874663043008256:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 662us (1010us total) trans 17179869995 rc 0/0 00000100:00100000:3.0:1787826318.790991:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:0.0:1787826318.799734:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.800120:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043008512 00000100:00100000:1.0:1787826318.800148:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043008512 00000100:00100000:1.0:1787826318.800236:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1107 00000100:00100000:1.0:1787826318.800248:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+23:161476:x1874663043008512:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826318.800283:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826318.800316:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00cedf75 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f282 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.801201:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.801233:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.801250:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.801270:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.801283:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.801291:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826318.802784:0:187906:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x384:0x0], index 0: 0 00010000:00010000:0.0:1787826318.803004:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cedf8a lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803022:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cedf8a lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803034:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cedf8a lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803084:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803093:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803100:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803108:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803116:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826318.803122:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803136:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803151:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb348b07800) 00010000:00010000:0.0:1787826318.803155:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826318.803161:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803168:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf7c lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826318.803192:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000836877ef reply state 00000000f2dad4a2 transno 17179869996 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803205:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803608:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x1c2b00d3 (ffff8eb47f8feb00) 00010000:00010000:0.0:1787826318.803612:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826318.803616:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826318.803673:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00cedf75 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f282 expref: 26 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803705:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cedf8a lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f282 expref: 25 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.803714:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x6:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:0.0:1787826318.803716:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826318.803718:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568c00, rc 0) 00000100:00100000:0.0:1787826318.803824:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+26:161476:x1874663043008512:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 3576us (4104us total) trans 17179869996 rc 0/0 00000100:00100000:0.0:1787826318.803834:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1107 00000100:00100000:0.0:1787826318.811881:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.814463:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043008768 00000100:00100000:2.0:1787826318.814552:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043008768 00000100:00100000:2.0:1787826318.814706:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:2.0:1787826318.814721:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345734450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+26:161476:x1874663043008768:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:2.0:1787826318.815131:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345734450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+27:161476:x1874663043008768:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 412us (3262us total) trans 17179869997 rc 0/0 00000100:00100000:2.0:1787826318.815151:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:2.0:1787826318.819605:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.819839:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043009024 00000100:00100000:0.0:1787826318.819853:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043009024 00000100:00100000:0.0:1787826318.819942:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1108 00000100:00100000:0.0:1787826318.819955:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+27:161476:x1874663043009024:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826318.819990:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826318.820023:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf98 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f289 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.820256:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.820275:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.820288:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.820305:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.820313:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.820359:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826318.821052:0:187904:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x384:0x0], index 1: 0 00010000:00010000:0.0:1787826318.821430:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cedfad lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821448:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cedfad lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821457:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cedfad lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821568:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821577:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821592:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821599:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826318.821605:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821613:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821628:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:0.0:1787826318.821631:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826318.821706:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821719:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00cedf9f lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826318.821740:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f13da81 reply state 00000000c7bf1ded transno 17179869998 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821752:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821759:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x494dcf1b (ffff8eb47f8fe200) 00010000:00010000:0.0:1787826318.821761:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826318.821765:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826318.821810:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00cedf98 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f289 expref: 30 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821833:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cedfad lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f289 expref: 29 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.821841:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x7:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:0.0:1787826318.821843:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826318.821846:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18e00, rc 0) 00000100:00100000:0.0:1787826318.821943:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+30:161476:x1874663043009024:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1990us (2363us total) trans 17179869998 rc 0/0 00000100:00100000:0.0:1787826318.821953:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1108 00000100:00100000:0.0:1787826318.825146:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.830465:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043009280 00000100:00100000:3.0:1787826318.830488:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043009280 00000100:00100000:3.0:1787826318.830659:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:3.0:1787826318.830674:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+30:161476:x1874663043009280:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826318.831083:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+31:161476:x1874663043009280:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 411us (5963us total) trans 17179869999 rc 0/0 00000100:00100000:3.0:1787826318.831092:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:1.0:1787826318.836125:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.836355:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043009536 00000100:00100000:2.0:1787826318.836368:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043009536 00000100:00100000:2.0:1787826318.836454:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1109 00000100:00100000:2.0:1787826318.836467:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+31:161476:x1874663043009536:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.836498:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.836529:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cedfbb lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f290 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.836700:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.836720:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.836733:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.836747:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.836754:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.836760:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.837533:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x385:0x0], index 0: 0 00010000:00010000:2.0:1787826318.837796:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedfd0 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837810:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedfd0 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837819:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedfd0 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837858:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837866:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837873:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837881:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.837887:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837896:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837910:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb472775000) 00010000:00010000:2.0:1787826318.837913:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.837918:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837924:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfc2 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.837943:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428083b5 reply state 000000009db76cdb transno 17179870000 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837954:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.837960:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x76709d63 (ffff8eb472775100) 00010000:00010000:2.0:1787826318.837962:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.837966:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.838003:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cedfbb lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f290 expref: 34 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.838026:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedfd0 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f290 expref: 33 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.838039:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x8:0x0].0x0 (ffff8eb472775e00) 00010000:00010000:2.0:1787826318.838041:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.838044:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511400, rc 0) 00000100:00100000:2.0:1787826318.839854:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+34:161476:x1874663043009536:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 3373us (3727us total) trans 17179870000 rc 0/0 00000100:00100000:2.0:1787826318.839871:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1109 00000100:00100000:0.0:1787826318.841824:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.841954:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043009792 00000100:00100000:2.0:1787826318.841968:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043009792 00000100:00100000:2.0:1787826318.842042:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:2.0:1787826318.842055:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+34:161476:x1874663043009792:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:2.0:1787826318.842621:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+35:161476:x1874663043009792:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 565us (809us total) trans 17179870001 rc 0/0 00000100:00100000:2.0:1787826318.842631:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:0.0:1787826318.847875:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.848128:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043010048 00000100:00100000:2.0:1787826318.848154:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043010048 00000100:00100000:2.0:1787826318.848423:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1110 00000100:00100000:2.0:1787826318.848438:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+35:161476:x1874663043010048:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.848471:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.848501:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cedfde lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f297 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.848665:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.848682:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.848697:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.848711:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.848718:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.848724:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.849931:0:187906:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x385:0x0], index 1: 0 00010000:00010000:2.0:1787826318.850146:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cedff3 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850164:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cedff3 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850174:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cedff3 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850231:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850240:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850247:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850254:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850262:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.850267:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850274:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850288:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb472775000) 00010000:00010000:2.0:1787826318.850291:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.850295:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850302:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cedfe5 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.850321:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005623a003 reply state 00000000bd458f5c transno 17179870002 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850386:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850392:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xa3936bac (ffff8eb472775d00) 00010000:00010000:2.0:1787826318.850394:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.850398:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.850439:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cedfde lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f297 expref: 38 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850464:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cedff3 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f297 expref: 37 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.850477:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x9:0x0].0x0 (ffff8eb472775200) 00010000:00010000:2.0:1787826318.850480:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.850482:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715600, rc 0) 00000100:00100000:2.0:1787826318.850581:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+38:161476:x1874663043010048:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2145us (2721us total) trans 17179870002 rc 0/0 00000100:00100000:2.0:1787826318.850600:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1110 00000100:00100000:1.0:1787826318.854286:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.854444:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043010304 00000100:00100000:2.0:1787826318.854456:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043010304 00000100:00100000:2.0:1787826318.854519:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:2.0:1787826318.854531:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+38:161476:x1874663043010304:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:2.0:1787826318.854943:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+39:161476:x1874663043010304:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 412us (670us total) trans 17179870003 rc 0/0 00000100:00100000:2.0:1787826318.854952:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:0.0:1787826318.859955:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.860057:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043010560 00000100:00100000:2.0:1787826318.860069:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043010560 00000100:00100000:2.0:1787826318.860158:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1111 00000100:00100000:2.0:1787826318.860171:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+39:161476:x1874663043010560:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.860216:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.860249:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee001 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f29e expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.860605:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.860624:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.860647:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.860663:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.860671:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.860679:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.861432:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x386:0x0], index 0: 0 00010000:00010000:2.0:1787826318.861614:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee016 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861630:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee016 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861642:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee016 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861678:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861694:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861701:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861706:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.861712:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861718:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861731:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb472775400) 00010000:00010000:2.0:1787826318.861733:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.861737:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861742:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee008 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.861757:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b9b40db reply state 00000000ed620b31 transno 17179870004 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861768:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861774:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xd0b639f4 (ffff8eb472775800) 00010000:00010000:2.0:1787826318.861776:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.861779:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.861817:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee001 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f29e expref: 42 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861835:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee016 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f29e expref: 41 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.861843:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xa:0x0].0x0 (ffff8eb472775000) 00010000:00010000:2.0:1787826318.861846:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.861849:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714a00, rc 0) 00000100:00100000:2.0:1787826318.861920:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+42:161476:x1874663043010560:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1751us (1981us total) trans 17179870004 rc 0/0 00000100:00100000:2.0:1787826318.861930:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1111 00000100:00100000:1.0:1787826318.865145:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.865250:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043010816 00000100:00100000:3.0:1787826318.865264:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043010816 00000100:00100000:3.0:1787826318.865438:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:3.0:1787826318.865451:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+42:161476:x1874663043010816:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826318.865838:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+43:161476:x1874663043010816:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 388us (712us total) trans 17179870005 rc 0/0 00000100:00100000:3.0:1787826318.865847:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:0.0:1787826318.868804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.869524:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043011072 00000100:00100000:2.0:1787826318.869537:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043011072 00000100:00100000:2.0:1787826318.869628:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1112 00000100:00100000:2.0:1787826318.869642:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+43:161476:x1874663043011072:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.869674:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.869705:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee024 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2a5 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.869849:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.869866:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.869880:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.869895:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.869902:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.869909:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.870781:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x386:0x0], index 1: 0 00010000:00010000:2.0:1787826318.870979:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee039 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.870995:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee039 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871004:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee039 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871045:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871053:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871061:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871067:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.871072:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871080:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871095:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb472775900) 00010000:00010000:2.0:1787826318.871098:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.871103:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871110:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee02b lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.871134:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c57d4f4 reply state 0000000094385d66 transno 17179870006 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871146:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871153:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xfdd9083c (ffff8eb472775300) 00010000:00010000:2.0:1787826318.871155:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.871159:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.871203:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee024 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2a5 expref: 46 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871311:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee039 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2a5 expref: 45 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.871320:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xb:0x0].0x0 (ffff8eb472775600) 00010000:00010000:2.0:1787826318.871529:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.871535:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714400, rc 0) 00000100:00100000:2.0:1787826318.871711:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+46:161476:x1874663043011072:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2071us (2920us total) trans 17179870006 rc 0/0 00000100:00100000:2.0:1787826318.871722:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1112 00000100:00100000:1.0:1787826318.874967:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.875061:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043011328 00000100:00100000:0.0:1787826318.875075:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043011328 00000100:00100000:0.0:1787826318.875146:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:0.0:1787826318.875159:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+46:161476:x1874663043011328:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826318.875950:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+47:161476:x1874663043011328:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 790us (993us total) trans 17179870007 rc 0/0 00000100:00100000:0.0:1787826318.875961:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:0.0:1787826318.879792:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.879883:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043011584 00000100:00100000:2.0:1787826318.879897:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043011584 00000100:00100000:2.0:1787826318.879972:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1113 00000100:00100000:2.0:1787826318.879986:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+47:161476:x1874663043011584:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.880021:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.880055:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee047 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2ac expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.880202:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.880368:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.880436:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.880454:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.880462:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.880469:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.880943:0:187906:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x387:0x0], index 0: 0 00010000:00010000:2.0:1787826318.881128:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00cee05c lrc: 3/1,0 mode: --/PR res: [0x240001f59:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881141:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00cee05c lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881150:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00cee05c lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881190:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881204:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881453:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881460:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881466:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.881471:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881480:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881495:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb472775400) 00010000:00010000:2.0:1787826318.881499:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.881504:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881511:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee04e lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.881532:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec55497f reply state 000000002ed46bf3 transno 17179870008 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881545:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881552:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x1b7026cc (ffff8eb472775b00) 00010000:00010000:2.0:1787826318.881556:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.881559:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.881615:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee047 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2ac expref: 50 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881763:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00cee05c lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2ac expref: 49 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.881773:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xc:0x0].0x0 (ffff8eb472775c00) 00010000:00010000:2.0:1787826318.881775:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.881778:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714e00, rc 0) 00000100:00100000:2.0:1787826318.881938:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+50:161476:x1874663043011584:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1955us (2161us total) trans 17179870008 rc 0/0 00000100:00100000:2.0:1787826318.881948:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1113 00000100:00100000:1.0:1787826318.885181:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.885514:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043011840 00000100:00100000:3.0:1787826318.885528:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043011840 00000100:00100000:0.0:1787826318.885787:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:0.0:1787826318.885803:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345736c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+50:161476:x1874663043011840:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826318.886313:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345736c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+51:161476:x1874663043011840:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 511us (1143us total) trans 17179870009 rc 0/0 00000100:00100000:0.0:1787826318.886355:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:1.0:1787826318.889893:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.889988:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043012096 00000100:00100000:3.0:1787826318.890002:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043012096 00000100:00100000:3.0:1787826318.890088:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1114 00000100:00100000:3.0:1787826318.890102:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+51:161476:x1874663043012096:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:3.0:1787826318.890135:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826318.890168:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee06a lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2b3 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.890779:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.890798:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.890809:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.890824:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.890831:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.890837:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826318.891769:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x387:0x0], index 1: 0 00010000:00010000:3.0:1787826318.891974:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec600/0x878a5eea00cee07f lrc: 3/1,0 mode: --/PR res: [0x240001f59:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.891988:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec600/0x878a5eea00cee07f lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.891997:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec600/0x878a5eea00cee07f lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892039:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892047:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892053:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892060:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826318.892065:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892077:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892092:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693200) 00010000:00010000:3.0:1787826318.892095:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826318.892101:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892107:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee071 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826318.892123:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b5497ab reply state 00000000599f223e transno 17179870010 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892136:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892143:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x3e3e6f26 (ffff8eb481693500) 00010000:00010000:3.0:1787826318.892146:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826318.892149:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826318.892194:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee06a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2b3 expref: 54 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892621:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec600/0x878a5eea00cee07f lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2b3 expref: 53 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.892631:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xd:0x0].0x0 (ffff8eb481693900) 00010000:00010000:3.0:1787826318.892633:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826318.892699:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ec600, rc 0) 00000100:00100000:3.0:1787826318.892853:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+54:161476:x1874663043012096:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2752us (2974us total) trans 17179870010 rc 0/0 00000100:00100000:3.0:1787826318.892864:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1114 00000100:00100000:1.0:1787826318.895642:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.895816:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043012352 00000100:00100000:3.0:1787826318.895829:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043012352 00000100:00100000:3.0:1787826318.895952:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:3.0:1787826318.895967:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+54:161476:x1874663043012352:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826318.896414:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+55:161476:x1874663043012352:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 448us (783us total) trans 17179870011 rc 0/0 00000100:00100000:3.0:1787826318.896424:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:1.0:1787826318.899902:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.899997:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043012608 00000100:00100000:3.0:1787826318.900011:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043012608 00000100:00100000:3.0:1787826318.900090:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1115 00000100:00100000:3.0:1787826318.900105:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+55:161476:x1874663043012608:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:3.0:1787826318.900137:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826318.900169:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee08d lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2ba expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.900741:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.900763:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.900777:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.900795:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.900804:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.900810:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826318.901533:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x388:0x0], index 0: 0 00010000:00010000:3.0:1787826318.901830:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cee0a2 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901843:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cee0a2 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901857:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cee0a2 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901903:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901911:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901919:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901926:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826318.901932:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901940:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901960:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693e00) 00010000:00010000:3.0:1787826318.901963:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826318.901968:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.901976:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee094 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826318.901993:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2974fca reply state 000000000738fcf6 transno 17179870012 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.902006:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.902012:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x610cb780 (ffff8eb481693100) 00010000:00010000:3.0:1787826318.902015:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826318.902018:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826318.902064:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee08d lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2ba expref: 58 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.902089:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cee0a2 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2ba expref: 57 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.902096:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xe:0x0].0x0 (ffff8eb481693c00) 00010000:00010000:3.0:1787826318.902099:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826318.902101:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ec200, rc 0) 00000100:00100000:3.0:1787826318.902493:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+58:161476:x1874663043012608:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2388us (2603us total) trans 17179870012 rc 0/0 00000100:00100000:3.0:1787826318.902505:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1115 00000100:00100000:1.0:1787826318.909170:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.909273:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043012864 00000100:00100000:0.0:1787826318.909286:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043012864 00000100:00100000:0.0:1787826318.909400:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:0.0:1787826318.909414:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+58:161476:x1874663043012864:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826318.909833:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+59:161476:x1874663043012864:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 419us (675us total) trans 17179870013 rc 0/0 00000100:00100000:0.0:1787826318.909842:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:1.0:1787826318.912977:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.913090:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043013120 00000100:00100000:2.0:1787826318.913103:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043013120 00000100:00100000:2.0:1787826318.913180:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1116 00000100:00100000:2.0:1787826318.913193:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+59:161476:x1874663043013120:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.913236:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.913268:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee0b0 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2c1 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.913448:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.913466:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.913479:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.913494:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.913501:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.913508:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.914057:0:187906:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x388:0x0], index 1: 0 00010000:00010000:2.0:1787826318.914227:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee0c5 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914239:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee0c5 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914247:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee0c5 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914286:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914294:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914302:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914309:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914316:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.914551:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914564:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914578:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb472775400) 00010000:00010000:2.0:1787826318.914582:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.914597:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914605:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0b7 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.914624:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008625abc3 reply state 000000001a12cb65 transno 17179870014 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914709:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914719:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x83daffd9 (ffff8eb472775900) 00010000:00010000:2.0:1787826318.914721:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.914726:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.914770:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee0b0 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2c1 expref: 62 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914792:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee0c5 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2c1 expref: 61 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.914801:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xf:0x0].0x0 (ffff8eb47f8ff200) 00010000:00010000:2.0:1787826318.914803:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.914807:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714000, rc 0) 00000100:00100000:2.0:1787826318.914950:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+62:161476:x1874663043013120:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1759us (1987us total) trans 17179870014 rc 0/0 00000100:00100000:2.0:1787826318.914959:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1116 00000100:00100000:1.0:1787826318.918152:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.918297:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043013376 00000100:00100000:0.0:1787826318.918310:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043013376 00000100:00100000:0.0:1787826318.918779:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:0.0:1787826318.918792:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+62:161476:x1874663043013376:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826318.919173:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+63:161476:x1874663043013376:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 382us (1033us total) trans 17179870015 rc 0/0 00000100:00100000:0.0:1787826318.919182:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:1.0:1787826318.921818:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.921909:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043013632 00000100:00100000:3.0:1787826318.921921:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043013632 00000100:00100000:3.0:1787826318.921994:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1117 00000100:00100000:3.0:1787826318.922007:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+63:161476:x1874663043013632:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:3.0:1787826318.922040:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826318.922070:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee0d3 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2c8 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.922742:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.922765:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.922780:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.922798:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.922806:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.922813:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.923759:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x389:0x0], index 0: 0 00010000:00010000:2.0:1787826318.923997:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee0e8 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924013:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee0e8 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924023:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee0e8 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924071:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924079:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924087:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924095:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.924100:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924110:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924125:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693e00) 00010000:00010000:2.0:1787826318.924129:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.924135:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924141:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee0da lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.924158:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fe0ec93 reply state 000000006ae68928 transno 17179870016 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924172:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924178:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xa6a94833 (ffff8eb481693200) 00010000:00010000:2.0:1787826318.924181:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.924184:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.924304:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee0d3 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2c8 expref: 66 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924529:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee0e8 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2c8 expref: 65 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.924538:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x10:0x0].0x0 (ffff8eb47f8ff900) 00010000:00010000:2.0:1787826318.924541:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.924543:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714200, rc 0) 00000100:00100000:2.0:1787826318.924783:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+66:161476:x1874663043013632:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2775us (2978us total) trans 17179870016 rc 0/0 00000100:00100000:2.0:1787826318.924794:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1117 00000100:00100000:1.0:1787826318.928048:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.928153:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043013888 00000100:00100000:3.0:1787826318.928168:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043013888 00000100:00100000:3.0:1787826318.928448:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:3.0:1787826318.928463:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+66:161476:x1874663043013888:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:1.0:1787826318.929147:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+67:161476:x1874663043013888:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 683us (1112us total) trans 17179870017 rc 0/0 00000100:00100000:1.0:1787826318.929158:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:3.0:1787826318.932123:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.932214:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043014144 00000100:00100000:2.0:1787826318.932227:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043014144 00000100:00100000:2.0:1787826318.932302:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1118 00000100:00100000:2.0:1787826318.932314:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+67:161476:x1874663043014144:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.932387:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.932419:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0f6 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2cf expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.932567:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.932593:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.932608:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.932625:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xc977908d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.932632:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.932649:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.933113:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x389:0x0], index 1: 0 00010000:00010000:2.0:1787826318.933288:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee10b lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933299:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee10b lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933307:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee10b lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933387:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933395:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933402:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933408:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.933413:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933421:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933436:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8ffc00) 00010000:00010000:2.0:1787826318.933439:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.933444:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933450:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee0fd lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.933466:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c727037f reply state 0000000017c427f9 transno 17179870018 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933478:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933485:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xc977908d (ffff8eb47f8ff700) 00010000:00010000:2.0:1787826318.933488:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.933491:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.933530:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee0f6 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2cf expref: 70 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933552:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee10b lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2cf expref: 69 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.933560:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x11:0x0].0x0 (ffff8eb47f8ff600) 00010000:00010000:2.0:1787826318.933562:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.933565:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714c00, rc 0) 00000100:00100000:2.0:1787826318.933673:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+70:161476:x1874663043014144:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1360us (1565us total) trans 17179870018 rc 0/0 00000100:00100000:2.0:1787826318.933684:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1118 00000100:00100000:1.0:1787826318.937184:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.937259:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043014400 00000100:00100000:0.0:1787826318.937271:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043014400 00000100:00100000:0.0:1787826318.937347:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:0.0:1787826318.937358:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+70:161476:x1874663043014400:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826318.937758:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+71:161476:x1874663043014400:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 399us (586us total) trans 17179870019 rc 0/0 00000100:00100000:0.0:1787826318.937767:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:3.0:1787826318.939797:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.940060:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043014656 00000100:00100000:0.0:1787826318.940072:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043014656 00000100:00100000:0.0:1787826318.940140:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1119 00000100:00100000:0.0:1787826318.940153:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+71:161476:x1874663043014656:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826318.940186:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826318.940232:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee119 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2d6 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.940396:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.940413:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.940427:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.940447:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.940455:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.940462:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826318.941084:0:187906:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x38a:0x0], index 0: 0 00010000:00010000:0.0:1787826318.941629:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee12e lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.941922:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee12e lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.941935:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee12e lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.941986:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.941996:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942003:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942010:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942017:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826318.942024:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942033:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942048:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:0.0:1787826318.942052:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826318.942058:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942066:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee120 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826318.942086:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000511c566a reply state 000000006dda379c transno 17179870020 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942100:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942107:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xec45d8e7 (ffff8eb47f8fe600) 00010000:00010000:0.0:1787826318.942110:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826318.942113:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826318.942161:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee119 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2d6 expref: 74 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942185:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee12e lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2d6 expref: 73 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.942193:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x12:0x0].0x0 (ffff8eb47f8fee00) 00010000:00010000:0.0:1787826318.942196:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826318.942199:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19200, rc 0) 00000100:00100000:0.0:1787826318.942540:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+74:161476:x1874663043014656:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2387us (2756us total) trans 17179870020 rc 0/0 00000100:00100000:0.0:1787826318.942550:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1119 00000100:00100000:3.0:1787826318.945839:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.945947:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043014912 00000100:00100000:0.0:1787826318.945961:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043014912 00000100:00100000:0.0:1787826318.946083:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:0.0:1787826318.946097:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345734850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+74:161476:x1874663043014912:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826318.946576:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345734850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+75:161476:x1874663043014912:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 480us (751us total) trans 17179870021 rc 0/0 00000100:00100000:0.0:1787826318.946594:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:3.0:1787826318.949381:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826318.949496:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043015168 00000100:00100000:2.0:1787826318.949508:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043015168 00000100:00100000:2.0:1787826318.949572:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1120 00000100:00100000:2.0:1787826318.949593:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+75:161476:x1874663043015168:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826318.949625:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826318.949671:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee13c lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2dd expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.949809:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.949826:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.949839:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.949855:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xf142140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.949862:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.949868:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826318.950269:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x38a:0x0], index 1: 0 00010000:00010000:2.0:1787826318.950495:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cee151 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950506:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cee151 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950514:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cee151 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950555:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950563:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950570:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950577:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826318.950582:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950609:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950626:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:2.0:1787826318.950630:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826318.950637:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950643:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee143 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826318.950662:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b17b027 reply state 000000005b5306a4 transno 17179870022 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950674:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950680:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xf142140 (ffff8eb47f8ffb00) 00010000:00010000:2.0:1787826318.950683:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826318.950686:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826318.950725:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee13c lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2dd expref: 78 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950749:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cee151 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2dd expref: 77 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826318.950757:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x13:0x0].0x0 (ffff8eb47f8ffe00) 00010000:00010000:2.0:1787826318.950759:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826318.950761:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:2.0:1787826318.950844:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+78:161476:x1874663043015168:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1262us (1525us total) trans 17179870022 rc 0/0 00000100:00100000:2.0:1787826318.950853:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1120 00000100:00100000:3.0:1787826318.953866:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.954496:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043015424 00000100:00100000:1.0:1787826318.954512:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043015424 00000100:00100000:1.0:1787826318.954618:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:1.0:1787826318.954631:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+78:161476:x1874663043015424:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:1.0:1787826318.955140:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+79:161476:x1874663043015424:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 510us (1288us total) trans 17179870023 rc 0/0 00000100:00100000:1.0:1787826318.955150:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:2.0:1787826318.959458:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.959680:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043015680 00000100:00100000:3.0:1787826318.959694:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043015680 00000100:00100000:3.0:1787826318.959784:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1121 00000100:00100000:3.0:1787826318.959798:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+79:161476:x1874663043015680:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:3.0:1787826318.959832:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826318.959867:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee15f lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2e4 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.960015:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.960031:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.960045:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.960060:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.960068:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.960074:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826318.960862:0:187904:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x38b:0x0], index 0: 0 00010000:00010000:3.0:1787826318.961048:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed400/0x878a5eea00cee174 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961059:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed400/0x878a5eea00cee174 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961069:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed400/0x878a5eea00cee174 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961108:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961116:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961124:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961131:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826318.961137:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961145:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961161:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826318.961164:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826318.961170:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961181:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee166 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826318.961197:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010b67c6b reply state 000000003d6a011d transno 17179870024 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961208:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961214:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x31e2699a (ffff8eb481693300) 00010000:00010000:3.0:1787826318.961217:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826318.961221:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826318.961259:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee15f lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2e4 expref: 82 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961279:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed400/0x878a5eea00cee174 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2e4 expref: 81 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.961287:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x14:0x0].0x0 (ffff8eb481693f00) 00010000:00010000:3.0:1787826318.961289:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826318.961292:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed400, rc 0) 00000100:00100000:3.0:1787826318.961421:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+82:161476:x1874663043015680:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1626us (1980us total) trans 17179870024 rc 0/0 00000100:00100000:3.0:1787826318.961430:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1121 00000100:00100000:0.0:1787826318.964988:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.965098:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043015936 00000100:00100000:1.0:1787826318.965111:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043015936 00000100:00100000:1.0:1787826318.965221:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:1.0:1787826318.965233:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+82:161476:x1874663043015936:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:1.0:1787826318.966028:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+83:161476:x1874663043015936:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 793us (1051us total) trans 17179870025 rc 0/0 00000100:00100000:1.0:1787826318.966040:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:2.0:1787826318.969296:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826318.969715:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043016192 00000100:00100000:0.0:1787826318.969730:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043016192 00000100:00100000:0.0:1787826318.969837:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1122 00000100:00100000:0.0:1787826318.969851:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+83:161476:x1874663043016192:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826318.969885:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826318.969917:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee182 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2eb expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.970062:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.970080:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.970094:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.970112:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.970119:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.970125:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826318.970950:0:187906:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x38b:0x0], index 1: 0 00010000:00010000:0.0:1787826318.971149:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee197 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971162:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee197 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971172:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee197 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971214:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971222:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971229:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971236:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971243:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826318.971249:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971257:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971270:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:0.0:1787826318.971274:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826318.971279:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971286:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee189 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826318.971306:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ffb8c0e reply state 000000002637a1e8 transno 17179870026 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971318:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971571:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x54b0b1f4 (ffff8eb47f8fe000) 00010000:00010000:0.0:1787826318.971575:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826318.971579:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826318.971634:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee182 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2eb expref: 86 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971735:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee197 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2eb expref: 85 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826318.971744:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x15:0x0].0x0 (ffff8eb47f8fea00) 00010000:00010000:0.0:1787826318.971746:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826318.971750:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18c00, rc 0) 00000100:00100000:0.0:1787826318.971900:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+86:161476:x1874663043016192:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2052us (2618us total) trans 17179870026 rc 0/0 00000100:00100000:0.0:1787826318.971911:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1122 00000100:00100000:0.0:1787826318.975172:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826318.975250:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043016448 00000100:00100000:1.0:1787826318.975263:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043016448 00000100:00100000:1.0:1787826318.975394:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:1.0:1787826318.975408:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+86:161476:x1874663043016448:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:1.0:1787826318.976140:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+87:161476:x1874663043016448:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 730us (977us total) trans 17179870027 rc 0/0 00000100:00100000:1.0:1787826318.976151:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:0.0:1787826318.993981:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.994063:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043016704 00000100:00100000:3.0:1787826318.994076:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043016704 00000100:00100000:3.0:1787826318.994151:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1123 00000100:00100000:3.0:1787826318.994163:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+87:161484:x1874663043016704:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826318.994195:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826318.994311:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee1a5 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2f2 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826318.994611:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787826318.994818:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee1a5 lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2f2 expref: 89 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.994837:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826318.994840:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826318.994846:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee1a5 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2f2 expref: 89 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.994869:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed800, rc 0) 00000100:00100000:3.0:1787826318.995087:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+88:161484:x1874663043016704:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 925us (1119us total) trans 17179870028 rc 301/301 00000100:00100000:3.0:1787826318.995098:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1123 00000100:00100000:2.0:1787826318.997772:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826318.997893:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043016960 00000100:00100000:3.0:1787826318.997906:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043016960 00000100:00100000:3.0:1787826318.998017:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1124 00000100:00100000:3.0:1787826318.998031:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+88:161484:x1874663043016960:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826318.998062:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826318.998094:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee1b3 lrc: 2/0,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f2f9 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.998259:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee1ba lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.998279:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee1ba lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.998292:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee1ba lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826318.998304:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x3:0x0]: returning size 0 00010000:00010000:3.0:1787826318.998609:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee1b3 lrc: 0/0,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2f9 expref: 91 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.998637:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee1ba lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2f9 expref: 90 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826318.998647:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x3:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:3.0:1787826318.998650:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826318.998654:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed600, rc 0) 00000100:00100000:3.0:1787826318.998726:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+90:161484:x1874663043016960:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 698us (968us total) trans 17179870029 rc 0/0 00000100:00100000:3.0:1787826318.998735:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1124 00000100:00100000:0.0:1787826319.005238:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826319.005375:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.005457:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043017088 00000100:00100000:2.0:1787826319.005471:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043017088 00000100:00100000:2.0:1787826319.005614:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4235 00000100:00100000:2.0:1787826319.005629:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+90:2390:x1874663043017088:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826319.005651:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826319.005683:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee1ba lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2f9 expref: 90 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.005703:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x3:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:2.0:1787826319.005710:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826319.005780:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+89:2390:x1874663043017088:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 156us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.005788:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4235 00000100:00100000:3.0:1787826319.006135:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043017344 00000100:00100000:3.0:1787826319.006141:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043017344 00000100:00100000:3.0:1787826319.006190:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:3.0:1787826319.006200:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+89:161484:x1874663043017344:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1787826319.006682:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+90:161484:x1874663043017344:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 482us (1457us total) trans 17179870030 rc 0/0 00000100:00100000:2.0:1787826319.006690:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:0.0:1787826319.014042:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826319.016579:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043017600 00000100:00100000:1.0:1787826319.019979:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043017600 00000100:00100000:0.0:1787826319.020452:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:0.0:1787826319.020469:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+90:161484:x1874663043017600:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:0.0:1787826319.020835:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+91:161484:x1874663043017600:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 367us (6805us total) trans 17179870031 rc 0/0 00000100:00100000:0.0:1787826319.020844:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:0.0:1787826319.040706:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.041769:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043017856 00000100:00100000:2.0:1787826319.041787:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043017856 00000100:00100000:0.0:1787826319.042047:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1125 00000100:00100000:0.0:1787826319.042062:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:161485:x1874663043017856:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826319.042090:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826319.042117:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee1c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f300 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826319.042752:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787826319.042930:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee1c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f300 expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.042949:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:0.0:1787826319.042954:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826319.042960:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee1c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f300 expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.042978:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19000, rc 0) 00000100:00100000:0.0:1787826319.043062:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:161485:x1874663043017856:12345-192.168.203.47@tcp:101:rm.0 Request processed in 1003us (2370us total) trans 352187318276 rc 301/301 00000100:00100000:0.0:1787826319.043072:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1125 00000100:00100000:1.0:1787826319.047878:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.047953:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043017984 00000100:00100000:2.0:1787826319.047967:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043017984 00000100:00100000:2.0:1787826319.048038:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:2.0:1787826319.048050:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345737850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:161485:x1874663043017984:12345-192.168.203.47@tcp:37:rm.0 00000100:00100000:2.0:1787826319.061992:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345737850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:161485:x1874663043017984:12345-192.168.203.47@tcp:37:rm.0 Request processed in 13927us (14111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.062010:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:0.0:1787826319.082493:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.082766:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043018240 00000100:00100000:2.0:1787826319.082780:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043018240 00000100:00100000:2.0:1787826319.082849:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:2.0:1787826319.082862:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:161485:x1874663043018240:12345-192.168.203.47@tcp:35:rm.0 00000100:00100000:2.0:1787826319.083175:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:161485:x1874663043018240:12345-192.168.203.47@tcp:35:rm.0 Request processed in 314us (696us total) trans 352187318277 rc 0/0 00000100:00100000:2.0:1787826319.083184:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:1.0:1787826319.088961:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.089387:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043018496 00000100:00100000:3.0:1787826319.089401:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043018496 00000100:00100000:3.0:1787826319.089494:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1126 00000100:00100000:3.0:1787826319.089507:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:161485:x1874663043018496:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826319.089543:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826319.089569:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cee1d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f307 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.089799:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cee1dd lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.089818:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cee1dd lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.089834:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cee1dd lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826319.089848:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787826319.089980:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cee1d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f307 expref: 14 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.089999:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cee1dd lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f307 expref: 13 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.090009:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:2.0:1787826319.090013:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826319.090017:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39a00, rc 0) 00000100:00100000:2.0:1787826319.090102:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:161485:x1874663043018496:12345-192.168.203.47@tcp:101:rm.0 Request processed in 597us (1155us total) trans 352187318278 rc 0/0 00000100:00100000:2.0:1787826319.090112:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1126 00000100:00100000:1.0:1787826319.103151:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.103547:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043018624 00000100:00100000:3.0:1787826319.103562:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043018624 00000100:00100000:3.0:1787826319.103882:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1127 00000100:00100000:3.0:1787826319.103897:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+91:161485:x1874663043018624:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826319.103931:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826319.103962:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee1eb lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f30e expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.104056:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee1f2 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.104073:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee1f2 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.104085:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee1f2 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826319.104143:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787826319.104148:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826319.104194:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee1f2 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.104231:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee1eb lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f30e expref: 93 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.104256:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee1f2 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f30e expref: 92 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.104267:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.104270:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826319.104274:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724eca00, rc 0) 00000100:00100000:3.0:1787826319.104392:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+92:161485:x1874663043018624:12345-192.168.203.47@tcp:101:rm.0 Request processed in 498us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826319.104400:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1127 00000100:00100000:0.0:1787826319.111476:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.111608:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043018880 00000100:00100000:3.0:1787826319.111622:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043018880 00000100:00100000:3.0:1787826319.111699:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1128 00000100:00100000:3.0:1787826319.111710:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+92:161485:x1874663043018880:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826319.111736:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826319.111767:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee1f9 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f315 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.111901:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724edc00/0x878a5eea00cee200 lrc: 3/1,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.111917:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724edc00/0x878a5eea00cee200 lrc: 3/1,0 mode: CR/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.111930:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724edc00/0x878a5eea00cee200 lrc: 3/1,0 mode: CR/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826319.111942:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787826319.112060:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee1f9 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f315 expref: 95 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.112092:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724edc00/0x878a5eea00cee200 lrc: 3/0,0 mode: CR/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f315 expref: 94 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.112102:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.112106:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826319.112109:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724edc00, rc 0) 00000100:00100000:3.0:1787826319.112187:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+94:161485:x1874663043018880:12345-192.168.203.47@tcp:101:rm.0 Request processed in 477us (724us total) trans 17179870032 rc 0/0 00000100:00100000:3.0:1787826319.112194:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1128 00000100:00100000:1.0:1787826319.116730:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.116921:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043019008 00000100:00100000:2.0:1787826319.116935:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043019008 00000100:00100000:2.0:1787826319.117012:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:2.0:1787826319.117026:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+94:161485:x1874663043019008:12345-192.168.203.47@tcp:37:rm.0 00000100:00100000:2.0:1787826319.128177:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+94:161485:x1874663043019008:12345-192.168.203.47@tcp:37:rm.0 Request processed in 11137us (11448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.128194:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:1.0:1787826319.136793:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.137075:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043019264 00000100:00100000:2.0:1787826319.137089:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043019264 00000100:00100000:2.0:1787826319.137171:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1129 00000100:00100000:2.0:1787826319.137184:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+94:161485:x1874663043019264:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826319.137274:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787826319.137310:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cedfad lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f289 expref: 94 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137383:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x7:0x0].0x0 (ffff8eb47f8fe300) 00010000:00010000:2.0:1787826319.137407:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee1f2 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f30e expref: 93 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137418:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.137422:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826319.137451:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137466:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137477:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137491:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137500:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137519:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137661:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137669:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.137676:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826319.138313:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 64 off8320 00000004:00080000:2.0:1787826319.138391:0:188682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8385965065100ns, next at 8386964997121ns, rc = 0 00010000:00010000:2.0:1787826319.138465:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138477:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138487:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138495:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138631:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138700:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138720:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826319.138749:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138756:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138763:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138946:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.138952:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138961:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138975:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x7:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:2.0:1787826319.138979:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826319.138984:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.138991:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee21c lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139015:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139023:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139029:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139035:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.139038:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139045:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139052:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.139055:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826319.139059:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139065:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee20e lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826319.139077:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c60052d8 reply state 00000000e5387abe transno 17179870033 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139096:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.139103:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x494dcf1b (ffff8eb47f8fe200) 00010000:00010000:2.0:1787826319.139105:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826319.139109:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826319.139307:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826319.139316:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.139350:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826319.139355:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.139362:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.139372:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x7:0x0].0x0 (ffff8eb47f8fff00) 00010000:00010000:1.0:1787826319.139375:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826319.139378:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.139384:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee223 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.139404:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.139406:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.139408:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826319.140134:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+94:161485:x1874663043019264:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2944us (3359us total) trans 17179870033 rc 0/0 00000100:00100000:2.0:1787826319.140147:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1129 00000100:00100000:1.0:1787826319.147646:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.147786:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043019520 00000100:00100000:3.0:1787826319.147800:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043019520 00000100:00100000:3.0:1787826319.147887:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1130 00000100:00100000:3.0:1787826319.147900:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+94:161485:x1874663043019520:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.147979:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.148016:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00cedefe lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f266 expref: 94 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148041:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2:0x0].0x0 (ffff8eb348b07100) 00010000:00010000:3.0:1787826319.148059:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.148088:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148105:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148117:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148132:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148142:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148149:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148274:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148283:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.148290:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.149149:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 64 off8320 00000004:00080000:3.0:1787826319.149163:0:187904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8385975837677ns, next at 8386975834542ns, rc = 0 00010000:00010000:3.0:1787826319.149278:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149290:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149299:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149307:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149317:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149608:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149725:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.149754:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149761:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149777:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149784:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.149789:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149798:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149812:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2:0x0].0x0 (ffff8eb481693600) 00010000:00010000:3.0:1787826319.149815:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.149819:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149826:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec000/0x878a5eea00cee238 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149852:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149858:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149863:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149868:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.149871:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149877:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149884:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.149886:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.149889:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149894:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed800/0x878a5eea00cee22a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.149903:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022508f77 reply state 000000007a432ae1 transno 17179870034 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149915:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.149921:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x679fc7b1 (ffff8eb348b07f00) 00010000:00010000:3.0:1787826319.149924:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.149928:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.150043:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+95:161485:x1874663043019520:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2140us (2409us total) trans 17179870034 rc 0/0 00000100:00100000:3.0:1787826319.150053:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1130 00010000:00010000:0.0:1787826319.151505:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826319.151519:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.151531:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826319.151535:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.151545:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.151563:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2:0x0].0x0 (ffff8eb481693600) 00010000:00010000:0.0:1787826319.151567:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826319.151571:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.151577:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed600/0x878a5eea00cee23f lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.151914:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.151918:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.151920:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.153959:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.154049:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043019776 00000100:00100000:3.0:1787826319.154063:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043019776 00000100:00100000:3.0:1787826319.154198:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1131 00000100:00100000:3.0:1787826319.154212:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+95:161485:x1874663043019776:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.154309:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.154386:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511400/0x878a5eea00cedfd0 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f290 expref: 95 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155382:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x8:0x0].0x0 (ffff8eb472775e00) 00010000:00010000:3.0:1787826319.155416:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.155454:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155473:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155487:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155500:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155509:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155515:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155652:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155661:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.155668:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.155955:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].3, 64 off8384 00010000:00010000:3.0:1787826319.156016:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156026:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156034:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156042:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156049:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156056:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156091:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.156116:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156127:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156134:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156140:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.156146:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156154:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156166:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x8:0x0].0x0 (ffff8eb481693d00) 00010000:00010000:3.0:1787826319.156170:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.156174:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156180:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00cee254 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156199:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156206:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156211:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156216:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.156220:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156226:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156233:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.156236:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.156239:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156245:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec800/0x878a5eea00cee246 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.156255:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fd6262f reply state 000000004d8c1573 transno 17179870035 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156267:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.156273:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x76709d63 (ffff8eb472775100) 00010000:00010000:3.0:1787826319.156286:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.156290:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.156427:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+96:161485:x1874663043019776:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2214us (2477us total) trans 17179870035 rc 0/0 00000100:00100000:3.0:1787826319.156438:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1131 00010000:00010000:0.0:1787826319.156541:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826319.156550:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.156559:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ee00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826319.156563:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.156571:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.156605:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x8:0x0].0x0 (ffff8eb481693d00) 00010000:00010000:0.0:1787826319.156608:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826319.156612:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.156618:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee25b lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.156644:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.156646:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.156647:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.165857:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826319.166472:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043020032 00000100:00100000:0.0:1787826319.166488:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043020032 00000100:00100000:0.0:1787826319.166594:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1132 00000100:00100000:0.0:1787826319.166625:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+96:161485:x1874663043020032:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826319.167194:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826319.167244:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee0e8 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2c8 expref: 96 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167274:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x10:0x0].0x0 (ffff8eb47f8ff900) 00010000:00010000:0.0:1787826319.167286:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826319.167317:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167356:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167370:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167385:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167394:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167401:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167522:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167531:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.167538:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826319.171403:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].4, 64 off8448 00010000:00010000:0.0:1787826319.171501:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171523:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171536:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171547:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171554:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171560:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171593:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.171621:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826319.171628:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.171631:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171648:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171657:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.171658:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826319.171666:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171667:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.171674:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.171681:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171684:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.171711:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x10:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:3.0:1787826319.171717:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826319.171724:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x10:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:3.0:1787826319.171725:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171732:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.171737:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee277 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171738:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171755:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee270 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.171771:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.171774:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.171777:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.171785:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171794:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171800:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171806:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171812:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.171815:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171821:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171829:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:0.0:1787826319.171832:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826319.171836:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171848:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee262 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826319.171859:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000201ad590 reply state 0000000029aef2f0 transno 17179870036 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171871:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.171877:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xa6a94833 (ffff8eb481693200) 00010000:00010000:0.0:1787826319.171879:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826319.171883:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826319.171999:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+97:161485:x1874663043020032:12345-192.168.203.47@tcp:36:rm.0 Request processed in 5387us (6149us total) trans 17179870036 rc 0/0 00000100:00100000:0.0:1787826319.172010:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1132 00000100:00100000:1.0:1787826319.178369:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.178451:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043020288 00000100:00100000:3.0:1787826319.178465:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043020288 00000100:00100000:2.0:1787826319.178615:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1133 00000100:00100000:2.0:1787826319.178631:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+97:161485:x1874663043020288:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826319.178713:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826319.178752:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee016 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f29e expref: 97 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178775:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xa:0x0].0x0 (ffff8eb472775000) 00010000:00010000:2.0:1787826319.178788:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826319.178815:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178831:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178843:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178855:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178868:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178876:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178981:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178991:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.178997:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826319.179702:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].5, 64 off8512 00010000:00010000:2.0:1787826319.179784:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.179796:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.179806:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.179814:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.179821:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.179828:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180227:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826319.180320:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826319.180345:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.180354:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826319.180360:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.180370:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.180384:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xa:0x0].0x0 (ffff8eb47f8ffc00) 00010000:00010000:1.0:1787826319.180387:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826319.180393:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.180400:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee293 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.180416:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.180418:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.180420:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826319.180496:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180505:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180511:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180517:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.180522:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180528:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180537:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xa:0x0].0x0 (ffff8eb47f8ffc00) 00010000:00010000:2.0:1787826319.180540:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826319.180543:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 2/0,0 mode: --/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180549:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee28c lrc: 0/0,0 mode: --/EX res: [0x240001f59:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180573:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180580:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180600:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180605:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.180608:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180614:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180625:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.180627:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826319.180630:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180637:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee27e lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826319.180647:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc35d4a8 reply state 00000000d8efd2cc transno 17179870037 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180659:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.180665:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xd0b639f4 (ffff8eb472775800) 00010000:00010000:2.0:1787826319.180668:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826319.180671:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826319.180798:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+98:161485:x1874663043020288:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2167us (2467us total) trans 17179870037 rc 0/0 00000100:00100000:2.0:1787826319.180809:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1133 00000100:00100000:1.0:1787826319.184170:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.184262:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043020544 00000100:00100000:3.0:1787826319.184276:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043020544 00000100:00100000:3.0:1787826319.184397:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1134 00000100:00100000:3.0:1787826319.184415:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+98:161485:x1874663043020544:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.184492:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.184526:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00cedf8a lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f282 expref: 98 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184553:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x6:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:3.0:1787826319.184564:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.184601:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184619:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184628:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184648:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184656:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184663:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184767:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184777:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.184783:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.185043:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].6, 64 off8576 00010000:00010000:3.0:1787826319.185103:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185113:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185121:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185128:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185136:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185142:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185159:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.185180:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185186:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185193:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185199:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.185204:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185212:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185222:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x6:0x0].0x0 (ffff8eb481693000) 00010000:00010000:3.0:1787826319.185225:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.185228:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185236:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee2a8 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185250:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185254:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185259:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185265:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.185267:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185274:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185281:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.185283:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.185286:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185292:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee29a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.185301:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c23a3c8d reply state 0000000055478efb transno 17179870038 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185313:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.185319:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x1c2b00d3 (ffff8eb47f8feb00) 00010000:00010000:3.0:1787826319.185321:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.185351:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.185448:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+99:161485:x1874663043020544:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1037us (1289us total) trans 17179870038 rc 0/0 00000100:00100000:3.0:1787826319.185457:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1134 00010000:00010000:0.0:1787826319.185960:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826319.185968:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.185977:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fe00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826319.185981:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.185989:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.186001:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x6:0x0].0x0 (ffff8eb481693000) 00010000:00010000:0.0:1787826319.186004:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826319.186007:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.186018:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee2af lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.186035:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.186037:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.186039:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.188310:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:3.0:1787826319.188463:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.189112:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049388928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826319.189190:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826319.189521:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049388928 00000100:00100000:3.0:1787826319.189532:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049388928 00000100:00100000:3.0:1787826319.189622:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5868 00000100:00100000:3.0:1787826319.189650:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049388928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826319.189681:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826319.189745:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049388928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826319.189754:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5868 00000100:00100000:3.0:1787826319.189810:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049388928:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787826319.189993:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826319.190060:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043020800 00000100:00100000:0.0:1787826319.190067:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043020800 00000100:00100000:0.0:1787826319.190146:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1135 00000100:00100000:0.0:1787826319.190156:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+99:161485:x1874663043020800:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826319.190239:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826319.190281:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee0c5 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2c1 expref: 99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190305:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xf:0x0].0x0 (ffff8eb47f8ff200) 00010000:00010000:0.0:1787826319.190318:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826319.190531:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190548:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190559:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190572:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190580:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190599:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190714:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190723:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.190731:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826319.191074:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].3, 64 off8384 00010000:00010000:0.0:1787826319.191136:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 3/0,1 mode: --/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191148:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191156:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191164:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191172:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191179:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191213:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826319.191238:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191245:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191252:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191764:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.191770:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191778:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191792:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xf:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:0.0:1787826319.191796:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826319.191800:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191806:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2c4 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191833:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191840:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191846:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191851:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191857:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.191860:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191867:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191874:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:0.0:1787826319.191876:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826319.191879:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191886:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2b6 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826319.191896:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047b6238b reply state 000000004646bcca transno 17179870039 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191909:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.191915:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x83daffd9 (ffff8eb472775900) 00010000:00010000:0.0:1787826319.191917:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826319.191921:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826319.192052:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826319.192060:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.192067:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826319.192071:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.192077:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.192086:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xf:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:3.0:1787826319.192090:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826319.192093:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 1/0,0 mode: --/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.192099:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee2cb lrc: 0/0,0 mode: --/PW res: [0x240001f59:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.192116:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.192118:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.192120:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.193598:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+100:161485:x1874663043020800:12345-192.168.203.47@tcp:36:rm.0 Request processed in 3418us (5372us total) trans 17179870039 rc 0/0 00000100:00100000:1.0:1787826319.193613:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1135 00000100:00100000:1.0:1787826319.198163:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.198319:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043021056 00000100:00100000:2.0:1787826319.198375:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043021056 00000100:00100000:2.0:1787826319.198464:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1136 00000100:00100000:2.0:1787826319.198485:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+100:161485:x1874663043021056:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826319.198591:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826319.198634:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee10b lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2cf expref: 100 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198664:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x11:0x0].0x0 (ffff8eb47f8ff600) 00010000:00010000:2.0:1787826319.198677:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826319.198713:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198736:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198749:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198768:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xc977908d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198777:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198784:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198920:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198940:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.198947:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826319.199295:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].4, 64 off8448 00010000:00010000:2.0:1787826319.199438:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199456:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199464:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199472:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199479:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199493:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199528:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826319.199550:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199565:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199576:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199594:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.199599:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199608:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199619:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x11:0x0].0x0 (ffff8eb47f8ffc00) 00010000:00010000:2.0:1787826319.199622:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826319.199626:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199631:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00cee2e0 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199649:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199655:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199659:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199664:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.199666:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199675:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199682:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.199684:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826319.199687:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199691:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00cee2d2 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826319.199701:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000499c858a reply state 00000000e8a37ef1 transno 17179870040 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199713:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.199718:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xc977908d (ffff8eb47f8ff700) 00010000:00010000:2.0:1787826319.199720:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826319.199723:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826319.199825:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+101:161485:x1874663043021056:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1347us (1677us total) trans 17179870040 rc 0/0 00000100:00100000:2.0:1787826319.199834:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1136 00010000:00010000:3.0:1787826319.200425:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826319.200434:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.200443:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826319.200447:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.200455:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.200469:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x11:0x0].0x0 (ffff8eb47f8ffc00) 00010000:00010000:3.0:1787826319.200471:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826319.200475:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.200480:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee2e7 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.200498:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.200500:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.200502:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826319.203714:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826319.203826:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043021312 00000100:00100000:0.0:1787826319.203844:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043021312 00000100:00100000:0.0:1787826319.203920:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1137 00000100:00100000:0.0:1787826319.203932:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+101:161485:x1874663043021312:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826319.204014:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826319.204049:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec600/0x878a5eea00cee07f lrc: 0/0,0 mode: --/PR res: [0x240001f59:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2b3 expref: 101 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204073:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xd:0x0].0x0 (ffff8eb481693900) 00010000:00010000:0.0:1787826319.204086:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826319.204121:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204136:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204153:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204164:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204178:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204184:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204807:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 3/0,1 mode: --/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204828:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.204837:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826319.205154:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].5, 64 off8512 00010000:00010000:0.0:1787826319.205232:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205250:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205274:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205282:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205289:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205296:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205885:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826319.205916:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205924:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205930:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205936:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.205941:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205949:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205964:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xd:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:0.0:1787826319.205967:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826319.205971:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 2/0,0 mode: --/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.205977:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee2fc lrc: 0/0,0 mode: --/EX res: [0x240001f59:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206003:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206010:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206016:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206021:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.206023:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206029:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206037:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:0.0:1787826319.206040:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826319.206043:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206048:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee2ee lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826319.206064:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa924aeb reply state 000000001a37068b transno 17179870041 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206077:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.206085:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x3e3e6f26 (ffff8eb481693500) 00010000:00010000:0.0:1787826319.206087:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826319.206091:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826319.206243:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+102:161485:x1874663043021312:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2301us (2541us total) trans 17179870041 rc 0/0 00000100:00100000:0.0:1787826319.206260:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1137 00010000:00010000:2.0:1787826319.208382:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826319.208398:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.208412:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826319.208418:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.208433:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.208455:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xd:0x0].0x0 (ffff8eb47f8fe100) 00010000:00010000:2.0:1787826319.208458:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826319.208464:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.208471:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee303 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.208501:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826319.208503:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826319.208505:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.211981:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.212060:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043021568 00000100:00100000:2.0:1787826319.212074:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043021568 00000100:00100000:2.0:1787826319.212151:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1138 00000100:00100000:2.0:1787826319.212164:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+102:161485:x1874663043021568:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826319.212239:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826319.212274:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee039 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2a5 expref: 102 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212301:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xb:0x0].0x0 (ffff8eb472775600) 00010000:00010000:2.0:1787826319.212314:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826319.212385:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212401:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212418:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212430:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212437:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212443:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212547:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212555:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.212572:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826319.212917:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].6, 64 off8576 00010000:00010000:2.0:1787826319.212995:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 3/0,1 mode: --/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213013:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213022:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213030:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213038:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213052:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213074:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826319.213101:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213115:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213122:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213128:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.213133:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213146:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213156:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xb:0x0].0x0 (ffff8eb47f8ff600) 00010000:00010000:2.0:1787826319.213159:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826319.213163:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213168:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee318 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213193:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213200:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213206:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213211:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213216:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.213219:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213224:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213240:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.213242:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826319.213245:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213250:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee30a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826319.213266:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082410b68 reply state 000000008d904434 transno 17179870042 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213278:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.213285:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xfdd9083c (ffff8eb472775300) 00010000:00010000:2.0:1787826319.213294:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826319.213298:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826319.213458:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+103:161485:x1874663043021568:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1287us (1482us total) trans 17179870042 rc 0/0 00000100:00100000:2.0:1787826319.213468:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1138 00010000:00010000:3.0:1787826319.213805:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826319.213812:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.213817:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826319.213824:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.213828:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.213837:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xb:0x0].0x0 (ffff8eb47f8ff600) 00010000:00010000:3.0:1787826319.213838:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826319.213840:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 1/0,0 mode: --/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.213844:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee31f lrc: 0/0,0 mode: --/PW res: [0x240001f59:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.213861:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.213863:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.213864:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.216572:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826319.216679:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043021824 00000100:00100000:0.0:1787826319.216691:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043021824 00000100:00100000:0.0:1787826319.216756:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1139 00000100:00100000:0.0:1787826319.216768:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+103:161485:x1874663043021824:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826319.216840:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826319.216868:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cedf67 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f27b expref: 103 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.216885:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x5:0x0].0x0 (ffff8eb472775500) 00010000:00010000:0.0:1787826319.216893:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826319.216914:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.216925:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.216936:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.216943:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xef08328a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.216948:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.216952:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217042:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217050:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217056:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826319.217319:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].7, 64 off8640 00010000:00010000:0.0:1787826319.217409:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217420:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217428:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217435:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217443:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217449:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217468:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826319.217488:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217495:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217502:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217508:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.217513:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217521:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217530:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x5:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:0.0:1787826319.217534:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826319.217538:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217544:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19a00/0x878a5eea00cee334 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217568:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217575:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217593:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217598:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.217600:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217607:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217614:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:0.0:1787826319.217616:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826319.217619:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217625:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee326 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826319.217635:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6842b1e reply state 0000000026b60eb8 transno 17179870043 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217646:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.217652:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xef08328a (ffff8eb481693700) 00010000:00010000:0.0:1787826319.217655:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826319.217658:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826319.217741:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+104:161485:x1874663043021824:12345-192.168.203.47@tcp:36:rm.0 Request processed in 974us (1182us total) trans 17179870043 rc 0/0 00000100:00100000:0.0:1787826319.217749:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1139 00010000:00010000:3.0:1787826319.218286:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826319.218295:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.218302:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826319.218306:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.218314:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.218348:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x5:0x0].0x0 (ffff8eb47f8fe700) 00010000:00010000:3.0:1787826319.218352:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826319.218355:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.218362:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19400/0x878a5eea00cee33b lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.218386:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.218388:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.218390:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826319.221409:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.221707:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043022080 00000100:00100000:3.0:1787826319.221720:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043022080 00000100:00100000:3.0:1787826319.221798:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1140 00000100:00100000:3.0:1787826319.221812:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+104:161485:x1874663043022080:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.221889:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.221922:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee197 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2eb expref: 104 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.221948:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x15:0x0].0x0 (ffff8eb47f8fea00) 00010000:00010000:3.0:1787826319.221960:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.221987:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222001:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222011:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222027:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222035:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222042:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222149:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222158:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222165:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.222864:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].8, 64 off8704 00010000:00010000:3.0:1787826319.222931:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222944:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222954:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222963:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222969:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.222977:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223082:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.223107:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223122:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223129:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223136:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.223141:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223157:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223175:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x15:0x0].0x0 (ffff8eb481693900) 00010000:00010000:3.0:1787826319.223178:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.223182:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223188:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee350 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223242:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223254:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223260:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223266:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.223269:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223291:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223301:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.223304:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.223307:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223312:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee342 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.223366:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000552952e9 reply state 00000000496dfcd5 transno 17179870044 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223485:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.223492:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x54b0b1f4 (ffff8eb47f8fe000) 00010000:00010000:3.0:1787826319.223494:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.223504:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.223659:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+105:161485:x1874663043022080:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1829us (2250us total) trans 17179870044 rc 0/0 00000100:00100000:3.0:1787826319.223670:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1140 00000100:00100000:2.0:1787826319.227130:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.227279:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043022336 00000100:00100000:3.0:1787826319.227310:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043022336 00000100:00100000:3.0:1787826319.227619:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1141 00000100:00100000:3.0:1787826319.227641:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+105:161485:x1874663043022336:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.227724:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.227759:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed400/0x878a5eea00cee174 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2e4 expref: 105 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.227793:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x14:0x0].0x0 (ffff8eb481693f00) 00010000:00010000:3.0:1787826319.227814:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.227847:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.227868:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.227879:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.227897:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.227905:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.227911:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.228059:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.228068:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.228075:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.228923:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].7, 64 off8640 00010000:00010000:3.0:1787826319.229001:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229014:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229022:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229035:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229042:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229049:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.229141:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826319.229165:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.229189:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229216:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229222:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229235:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.229240:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229248:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229266:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x14:0x0].0x0 (ffff8eb481693000) 00010000:00010000:3.0:1787826319.229270:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.229274:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229281:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee36c lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229307:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229313:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229319:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229358:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.229363:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229383:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229391:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.229393:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.229396:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229408:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee35e lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.229419:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000415644d6 reply state 0000000023fd80a0 transno 17179870045 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229431:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.229444:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x31e2699a (ffff8eb481693300) 00010000:00010000:3.0:1787826319.229447:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.229450:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.229580:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+106:161485:x1874663043022336:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1946us (2466us total) trans 17179870045 rc 0/0 00000100:00100000:3.0:1787826319.229598:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1141 00010000:00010000:2.0:1787826319.230668:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826319.230681:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.230693:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826319.230697:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.230706:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.230723:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x14:0x0].0x0 (ffff8eb481693000) 00010000:00010000:2.0:1787826319.230726:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826319.230731:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.230737:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee373 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.230771:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826319.230773:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826319.230776:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826319.233013:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826319.233100:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043022592 00000100:00100000:0.0:1787826319.233115:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043022592 00000100:00100000:0.0:1787826319.233193:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1142 00000100:00100000:0.0:1787826319.233215:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+106:161485:x1874663043022592:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826319.233296:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826319.233368:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511800/0x878a5eea00cedf44 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f274 expref: 106 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233392:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x4:0x0].0x0 (ffff8eb472775a00) 00010000:00010000:0.0:1787826319.233404:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826319.233442:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233465:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233484:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233497:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233505:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233525:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233799:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233809:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.233817:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826319.234088:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].8, 64 off8704 00010000:00010000:0.0:1787826319.234148:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234159:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234166:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234174:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234181:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234187:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234219:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826319.234272:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234281:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234287:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234294:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.234299:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234306:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234317:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x4:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:0.0:1787826319.234320:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826319.234355:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.234363:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19000/0x878a5eea00cee388 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.234710:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826319.234720:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.234727:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826319.234731:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.234739:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.234750:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x4:0x0].0x0 (ffff8eb47f8fe800) 00010000:00010000:3.0:1787826319.234752:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826319.234755:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.234761:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18400/0x878a5eea00cee38f lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.234778:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.234780:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.234782:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.235123:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.235133:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.235139:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.235148:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.235152:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.235158:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.235167:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:0.0:1787826319.235170:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826319.235173:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.235179:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18200/0x878a5eea00cee37a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826319.235191:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087dc5f45 reply state 00000000b174b0c5 transno 17179870046 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.235287:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.235301:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fc00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826319.235304:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.235311:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.235321:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x15:0x0].0x0 (ffff8eb481693900) 00010000:00010000:0.0:1787826319.235465:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.235474:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xc1e56442 (ffff8eb472775f00) 00010000:00010000:0.0:1787826319.235477:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826319.235481:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826319.235683:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+107:161485:x1874663043022592:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2464us (2672us total) trans 17179870046 rc 0/0 00000100:00100000:0.0:1787826319.235693:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1142 00010000:00010000:1.0:1787826319.235841:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826319.235846:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.235860:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee357 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.235884:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.235885:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.235888:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826319.239606:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.239772:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043022848 00000100:00100000:3.0:1787826319.239785:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043022848 00000100:00100000:3.0:1787826319.239894:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1143 00000100:00100000:3.0:1787826319.239908:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+107:161485:x1874663043022848:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.239985:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.240021:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00cedf21 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f26d expref: 107 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240047:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x3:0x0].0x0 (ffff8eb47f8fef00) 00010000:00010000:3.0:1787826319.240061:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.240090:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240104:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240120:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240131:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240138:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240178:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240316:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240350:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.240358:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.240928:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].9, 64 off8768 00010000:00010000:3.0:1787826319.241004:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241015:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241030:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241038:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241046:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241053:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241092:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.241121:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241128:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241134:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241147:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.241153:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241160:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241177:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x3:0x0].0x0 (ffff8eb481693d00) 00010000:00010000:3.0:1787826319.241181:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.241185:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241191:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3a4 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241292:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241303:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241309:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241313:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.241316:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241358:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241367:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.241532:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.241540:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241546:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee396 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.241565:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faf75efe reply state 00000000a5678a2c transno 17179870047 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241578:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.241601:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x94c295fa (ffff8eb47f8fed00) 00010000:00010000:3.0:1787826319.241604:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.241607:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.241885:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+108:161485:x1874663043022848:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1975us (2302us total) trans 17179870047 rc 0/0 00000100:00100000:3.0:1787826319.241895:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1143 00010000:00010000:0.0:1787826319.242024:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826319.242039:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.242047:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826319.242051:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.242057:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.242075:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x3:0x0].0x0 (ffff8eb481693d00) 00010000:00010000:0.0:1787826319.242077:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826319.242081:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.242086:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee3ab lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.242113:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.242115:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.242117:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826319.246084:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.246302:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043023104 00000100:00100000:3.0:1787826319.246316:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043023104 00000100:00100000:3.0:1787826319.247042:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1144 00000100:00100000:3.0:1787826319.247057:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+108:161485:x1874663043023104:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.247164:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.247201:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee12e lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2d6 expref: 108 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247310:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x12:0x0].0x0 (ffff8eb47f8fee00) 00010000:00010000:3.0:1787826319.247359:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.247488:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247511:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247524:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247542:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247550:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247563:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247737:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247747:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.247754:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.248017:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9, 64 off8768 00010000:00010000:3.0:1787826319.248147:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248157:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248166:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248173:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248180:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248187:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248214:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.248238:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248248:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248255:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248261:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.248266:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248275:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.248603:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826319.248612:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.248618:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826319.248622:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.248628:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.248643:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x12:0x0].0x0 (ffff8eb481693f00) 00010000:00010000:2.0:1787826319.248646:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826319.248650:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.248656:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee3c7 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248669:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x12:0x0].0x0 (ffff8eb481693f00) 00010000:00010000:3.0:1787826319.248671:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826319.248678:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826319.248680:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.248680:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.248682:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.248686:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3c0 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248715:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248722:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248787:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248793:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.248798:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248805:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248814:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.248817:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.248820:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248826:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3b2 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.248837:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7d45eda reply state 0000000015badf70 transno 17179870048 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248849:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.248855:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xec45d8e7 (ffff8eb47f8fe600) 00010000:00010000:3.0:1787826319.248857:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.248861:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.249011:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+109:161485:x1874663043023104:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1953us (2948us total) trans 17179870048 rc 0/0 00000100:00100000:3.0:1787826319.249021:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1144 00000100:00100000:0.0:1787826319.251970:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.252071:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043023360 00000100:00100000:2.0:1787826319.252084:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043023360 00000100:00100000:2.0:1787826319.252173:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1145 00000100:00100000:2.0:1787826319.252185:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+109:161485:x1874663043023360:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826319.252316:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826319.252398:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cedff3 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f297 expref: 109 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252429:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x9:0x0].0x0 (ffff8eb472775200) 00010000:00010000:2.0:1787826319.252449:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826319.252482:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252496:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252513:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252526:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252541:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252548:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252697:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252713:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.252721:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826319.253014:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].10, 64 off8832 00010000:00010000:2.0:1787826319.253075:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253095:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253103:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253117:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253125:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253132:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253161:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826319.253187:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253194:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253200:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253205:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.253210:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253219:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253234:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x9:0x0].0x0 (ffff8eb47f8ffa00) 00010000:00010000:2.0:1787826319.253237:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826319.253241:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253247:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee3dc lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253266:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253271:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253277:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253282:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.253285:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253290:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253296:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.253299:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826319.253302:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.253307:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee3ce lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826319.253320:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba1eb082 reply state 00000000188f3ed8 transno 17179870049 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.253575:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826319.253597:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.253604:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826319.253608:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.253616:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.253626:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x9:0x0].0x0 (ffff8eb47f8ffa00) 00010000:00010000:3.0:1787826319.253637:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826319.253640:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.253646:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee3e3 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.253668:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.253670:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826319.253671:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826319.254044:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.254052:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xa3936bac (ffff8eb472775d00) 00010000:00010000:2.0:1787826319.254054:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826319.254057:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826319.254224:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+110:161485:x1874663043023360:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2037us (2265us total) trans 17179870049 rc 0/0 00000100:00100000:2.0:1787826319.254235:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1145 00000100:00100000:0.0:1787826319.257956:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.258057:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043023616 00000100:00100000:3.0:1787826319.258071:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043023616 00000100:00100000:3.0:1787826319.258200:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1146 00000100:00100000:3.0:1787826319.258229:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+110:161485:x1874663043023616:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.258383:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.258429:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec200/0x878a5eea00cee0a2 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2ba expref: 110 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258458:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xe:0x0].0x0 (ffff8eb481693c00) 00010000:00010000:3.0:1787826319.258470:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.258510:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258525:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258551:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258570:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258579:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258599:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258746:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258755:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.258761:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.259067:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].10, 64 off8832 00010000:00010000:3.0:1787826319.259161:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 3/0,1 mode: --/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259179:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259190:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259198:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259216:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259224:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259261:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.259292:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259305:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259312:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259318:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.259366:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259376:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259394:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xe:0x0].0x0 (ffff8eb481693f00) 00010000:00010000:3.0:1787826319.259397:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.259402:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259408:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00cee3f8 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259438:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259450:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259456:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259461:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.259464:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259471:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259484:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.259488:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.259491:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259497:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f000/0x878a5eea00cee3ea lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.259513:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aae9426c reply state 000000002c0cdb03 transno 17179870050 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259526:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.259533:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x610cb780 (ffff8eb481693100) 00010000:00010000:3.0:1787826319.259536:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.259547:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.259679:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+111:161485:x1874663043023616:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1458us (1738us total) trans 17179870050 rc 0/0 00000100:00100000:3.0:1787826319.259689:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1146 00010000:00010000:1.0:1787826319.259781:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826319.259791:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.259798:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fa00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826319.259802:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.259809:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.259819:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xe:0x0].0x0 (ffff8eb481693f00) 00010000:00010000:1.0:1787826319.259823:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826319.259826:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 1/0,0 mode: --/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.259833:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00cee3ff lrc: 0/0,0 mode: --/PW res: [0x240001f59:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.259849:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.259851:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.259853:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.264110:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.264307:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043023872 00000100:00100000:3.0:1787826319.264321:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043023872 00000100:00100000:3.0:1787826319.264689:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1147 00000100:00100000:3.0:1787826319.264704:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+111:161485:x1874663043023872:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.264783:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826319.264817:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00cee05c lrc: 0/0,0 mode: --/PR res: [0x240001f59:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2ac expref: 111 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.264841:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xc:0x0].0x0 (ffff8eb472775c00) 00010000:00010000:3.0:1787826319.264852:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.264880:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.264895:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.264905:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.264916:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.264924:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.264930:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265030:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265038:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265044:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826319.265307:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].11, 64 off8896 00010000:00010000:3.0:1787826319.265418:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 3/0,1 mode: --/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265427:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265435:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265442:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265449:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265456:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265485:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826319.265506:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265517:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265522:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265529:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.265534:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265542:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265553:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xc:0x0].0x0 (ffff8eb481693600) 00010000:00010000:3.0:1787826319.265555:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.265559:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265565:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00cee414 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265601:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265608:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265614:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265620:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.265624:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265630:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265638:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:3.0:1787826319.265640:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.265643:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265649:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00cee406 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.265659:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdee7fc4 reply state 00000000053f7755 transno 17179870051 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265671:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.265677:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x1b7026cc (ffff8eb472775b00) 00010000:00010000:3.0:1787826319.265679:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.265682:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.265793:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+112:161485:x1874663043023872:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1090us (1703us total) trans 17179870051 rc 0/0 00000100:00100000:3.0:1787826319.265802:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1147 00010000:00010000:1.0:1787826319.266670:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826319.266681:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.266689:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fc00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826319.266693:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.266701:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.266715:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0xc:0x0].0x0 (ffff8eb481693600) 00010000:00010000:1.0:1787826319.266718:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826319.266721:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 1/0,0 mode: --/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.266727:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00cee41b lrc: 0/0,0 mode: --/PW res: [0x240001f59:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.266749:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.266751:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.266754:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826319.269194:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.269744:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043024128 00000100:00100000:2.0:1787826319.269757:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043024128 00000100:00100000:2.0:1787826319.269839:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1148 00000100:00100000:2.0:1787826319.269853:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+112:161485:x1874663043024128:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826319.269941:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826319.269978:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511c00/0x878a5eea00cee151 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f2dd expref: 112 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270000:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x13:0x0].0x0 (ffff8eb47f8ffe00) 00010000:00010000:2.0:1787826319.270012:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826319.270039:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270053:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270067:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270078:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1:0x0].0xf142140 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270085:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270091:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270252:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270261:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270274:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826319.270890:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].11, 64 off8896 00010000:00010000:2.0:1787826319.270964:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270976:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270985:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.270993:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271001:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271008:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271086:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826319.271111:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271118:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271124:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271130:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.271135:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271143:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271155:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x13:0x0].0x0 (ffff8eb47f8ff500) 00010000:00010000:2.0:1787826319.271158:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826319.271162:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271168:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00cee430 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271196:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271201:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271206:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271210:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826319.271213:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271218:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271224:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.271227:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826319.271229:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271235:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00cee422 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826319.271243:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000677542af reply state 00000000ae297ab4 transno 17179870052 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271255:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.271261:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xf142140 (ffff8eb47f8ffb00) 00010000:00010000:2.0:1787826319.271265:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826319.271269:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826319.271422:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+113:161485:x1874663043024128:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1567us (2239us total) trans 17179870052 rc 0/0 00000100:00100000:2.0:1787826319.271432:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1148 00000100:00100000:2.0:1787826319.274240:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826319.274398:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043024256 00000100:00100000:3.0:1787826319.274411:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043024256 00000100:00100000:3.0:1787826319.274491:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1149 00000100:00100000:3.0:1787826319.274505:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:161485:x1874663043024256:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826319.274539:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826319.274569:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee43e lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f31c expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274705:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274723:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274736:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274755:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274762:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274769:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274842:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee453 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274850:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee453 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274857:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee453 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.274886:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee453 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274907:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274914:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274921:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274927:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.274933:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274941:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274955:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:3.0:1787826319.274958:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.274964:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274971:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8ee00/0x878a5eea00cee445 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.274996:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275003:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275009:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275015:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.275018:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275025:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275033:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0xf7117594 (ffff8eb481693e00) 00010000:00010000:3.0:1787826319.275036:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.275039:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275046:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65000/0x878a5eea00cee44c lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275083:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8fe00/0x878a5eea00cee43e lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f31c expref: 15 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275099:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee453 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f31c expref: 14 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.275108:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:3.0:1787826319.275111:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826319.275114:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511800, rc 0) 00000100:00100000:3.0:1787826319.275200:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+14:161485:x1874663043024256:12345-192.168.203.47@tcp:101:rm.0 Request processed in 697us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826319.275576:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1149 00010000:00010000:0.0:1787826319.278476:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826319.278496:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.278510:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826319.278516:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.278527:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.278552:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x13:0x0].0x0 (ffff8eb47f8ff500) 00010000:00010000:0.0:1787826319.278556:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826319.278562:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.278569:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00cee437 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.278609:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.278612:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.278614:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826319.280075:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826319.280173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.280358:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043024512 00000100:00100000:2.0:1787826319.280410:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043024512 00000100:00100000:2.0:1787826319.280503:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4236 00000100:00100000:2.0:1787826319.280517:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+14:2389:x1874663043024512:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826319.280546:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826319.280578:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee453 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f31c expref: 14 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.280612:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:2.0:1787826319.280618:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826319.280729:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:2389:x1874663043024512:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 209us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.280738:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4236 00000100:00100000:3.0:1787826319.282896:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043024384 00000100:00100000:3.0:1787826319.282915:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043024384 00000100:00100000:2.0:1787826319.283150:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1150 00000100:00100000:2.0:1787826319.283164:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+113:161485:x1874663043024384:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:2.0:1787826319.283201:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826319.283241:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee45a lrc: 2/0,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f323 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.283382:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee461 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.283405:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee461 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.283419:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee461 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826319.283479:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787826319.283484:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787826319.283527:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00cee45a lrc: 0/0,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f323 expref: 115 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.283549:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee461 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f323 expref: 114 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.283560:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.283563:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787826319.283569:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715000, rc 0) 00000100:00100000:2.0:1787826319.284009:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+114:161485:x1874663043024384:12345-192.168.203.47@tcp:101:rm.0 Request processed in 844us (3944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.284017:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1150 00000100:00100000:0.0:1787826319.288596:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826319.288665:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.288745:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043024640 00000100:00100000:2.0:1787826319.288771:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043024640 00000100:00100000:2.0:1787826319.288858:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4237 00000100:00100000:2.0:1787826319.288871:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:2392:x1874663043024640:12345-192.168.203.47@tcp:103:rm.0 00010000:00010000:2.0:1787826319.288892:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826319.288928:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cedec6 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f258 expref: 13 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.288961:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fe900) 00010000:00010000:2.0:1787826319.288975:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826319.289063:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:2392:x1874663043024640:12345-192.168.203.47@tcp:103:rm.0 Request processed in 194us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.289071:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4237 00000100:00100000:1.0:1787826319.289238:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043024896 00000100:00100000:1.0:1787826319.289243:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043024896 00000100:00100000:1.0:1787826319.289301:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:1.0:1787826319.289309:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+114:161485:x1874663043024896:12345-192.168.203.47@tcp:35:rm.0 00000100:00100000:1.0:1787826319.290062:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+115:161485:x1874663043024896:12345-192.168.203.47@tcp:35:rm.0 Request processed in 750us (1490us total) trans 17179870053 rc 0/0 00000100:00100000:1.0:1787826319.290072:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:1.0:1787826319.303458:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.303608:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043025152 00000100:00100000:2.0:1787826319.303620:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043025152 00000100:00100000:2.0:1787826319.303689:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1151 00000100:00100000:2.0:1787826319.303702:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+115:161485:x1874663043025152:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826319.303782:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787826319.303816:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00cee461 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f323 expref: 115 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.303841:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724edc00/0x878a5eea00cee200 lrc: 0/0,0 mode: --/CR res: [0x240001f59:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f315 expref: 114 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.303853:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb481693800) 00010000:00010000:2.0:1787826319.303864:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826319.303929:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.303938:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.303949:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826319.303978:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389056:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1787826319.304036:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826319.304077:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6b1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826319.305435:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049389056 00000100:00100000:3.0:1787826319.305453:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049389056 00000100:00100000:3.0:1787826319.305528:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12788 00000100:00100000:3.0:1787826319.305540:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:187905:x1874663049389056:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787826319.305559:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826319.305596:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee468 expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.305631:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.305642:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 4/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee468 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.305687:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.305704:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 11 pid: 187906 timeout: 8486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826319.305718:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:177390:1874663049389184:192.168.203.47@tcp:104: 00000100:00100000:3.0:1787826319.305843:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441377300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826319.313393:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.313811:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:177390:1874663049389184:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826319.313863:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee468 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.313879:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:2.0:1787826319.313882:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826319.313887:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee468 expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.313899:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511200, rc 0) 00000100:00100000:2.0:1787826319.313988:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187905:x1874663049389056:12345-0@lo:101:mdt00_001.0 Request processed in 8450us (9949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.313998:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12788 00000100:00100000:3.0:1787826319.314311:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389056:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787826319.314368:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.314396:0:187905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826319.314494:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043025280 00000100:00100000:0.0:1787826319.314503:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043025280 00010000:00010000:0.0:1787826319.314545:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 12 pid: 187906 timeout: 8486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826319.314593:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12231 00000100:00100000:0.0:1787826319.314604:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:2391:x1874663043025280:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826319.314626:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826319.314634:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 12 pid: 187906 timeout: 8486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.314647:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 12 pid: 187906 timeout: 8486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.314679:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cedeaa lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f251 expref: 12 pid: 187906 timeout: 8486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.314697:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:0.0:1787826319.314703:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee468 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.314714:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cee468 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.314724:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cee468 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.314777:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee468 expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826319.314793:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10369:1874663049389312:0@lo:105: 00000100:00100000:0.0:1787826319.314844:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.314892:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f7fdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826319.315001:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049389312 00000100:00100000:1.0:1787826319.315007:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049389312 00000100:00100000:1.0:1787826319.315051:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4775 00000100:00100000:1.0:1787826319.315059:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10369:x1874663049389312:12345-0@lo:105: 00010000:00010000:1.0:1787826319.315072:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.315081:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.315091:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.315098:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 5/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.315105:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.315121:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.315150:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb481714200) 00000100:00100000:1.0:1787826319.315199:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10369:x1874663049389312:12345-0@lo:105: Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826319.315217:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4775 00000100:00100000:1.0:1787826319.315252:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10369:1874663049389312:0@lo:105: 00010000:00010000:1.0:1787826319.315266:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826319.315315:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2391:x1874663043025280:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 712us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826319.315353:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12231 00010000:00010000:0.0:1787826319.316080:0:187905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.316094:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826319.316125:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x2:0x0] 00010000:00010000:0.0:1787826319.316179:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.316187:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.316199:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826319.316231:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389440:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787826319.316281:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.316315:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f7fd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826319.316488:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049389440 00000100:00100000:1.0:1787826319.316496:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049389440 00000100:00100000:1.0:1787826319.316552:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12789 00000100:00100000:1.0:1787826319.316562:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187905:x1874663049389440:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787826319.316593:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826319.316615:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee47d lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee476 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.316642:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee47d lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee476 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.316657:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee47d lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee476 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.316672:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0xf7117594 (ffff8eb348b07600) 00010000:00010000:1.0:1787826319.316676:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826319.316680:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356c00, rc 0) 00000100:00100000:1.0:1787826319.316720:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187905:x1874663049389440:12345-0@lo:101:mdt00_001.0 Request processed in 160us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826319.316727:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12789 00000100:00100000:0.0:1787826319.317554:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389440:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787826319.317579:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee47d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.317601:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee47d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826319.317622:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x2:0x0] 00000100:00100000:0.0:1787826319.317680:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389568:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826319.317732:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.317865:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f7fdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826319.317922:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049389568 00000100:00100000:2.0:1787826319.317929:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049389568 00000100:00100000:2.0:1787826319.317982:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12790 00000100:00100000:2.0:1787826319.317991:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187905:x1874663049389568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826319.318083:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187905:x1874663049389568:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.318090:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12790 00000100:00100000:0.0:1787826319.318288:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389568:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826319.318838:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389696:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826319.318879:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.318910:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f7fd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826319.318982:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049389696 00000100:00100000:1.0:1787826319.318989:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049389696 00000100:00100000:1.0:1787826319.319032:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12791 00000100:00100000:1.0:1787826319.319049:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187905:x1874663049389696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826319.319166:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187905:x1874663049389696:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (285us total) trans 0 rc 1/1 00000100:00100000:1.0:1787826319.319173:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12791 00000100:00100000:2.0:1787826319.319489:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389696:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787826319.319875:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.319892:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.319903:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826319.319919:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389824:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787826319.319956:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.319981:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f7fd600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826319.320305:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049389824 00000100:00100000:2.0:1787826319.320312:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049389824 00000100:00100000:2.0:1787826319.320635:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12792 00000100:00100000:2.0:1787826319.320648:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187905:x1874663049389824:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826319.320664:0:177386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826319.320688:0:177386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee48b lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee484 expref: -99 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.320719:0:177386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee48b lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee484 expref: 10 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.320735:0:177386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee48b lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee484 expref: 10 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826319.320743:0:177386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8ffd00) 00010000:00010000:2.0:1787826319.320746:0:177386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826319.320751:0:177386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715000, rc 0) 00000100:00100000:2.0:1787826319.321715:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:187905:x1874663049389824:12345-0@lo:101:mdt00_001.0 Request processed in 1061us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826319.321727:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12792 00000100:00100000:0.0:1787826319.322034:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389824:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787826319.322061:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 4/0,1 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.322077:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 4/0,1 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.322128:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.322368:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.323062:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826319.323857:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f5a:0x1:0x0].2, 424 off34288 00000100:00100000:0.0:1787826319.323988:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389952:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826319.324071:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.324185:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826319.325579:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049389952 00000100:00100000:1.0:1787826319.325602:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049389952 00000100:00100000:1.0:1787826319.325678:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12793 00000100:00100000:1.0:1787826319.325691:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:187905:x1874663049389952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826319.325970:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:187905:x1874663049389952:12345-0@lo:1000:mdt00_001.0 Request processed in 281us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826319.325979:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12793 00000100:00100000:0.0:1787826319.326072:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049389952:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1787826319.326129:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027cd2:0x1:0x0].2, 504 off34512 00000004:00080000:0.0:1787826319.326154:0:187905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb44f7fd600 with version 8 00000004:00080000:3.0:1787826319.326213:0:187966:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb348d2e6c0 version 8 rpc_version 8 00000020:00100000:3.0:1787826319.326245:0:187966:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826319.326253:0:187966:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb477dd5500 x1874663049390208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826319.326277:0:187966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049390208:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787826319.326350:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826319.326426:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb441377000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826319.326898:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049390208 00000100:00100000:2.0:1787826319.326905:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049390208 00000100:00100000:2.0:1787826319.326951:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12794 00000100:00100000:2.0:1787826319.326961:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:187966:x1874663049390208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787826319.328883:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:187966:x1874663049390208:12345-0@lo:1000:osp_up0-1.0 Request processed in 1913us (2549us total) trans 352187318279 rc 0/0 00000100:00100000:3.0:1787826319.328899:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12794 00000004:00200000:0.0:1787826319.329316:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787826319.329369:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329381:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329389:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329395:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.329400:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329410:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329428:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8fec00) 00010000:00010000:0.0:1787826319.329432:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826319.329436:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329443:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19200/0x878a5eea00cee492 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329468:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 4/0,1 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329482:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 4/0,1 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329488:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329512:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826319.329528:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x2:0x0] 00010000:00010000:0.0:1787826319.329538:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826319.329544:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329551:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19000 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826319.329555:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826319.329564:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329613:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329621:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826319.329647:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 1/0,0 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329654:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19000/0x878a5eea00cee484 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee48b expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329674:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.329676:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826319.329678:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826319.329687:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826319.329705:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049390336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826319.329767:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826319.329808:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329817:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329824:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329834:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826319.329838:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x2:0x0] 00010000:00010000:0.0:1787826319.329843:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee47d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.329850:0:187905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee47d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826319.329926:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+114:161485:x1874663043025152:12345-192.168.203.47@tcp:36:rm.0 Request processed in 26224us (26480us total) trans 17179870054 rc 0/0 00000100:00100000:0.0:1787826319.329935:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1151 00010000:00010000:1.0:1787826319.330899:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826319.330912:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.330922:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826319.330930:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826319.330939:0:6478:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.330976:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.330983:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826319.331012:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 1/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.331020:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714200/0x878a5eea00cee468 lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee46f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.331043:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.331045:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826319.331046:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826319.331055:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826319.331072:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049390464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826319.331130:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826319.331190:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049390336 00000100:00100000:1.0:1787826319.331198:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049390336 00000100:00100000:1.0:1787826319.331259:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049390464 00000100:00100000:1.0:1787826319.331262:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049390464 00000100:00100000:1.0:1787826319.331288:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4238 00000100:00100000:1.0:1787826319.331297:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3619:x1874663049390336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826319.331312:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826319.331373:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee48b lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee484 expref: 12 pid: 177386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.331389:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x0 (ffff8eb47f8ffd00) 00010000:00010000:1.0:1787826319.331398:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826319.331436:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3619:x1874663049390336:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826319.331442:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4238 00000100:00100000:1.0:1787826319.331462:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4239 00000100:00100000:1.0:1787826319.331469:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb450a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3618:x1874663049390464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826319.331477:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826319.331490:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee46f lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee468 expref: 10 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826319.331501:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:1.0:1787826319.331505:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826319.331531:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb450a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3618:x1874663049390464:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826319.331537:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4239 00000100:00100000:1.0:1787826319.331627:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049390336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826319.331659:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049390464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826319.332203:0:187966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049390208:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787826319.338910:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826319.339087:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043025408 00000100:00100000:0.0:1787826319.339102:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043025408 00000100:00100000:0.0:1787826319.339194:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1152 00000100:00100000:0.0:1787826319.339217:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:161485:x1874663043025408:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826319.339244:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826319.339273:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cee499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f32a expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339398:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339415:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339428:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339445:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339453:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339459:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339576:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cee4ae lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339595:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cee4ae lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339602:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cee4ae lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826319.339654:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1787826319.339659:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826319.339682:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cee4ae lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339695:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339702:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339721:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339728:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.339733:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339742:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339766:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:0.0:1787826319.339769:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826319.339775:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339781:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18e00/0x878a5eea00cee4a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339798:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339809:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339814:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339819:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826319.339823:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339828:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339835:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8eb47f8fe500) 00010000:00010000:0.0:1787826319.339838:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826319.339841:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339846:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18c00/0x878a5eea00cee4a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339882:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18400/0x878a5eea00cee499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f32a expref: 13 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339896:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cee4ae lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f32a expref: 12 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826319.339903:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:0.0:1787826319.339905:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826319.339908:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19400, rc 0) 00000100:00100000:0.0:1787826319.339988:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:161485:x1874663043025408:12345-192.168.203.47@tcp:101:rm.0 Request processed in 783us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826319.339997:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1152 00000100:00100000:0.0:1787826319.345823:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.346263:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043025664 00000100:00100000:2.0:1787826319.346287:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043025664 00000100:00100000:2.0:1787826319.346391:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:2.0:1787826319.346405:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:161485:x1874663043025664:12345-192.168.203.47@tcp:35:rm.0 00000100:00100000:0.0:1787826319.351733:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:161485:x1874663043025664:12345-192.168.203.47@tcp:35:rm.0 Request processed in 5313us (5907us total) trans 352187318280 rc 0/0 00000100:00100000:0.0:1787826319.351762:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:1.0:1787826319.360840:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826319.361007:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043025920 00000100:00100000:2.0:1787826319.361021:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043025920 00000100:00100000:2.0:1787826319.361168:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1153 00000100:00100000:2.0:1787826319.361186:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:161485:x1874663043025920:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826319.361727:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787826319.361776:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19400/0x878a5eea00cee4ae lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f32a expref: 13 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.361809:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00cee1dd lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f307 expref: 12 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.361824:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb472775700) 00010000:00010000:3.0:1787826319.361845:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb480d65400/0x878a5eea00cede80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f24a expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.361855:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826319.361860:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826319.361886:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.361902:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.361911:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.361924:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.361930:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.361937:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.362124:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.362133:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.362141:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826319.362939:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787826319.362962:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.362971:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.362980:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.362987:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.362992:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364232:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364266:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0x0 (ffff8eb481693c00) 00010000:00010000:3.0:1787826319.364269:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826319.364277:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364285:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee4c3 lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364882:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364894:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364901:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364908:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826319.364912:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364973:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.364987:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826319.364990:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826319.364994:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.365047:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee4b5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826319.365115:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2076608 reply state 00000000e587adde transno 352187318281 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.365129:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826319.365136:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8eb481693e00) 00010000:00010000:3.0:1787826319.365139:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826319.365143:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826319.365370:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:161485:x1874663043025920:12345-192.168.203.47@tcp:36:rm.0 Request processed in 4181us (4542us total) trans 352187318281 rc 0/0 00000100:00100000:3.0:1787826319.365380:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1153 00010000:00010000:0.0:1787826320.214995:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826320.216165:0:187971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8387042837863ns, next at 8388042833933ns, rc = 0 00000100:00100000:0.0:1787826320.216205:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826320.216231:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049390592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826320.216353:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826320.216413:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049390592 00000100:00100000:0.0:1787826320.216423:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049390592 00000100:00100000:0.0:1787826320.216500:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5869 00000100:00100000:0.0:1787826320.216514:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049390592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826320.216555:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826320.216619:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049390592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826320.216627:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5869 00000100:00080000:0.0:1787826320.216653:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826320.216700:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049390592:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826321.237292:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826321.748922:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049390720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826321.749047:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826321.749108:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826321.749115:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049390848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826321.749149:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826321.749212:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049390720 00000100:00100000:1.0:1787826321.749222:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049390720 00000100:00100000:1.0:1787826321.749298:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5870 00000100:00100000:1.0:1787826321.749308:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049390720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826321.749362:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826321.749418:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049390720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.749427:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5870 00000100:00100000:1.0:1787826321.749488:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049390720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826321.749851:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049390848 00000100:00100000:0.0:1787826321.749856:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049390848 00000100:00100000:0.0:1787826321.749894:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12795 00000100:00100000:0.0:1787826321.749903:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049390848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826321.749947:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445593088 avail 1299353600 00000100:00100000:0.0:1787826321.749997:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049390848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826321.750002:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12795 00000100:00080000:0.0:1787826321.750037:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826321.750052:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049390976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826321.750085:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826321.750125:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049390976 00000100:00100000:0.0:1787826321.750129:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049390976 00000100:00100000:0.0:1787826321.750163:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5871 00000100:00100000:0.0:1787826321.750170:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049390976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826321.750202:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826321.750236:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049390976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826321.750242:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5871 00000100:00080000:0.0:1787826321.750260:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826321.750284:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049390976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826321.750679:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049391360:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.750722:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826321.750744:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049391872:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.750768:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826321.750786:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787826321.750792:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049391232:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.750814:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826321.750830:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049391744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.750850:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826321.750863:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049392256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.750882:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826321.750909:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049391360 00000100:00100000:3.0:1787826321.750914:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049391360 00000100:00100000:3.0:1787826321.750948:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049391872 00000100:00100000:3.0:1787826321.750951:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049391872 00000100:00100000:3.0:1787826321.750964:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049391232 00000100:00100000:3.0:1787826321.750967:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049391232 00000100:00100000:3.0:1787826321.750984:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049391744 00000100:00100000:3.0:1787826321.750987:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049391744 00000100:00100000:3.0:1787826321.750997:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049392256 00000100:00100000:3.0:1787826321.751000:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049392256 00000100:00100000:3.0:1787826321.751026:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787826321.751035:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049391360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751079:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049391360:12345-0@lo:400:kworker.0 Request processed in 46us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826321.751086:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787826321.751101:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787826321.751108:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049391872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751134:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049391872:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826321.751140:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787826321.751151:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787826321.751157:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049391232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751194:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049391232:12345-0@lo:400:kworker.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826321.751200:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787826321.751211:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787826321.751218:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049391744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751244:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049391744:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826321.751250:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787826321.751261:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787826321.751267:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049392256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751292:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049392256:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826321.751298:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787826321.751373:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049391232:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751385:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049391744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751394:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049392256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751404:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049391360:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.751413:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049391872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826321.751755:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049390848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826321.752081:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049391104:0@lo:400:kworker.0 00000100:00100000:0.0:1787826321.752138:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826321.752314:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049391104 00000100:00100000:2.0:1787826321.752322:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049391104 00000100:00100000:2.0:1787826321.752392:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826321.752404:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049391104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826321.752456:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049391104:12345-0@lo:400:kworker.0 Request processed in 54us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826321.752463:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787826321.752513:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049391488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826321.752557:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826321.752608:0:179222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049391488 00000100:00100000:2.0:1787826321.752613:0:179222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049391488 00000100:00100000:2.0:1787826321.752653:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7119 00000100:00100000:2.0:1787826321.752660:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049391488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826321.752699:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049391488:12345-0@lo:400:kworker.0 Request processed in 40us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826321.752707:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7119 00000100:00080000:2.0:1787826321.752739:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826321.752745:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826321.752748:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826321.752885:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049392384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826321.752920:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826321.753031:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049391104:0@lo:400:kworker.0 00000100:00100000:0.0:1787826321.753040:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049391616:0@lo:400:kworker.0 00000100:00100000:0.0:1787826321.753066:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826321.753091:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049391616 00000100:00100000:0.0:1787826321.753094:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049391616 00000100:00100000:0.0:1787826321.753122:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7120 00000100:00100000:0.0:1787826321.753128:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049391616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826321.753160:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049391616:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826321.753166:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7120 00000100:00100000:3.0:1787826321.753445:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049391488:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.753453:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049392000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.753484:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826321.753639:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049392384 00000100:00100000:1.0:1787826321.753644:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049392384 00000100:00100000:1.0:1787826321.753679:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12796 00000100:00100000:1.0:1787826321.753686:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049392384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826321.753718:0:177386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445998592 avail 1299759104 00000100:00100000:1.0:1787826321.753759:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049392384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.753765:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12796 00000100:00100000:3.0:1787826321.754091:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049392000 00000100:00100000:3.0:1787826321.754096:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049392000 00000100:00100000:3.0:1787826321.754152:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787826321.754160:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049392000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826321.754296:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049392384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826321.754368:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049391616:0@lo:400:kworker.0 00000100:00100000:0.0:1787826321.754377:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049392128:0@lo:400:kworker.0 00000100:00100000:0.0:1787826321.754409:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826321.754452:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049392128 00000100:00100000:0.0:1787826321.754456:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049392128 00000100:00100000:0.0:1787826321.754482:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12797 00000100:00100000:0.0:1787826321.754488:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049392128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826321.754524:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049392128:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826321.754773:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12797 00000100:00100000:0.0:1787826321.754809:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049392128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826321.754922:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049392000:12345-0@lo:400:kworker.0 Request processed in 761us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826321.754930:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:2.0:1787826321.755159:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826321.755279:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049392000:0@lo:400:kworker.0 00010000:00010000:0.0:1787826322.265124:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787826322.268882:0:187942:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00010000:00010000:2.0:1787826322.268956:0:187942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cee47d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826322.268979:0:187942:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cee47d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.269040:0:187942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee47d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.269048:0:187942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826322.269074:0:187942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab19a00/0x878a5eea00cee476 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee47d expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826322.269096:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179870054 is committed 00000004:00080000:2.0:1787826322.269157:0:187942:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000004:00080000:2.0:1787826322.269167:0:187942:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000020:00080000:2.0:1787826322.269263:0:187942:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 12884910964 batchid updated 00000100:00100000:2.0:1787826322.269303:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049392512:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1787826322.269417:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787826322.269588:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910964 00000004:00080000:2.0:1787826322.269668:0:187983:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb450ceec00 with version 9 00000020:00080000:2.0:1787826322.269680:0:187983:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 12884910964 cancel update log [0x200027cd2:0x1:0x0].1: rc = 0 00000020:00080000:2.0:1787826322.269787:0:187983:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 12884910964 cancel update log [0x240001f5a:0x1:0x0].1: rc = 0 00000020:00080000:2.0:1787826322.269798:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910964 00000100:00100000:2.0:1787826322.269816:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049392512 00000100:00100000:2.0:1787826322.269825:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049392512 00000100:00100000:2.0:1787826322.269889:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4240 00000100:00100000:2.0:1787826322.269899:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3617:x1874663049392512:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787826322.269916:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826322.269943:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee47d lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee476 expref: 9 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.269962:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x2:0x0].0xf7117594 (ffff8eb348b07600) 00010000:00010000:2.0:1787826322.269978:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826322.270021:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3617:x1874663049392512:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 123us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826322.270029:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4240 00000004:00080000:2.0:1787826322.270052:0:187966:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb348d2e6c0 version 9 rpc_version 9 00000020:00100000:2.0:1787826322.270075:0:187966:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826322.270084:0:187966:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472584e00 x1874663049392768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826322.270103:0:187966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049392768:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826322.270138:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.270160:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450cee9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826322.270180:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049392768 00000100:00100000:2.0:1787826322.270184:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049392768 00000100:00100000:2.0:1787826322.270216:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12798 00000100:00100000:2.0:1787826322.270223:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187966:x1874663049392768:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826322.270383:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187966:x1874663049392768:12345-0@lo:1000:osp_up0-1.0 Request processed in 160us (244us total) trans 352187318282 rc 0/0 00000100:00100000:2.0:1787826322.270391:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12798 00000100:00100000:2.0:1787826322.270441:0:187966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049392768:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826322.270462:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049392512:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1787826322.270731:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049393024:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826322.270765:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.270783:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049393536:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826322.270800:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.270819:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787826322.270824:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049393152:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826322.270840:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.270853:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049393664:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826322.270868:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.270892:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049393024 00000100:00100000:1.0:1787826322.270895:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049393024 00000100:00100000:1.0:1787826322.270931:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049393536 00000100:00100000:1.0:1787826322.270933:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049393536 00000100:00100000:1.0:1787826322.270947:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049393152 00000100:00100000:1.0:1787826322.270949:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049393152 00000100:00100000:1.0:1787826322.270961:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049393664 00000100:00100000:1.0:1787826322.270964:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049393664 00000100:00100000:1.0:1787826322.270980:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22611 00000100:00100000:1.0:1787826322.270987:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049393024:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826322.271012:0:43905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:904 count 1 00002000:00010000:1.0:1787826322.271052:0:43905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x388:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826322.271061:0:43905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271079:0:43905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x388:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:1.0:1787826322.271084:0:43905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826322.271091:0:43905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271109:0:43905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271119:0:43905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271133:0:43905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271153:0:43905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826322.271295:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049393024:12345-0@lo:6:osp-syn-1-1.0 Request processed in 308us (528us total) trans 4294975538 rc 0/0 00000100:00100000:1.0:1787826322.271303:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22611 00000100:00100000:1.0:1787826322.271350:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22612 00000100:00100000:1.0:1787826322.271357:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049393536:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826322.271369:0:43905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:899 count 1 00002000:00010000:1.0:1787826322.271383:0:43905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x383:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826322.271388:0:43905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271397:0:43905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x383:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:1.0:1787826322.271400:0:43905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x383:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826322.271405:0:43905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271414:0:43905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271422:0:43905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271436:0:43905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271462:0:43905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787826322.271518:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049393536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 161us (716us total) trans 4294975539 rc 0/0 00000100:00100000:1.0:1787826322.271524:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22612 00000100:00100000:1.0:1787826322.271536:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22613 00000100:00100000:1.0:1787826322.271541:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049393152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826322.271551:0:43905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:905 count 1 00002000:00010000:1.0:1787826322.271576:0:43905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x389:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826322.271582:0:43905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271590:0:43905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x389:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:1.0:1787826322.271593:0:43905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x389:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826322.271597:0:43905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271606:0:43905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271613:0:43905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271627:0:43905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271640:0:43905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1787826322.271703:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049393152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 161us (861us total) trans 4294975540 rc 0/0 00000100:00100000:1.0:1787826322.271709:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22613 00000100:00100000:1.0:1787826322.271721:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22614 00000100:00100000:1.0:1787826322.271727:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049393664:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826322.271738:0:43905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:907 count 1 00002000:00010000:1.0:1787826322.271753:0:43905:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x38b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826322.271758:0:43905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271766:0:43905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38b:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:1.0:1787826322.271769:0:43905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826322.271773:0:43905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271783:0:43905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271790:0:43905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271802:0:43905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271817:0:43905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1787826322.271876:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049393664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 149us (1007us total) trans 4294975541 rc 0/0 00000100:00100000:1.0:1787826322.271883:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22614 00010000:00010000:1.0:1787826322.271916:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787826322.271923:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271932:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826322.271937:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271947:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271967:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.271975:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b689094a/0x878a5eea00cee4ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272001:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826322.272005:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272012:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826322.272015:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272023:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272033:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272041:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e11888/0x878a5eea00cee4d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272055:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826322.272058:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272064:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826322.272067:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272075:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272088:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272095:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a24bae27/0x878a5eea00cee4d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272106:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826322.272109:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272117:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826322.272120:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272128:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272137:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272145:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cee4df lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272160:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826322.272162:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826322.272164:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826322.272202:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479b42a00/2, rc 0, transno 4294975540 00000100:00100000:1.0:1787826322.272218:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049393152:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1787826322.272229:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479b40a80/2, rc 0, transno 4294975541 00000100:00100000:1.0:1787826322.272233:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049393664:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1787826322.272242:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb47a425500/2, rc 0, transno 4294975538 00000100:00100000:1.0:1787826322.272245:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049393024:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1787826322.272252:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479b40700/2, rc 0, transno 4294975539 00000100:00100000:1.0:1787826322.272255:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049393536:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826322.272352:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049394048:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826322.272392:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.272416:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826322.272422:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049394176:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826322.272443:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826322.272471:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049394048 00000100:00100000:1.0:1787826322.272477:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049394048 00000100:00100000:1.0:1787826322.272515:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049394176 00000100:00100000:1.0:1787826322.272518:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049394176 00000100:00100000:1.0:1787826322.272536:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22615 00000100:00100000:1.0:1787826322.272544:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+10:3619:x1874663049394048:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826322.272559:0:151857:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:901 count 1 00002000:00010000:1.0:1787826322.272594:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826322.272601:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272612:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x385:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:1.0:1787826322.272616:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x385:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826322.272622:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272631:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272640:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272648:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272661:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826322.272753:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+11:3619:x1874663049394048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 209us (360us total) trans 4294975542 rc 0/0 00000100:00100000:1.0:1787826322.272760:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22615 00000100:00100000:1.0:1787826322.272775:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22616 00000100:00100000:1.0:1787826322.272781:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+10:3619:x1874663049394176:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826322.272792:0:151857:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:906 count 1 00002000:00010000:1.0:1787826322.272807:0:151857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x38a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826322.272812:0:151857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272819:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38a:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:1.0:1787826322.272823:0:151857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826322.272827:0:151857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272837:0:151857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272844:0:151857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272852:0:151857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272860:0:151857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787826322.272921:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+11:3619:x1874663049394176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 139us (476us total) trans 4294975543 rc 0/0 00000100:00100000:1.0:1787826322.272927:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22616 00010000:00010000:1.0:1787826322.272944:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826322.272950:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272959:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826322.272963:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272971:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272987:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.272995:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cee4e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.273015:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826322.273018:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.273024:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826322.273027:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.273034:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.273044:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.273050:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079fa9eb3/0x878a5eea00cee4ed lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.273063:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826322.273064:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826322.273066:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826322.273090:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb348ae8000/2, rc 0, transno 4294975543 00000100:00100000:1.0:1787826322.273095:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049394176:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1787826322.273105:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb348ae8700/2, rc 0, transno 4294975542 00000100:00100000:1.0:1787826322.273108:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049394048:0@lo:6:osp-syn-1-1.0 00000100:00080000:2.0:1787826322.273216:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826322.273251:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049392896:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1787826322.273291:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.273350:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049393408:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1787826322.273372:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.273392:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049393920:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1787826322.273414:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.273435:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787826322.273441:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049393280:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1787826322.273464:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.273480:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049393792:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1787826322.273504:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826322.273537:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049392896 00000100:00100000:2.0:1787826322.273543:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049392896 00000100:00100000:2.0:1787826322.273587:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049393408 00000100:00100000:2.0:1787826322.273590:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049393408 00000100:00100000:2.0:1787826322.273608:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049393920 00000100:00100000:2.0:1787826322.273611:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049393920 00000100:00100000:2.0:1787826322.273626:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049393280 00000100:00100000:2.0:1787826322.273629:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049393280 00000100:00100000:2.0:1787826322.273645:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049393792 00000100:00100000:2.0:1787826322.273648:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049393792 00000100:00100000:2.0:1787826322.273669:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22617 00000100:00100000:2.0:1787826322.273676:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3618:x1874663049392896:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1787826322.273696:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:900 count 1 00002000:00010000:2.0:1787826322.273719:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x384:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826322.273725:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.273737:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x384:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:2.0:1787826322.273742:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826322.273747:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.273757:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.273765:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.273773:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.273787:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826322.273895:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+15:3618:x1874663049392896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 219us (603us total) trans 4294975544 rc 0/0 00000100:00100000:2.0:1787826322.273902:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22617 00000100:00100000:2.0:1787826322.273920:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22618 00000100:00100000:2.0:1787826322.273926:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3618:x1874663049393408:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1787826322.273938:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:902 count 1 00002000:00010000:2.0:1787826322.273953:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x386:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826322.273958:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.273966:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x386:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:2.0:1787826322.273969:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x386:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826322.273973:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.273984:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.273992:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.274000:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.274008:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1787826322.274087:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+15:3618:x1874663049393408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 161us (713us total) trans 4294975545 rc 0/0 00000100:00100000:2.0:1787826322.274094:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22618 00000100:00100000:2.0:1787826322.274107:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22619 00000100:00100000:2.0:1787826322.274115:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049393920:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1787826322.274130:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:898 count 1 00000100:00100000:2.0:1787826322.274351:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22620 00000100:00100000:2.0:1787826322.274359:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3618:x1874663049393280:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1787826322.274373:0:43898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:903 count 1 00002000:00010000:2.0:1787826322.274392:0:43898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x387:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826322.274397:0:43898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.274407:0:43898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x387:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:2.0:1787826322.274410:0:43898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x387:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826322.274414:0:43898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.274423:0:43898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.274431:0:43898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.274438:0:43898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.274446:0:43898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1787826322.274517:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3618:x1874663049393280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 159us (1053us total) trans 4294975546 rc 0/0 00000100:00100000:2.0:1787826322.274524:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22620 00000100:00100000:2.0:1787826322.274538:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22621 00000100:00100000:2.0:1787826322.274544:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3618:x1874663049393792:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1787826322.274555:0:43898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:898 count 1 00010000:00010000:0.0:1787826322.275338:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275355:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275362:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275370:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275375:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275383:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275403:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x679fc7b1 (ffff8eb348b07f00) 00010000:00010000:0.0:1787826322.275406:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275412:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275420:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cedef7 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275447:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275453:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275459:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275464:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275467:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275473:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275485:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x94c295fa (ffff8eb47f8fed00) 00010000:00010000:0.0:1787826322.275488:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275491:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275497:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00cedf1a lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275513:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275519:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275525:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275531:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275533:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275538:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275545:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xc1e56442 (ffff8eb472775f00) 00010000:00010000:0.0:1787826322.275547:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275550:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275556:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00cedf3d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275584:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275590:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275596:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275601:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ecc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275604:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275610:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275618:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xef08328a (ffff8eb481693700) 00010000:00010000:0.0:1787826322.275621:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275624:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275630:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ecc00/0x878a5eea00cedf60 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275641:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275646:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275652:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275657:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275660:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275666:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275673:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x1c2b00d3 (ffff8eb47f8feb00) 00010000:00010000:0.0:1787826322.275675:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275678:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275684:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00cedf83 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275698:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275705:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275711:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275716:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275719:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275736:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275748:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x494dcf1b (ffff8eb47f8fe200) 00010000:00010000:0.0:1787826322.275751:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275754:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275760:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19e00/0x878a5eea00cedfa6 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275772:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275779:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275785:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275790:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275793:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275799:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275806:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x76709d63 (ffff8eb472775100) 00010000:00010000:0.0:1787826322.275808:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275811:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275817:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511a00/0x878a5eea00cedfc9 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275829:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275836:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275841:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275846:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275849:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275855:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275862:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xa3936bac (ffff8eb472775d00) 00010000:00010000:0.0:1787826322.275865:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275868:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275873:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510a00/0x878a5eea00cedfec lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275884:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275889:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275894:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275900:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275902:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275908:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275914:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xd0b639f4 (ffff8eb472775800) 00010000:00010000:0.0:1787826322.275916:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275918:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275924:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714800/0x878a5eea00cee00f lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275935:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275940:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275946:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275950:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.275952:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275957:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275967:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xfdd9083c (ffff8eb472775300) 00010000:00010000:0.0:1787826322.275970:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.275972:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275978:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee032 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275988:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.275994:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276001:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276006:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276009:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276015:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276022:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x1b7026cc (ffff8eb472775b00) 00010000:00010000:0.0:1787826322.276024:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276027:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276032:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee055 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276043:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276049:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276055:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276061:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ece00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276064:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276070:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276077:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x3e3e6f26 (ffff8eb481693500) 00010000:00010000:0.0:1787826322.276079:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276082:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276087:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00cee078 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276097:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276103:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276108:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276113:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276116:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276121:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276126:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x610cb780 (ffff8eb481693100) 00010000:00010000:0.0:1787826322.276128:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276130:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276135:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00cee09b lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276145:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276151:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276156:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276161:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276164:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276169:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276181:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x83daffd9 (ffff8eb472775900) 00010000:00010000:0.0:1787826322.276184:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276187:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276193:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee0be lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276204:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276210:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276216:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276221:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276224:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276231:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276239:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xa6a94833 (ffff8eb481693200) 00010000:00010000:0.0:1787826322.276241:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276244:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276249:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00cee0e1 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276260:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276266:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276272:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276277:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276280:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276285:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276292:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xc977908d (ffff8eb47f8ff700) 00010000:00010000:0.0:1787826322.276294:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276297:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276303:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee104 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276312:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276318:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276353:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276359:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276361:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276367:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276374:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xec45d8e7 (ffff8eb47f8fe600) 00010000:00010000:0.0:1787826322.276377:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276379:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276385:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19600/0x878a5eea00cee127 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276398:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276404:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276409:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276414:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276417:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276423:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276434:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xf142140 (ffff8eb47f8ffb00) 00010000:00010000:0.0:1787826322.276436:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276439:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276445:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510c00/0x878a5eea00cee14a lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276456:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276462:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276468:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276473:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276476:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276482:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276489:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x31e2699a (ffff8eb481693300) 00010000:00010000:0.0:1787826322.276491:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276494:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276500:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00cee16d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276512:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276519:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276524:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276529:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276532:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276537:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276544:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x54b0b1f4 (ffff8eb47f8fe000) 00010000:00010000:0.0:1787826322.276547:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276549:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276555:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19c00/0x878a5eea00cee190 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276579:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276587:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276592:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276598:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276601:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276606:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276613:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x494dcf1b (ffff8eb47f8fe200) 00010000:00010000:0.0:1787826322.276616:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276619:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276625:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39800/0x878a5eea00cee215 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276646:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276653:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276659:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276664:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eca00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276667:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276674:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276685:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x679fc7b1 (ffff8eb348b07f00) 00010000:00010000:0.0:1787826322.276687:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276690:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276696:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00cee231 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276718:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276725:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276731:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276736:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276739:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276745:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276752:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x76709d63 (ffff8eb472775100) 00010000:00010000:0.0:1787826322.276754:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276757:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276762:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00cee24d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276778:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276783:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276789:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276793:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276796:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276802:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276809:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xa6a94833 (ffff8eb481693200) 00010000:00010000:0.0:1787826322.276811:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276814:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276819:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18600/0x878a5eea00cee269 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276832:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276839:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276844:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276850:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276854:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276860:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276867:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xd0b639f4 (ffff8eb472775800) 00010000:00010000:0.0:1787826322.276869:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276871:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276877:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00cee285 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276891:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276898:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276904:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276910:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276913:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276920:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276930:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x1c2b00d3 (ffff8eb47f8feb00) 00010000:00010000:0.0:1787826322.276933:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.276935:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276942:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00cee2a1 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276962:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276969:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276974:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276979:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.276982:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276988:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.276995:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x83daffd9 (ffff8eb472775900) 00010000:00010000:0.0:1787826322.276997:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277000:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277006:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee2bd lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277020:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277027:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277033:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277037:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277040:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277046:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277053:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xc977908d (ffff8eb47f8ff700) 00010000:00010000:0.0:1787826322.277055:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277057:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277063:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00cee2d9 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277075:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277081:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277087:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277092:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277095:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277100:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277107:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x3e3e6f26 (ffff8eb481693500) 00010000:00010000:0.0:1787826322.277109:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277112:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277118:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18000/0x878a5eea00cee2f5 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277132:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277139:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277145:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277150:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277153:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277159:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277170:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xfdd9083c (ffff8eb472775300) 00010000:00010000:0.0:1787826322.277173:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277175:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277181:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee311 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277196:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277202:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277207:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277212:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277215:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277221:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277229:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xef08328a (ffff8eb481693700) 00010000:00010000:0.0:1787826322.277231:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277234:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277240:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab18800/0x878a5eea00cee32d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277256:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277263:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277269:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277275:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277278:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277283:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277291:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x54b0b1f4 (ffff8eb47f8fe000) 00010000:00010000:0.0:1787826322.277294:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277296:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277303:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00cee349 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277316:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277322:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277359:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277365:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ec00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277368:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277375:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277383:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x31e2699a (ffff8eb481693300) 00010000:00010000:0.0:1787826322.277385:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277387:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277393:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00cee365 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277409:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277415:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277420:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277426:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277429:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277435:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277446:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xc1e56442 (ffff8eb472775f00) 00010000:00010000:0.0:1787826322.277448:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277451:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277457:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34ab19800/0x878a5eea00cee381 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277472:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277479:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277485:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277491:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277494:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277499:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277507:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x94c295fa (ffff8eb47f8fed00) 00010000:00010000:0.0:1787826322.277510:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277513:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277519:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00cee39d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277535:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277542:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277548:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277553:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277556:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277576:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277584:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xec45d8e7 (ffff8eb47f8fe600) 00010000:00010000:0.0:1787826322.277587:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277589:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277596:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00cee3b9 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277610:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277616:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277622:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277628:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277631:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277637:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277645:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xa3936bac (ffff8eb472775d00) 00010000:00010000:0.0:1787826322.277647:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277651:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277657:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee3d5 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277671:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277677:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277684:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277689:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277693:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277699:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277711:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x610cb780 (ffff8eb481693100) 00010000:00010000:0.0:1787826322.277713:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277716:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277722:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00cee3f1 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277736:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277742:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277748:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277754:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277756:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277763:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277771:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0x1b7026cc (ffff8eb472775b00) 00010000:00010000:0.0:1787826322.277773:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277776:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277782:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00cee40d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277796:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277803:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277809:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277815:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826322.277818:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277824:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277831:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1:0x0].0xf142140 (ffff8eb47f8ffb00) 00010000:00010000:0.0:1787826322.277834:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826322.277837:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277843:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee429 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277897:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787826322.277905:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277915:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826322.277919:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277929:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277945:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277952:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020d7c71a/0x878a5eea00cee4f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277970:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826322.277974:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277980:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826322.277984:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.277991:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.278001:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.278009:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c54dcb4e/0x878a5eea00cee4fb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.278027:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826322.278032:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.278038:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826322.278041:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.278049:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.278058:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.278066:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505397b4/0x878a5eea00cee502 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826322.278078:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826322.278080:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826322.278081:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826322.278090:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826322.278099:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826322.280839:0:43898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x382:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826322.280863:0:43898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.280885:0:43898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x382:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:2.0:1787826322.280890:0:43898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x382:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826322.280898:0:43898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.280915:0:43898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.280929:0:43898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.280938:0:43898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.280972:0:43898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826322.281407:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3618:x1874663049393792:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6857us (7896us total) trans 4294975547 rc 0/0 00000100:00100000:2.0:1787826322.281422:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22621 00002000:00010000:1.0:1787826322.281659:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x382:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826322.281667:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.281679:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x382:0x0].0x0 since=8389s v=(0 0) 00010000:00010000:1.0:1787826322.281683:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x382:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826322.281687:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.281702:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.281711:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.281719:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826322.281738:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787826322.281861:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049393920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7746us (8445us total) trans 38654705669 rc 0/0 00000100:00100000:1.0:1787826322.281868:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22619 00010000:00010000:2.0:1787826322.281978:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826322.281986:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.281996:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826322.282001:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282010:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282030:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282039:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a851f9d/0x878a5eea00cee509 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282060:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826322.282063:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282069:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826322.282072:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282079:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282088:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282096:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b72d46/0x878a5eea00cee510 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826322.282119:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826322.282121:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826322.282122:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787826322.282209:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479b40380/2, rc 0, transno 4294975546 00000100:00100000:2.0:1787826322.282219:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049393280:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1787826322.282234:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479b41c00/2, rc 0, transno 4294975547 00000100:00100000:2.0:1787826322.282237:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049393792:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1787826322.282248:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb477f66300/2, rc 0, transno 4294975544 00000100:00100000:2.0:1787826322.282251:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049392896:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1787826322.282260:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479b41f80/2, rc 0, transno 4294975545 00000100:00100000:2.0:1787826322.282264:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049393408:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1787826322.282274:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479b40e00/2, rc 0, transno 38654705669 00000100:00100000:2.0:1787826322.282287:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049393920:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1787826322.282316:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826322.287742:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826323.206818:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826323.208412:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826323.208459:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826323.208514:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826323.208577:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826323.208623:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043026304 00000100:00100000:0.0:1787826323.208636:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043026304 00000100:00100000:0.0:1787826323.208720:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043026176 00000100:00100000:0.0:1787826323.208723:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043026176 00000100:00100000:0.0:1787826323.208752:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 355 00000100:00100000:0.0:1787826323.208765:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043026304:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826323.208865:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043026304:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 103us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826323.208874:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 355 00000100:00100000:0.0:1787826323.208893:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 356 00000100:00100000:0.0:1787826323.208899:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:2390:x1874663043026176:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826323.208928:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:2390:x1874663043026176:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826323.208935:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 356 00000100:00100000:0.0:1787826323.208956:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043026560 00000100:00100000:0.0:1787826323.208959:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043026560 00000100:00100000:0.0:1787826323.208988:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043026432 00000100:00100000:0.0:1787826323.208992:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043026432 00000100:00100000:0.0:1787826323.209014:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7121 00000100:00100000:0.0:1787826323.209020:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043026560:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826323.209050:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043026560:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826323.209058:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7121 00000100:00100000:0.0:1787826323.209070:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7122 00000100:00100000:0.0:1787826323.209076:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043026432:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826323.209103:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043026432:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826323.209110:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7122 00000100:00080000:0.0:1787826323.209129:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826323.209134:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826323.209138:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826323.209140:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826323.212702:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043026048 00000100:00100000:1.0:1787826323.212721:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043026048 00000100:00100000:1.0:1787826323.212812:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 78 00000100:00100000:1.0:1787826323.212823:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043026048:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826323.212937:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043026048:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 115us (6135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826323.212946:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 78 00010000:00010000:0.0:1787826323.285054:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826324.314172:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826324.316628:0:187969:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8391143299949ns, next at 8392143297299ns, rc = 0 00000100:00100000:2.0:1787826324.316650:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049394304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826324.316722:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826324.316884:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049394304 00000100:00100000:1.0:1787826324.316892:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049394304 00000100:00100000:1.0:1787826324.316964:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:1.0:1787826324.316974:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049394304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826324.317002:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826324.317051:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049394304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826324.317060:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00000100:00100000:1.0:1787826324.317113:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049394304:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787826324.317187:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787826325.332844:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826325.333025:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049394432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826325.333089:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826325.333348:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049394432 00000100:00100000:1.0:1787826325.333357:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049394432 00000100:00100000:1.0:1787826325.333422:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5873 00000100:00100000:1.0:1787826325.333432:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3618:x1874663049394432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826325.333461:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826325.333521:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3618:x1874663049394432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826325.333529:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5873 00000100:00080000:2.0:1787826325.333697:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826325.333987:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049394432:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1787826325.339263:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318282 is committed 00000001:00080000:2.0:1787826325.339292:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318281 is committed 00010000:00010000:3.0:1787826325.339393:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826325.339405:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826325.339413:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826325.339419:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826325.339424:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826325.339431:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826325.339447:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff8eb481693e00) 00010000:00010000:3.0:1787826325.339450:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826325.339454:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826325.339461:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee4bc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1787826326.163684:0:197249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80b: DNE: create remote dir, drop update rep from MDT0, fail MDT1 ========================================================== 06:25:24 (1787826324) 00000100:00100000:0.0:1787826326.225138:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826326.225244:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043026688 00000100:00100000:3.0:1787826326.225259:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043026688 00000100:00100000:3.0:1787826326.225368:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1154 00000100:00100000:3.0:1787826326.225381:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162066:x1874663043026688:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826326.225402:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826326.225422:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f331 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826326.225484:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee51e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826326.225498:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee51e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826326.225510:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee51e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826326.225564:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787826326.225568:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826326.225589:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee51e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826326.225613:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f331 expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826326.225632:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee51e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f331 expref: 7 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826326.225640:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826326.225643:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826326.225647:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511200, rc 0) 00000100:00100000:3.0:1787826326.225713:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:162066:x1874663043026688:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 336us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.225720:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1154 00000100:00080000:2.0:1787826326.227758:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826326.237007:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826326.237100:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043026816 00000100:00100000:2.0:1787826326.237110:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043026816 00000100:00100000:2.0:1787826326.237202:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1155 00000100:00100000:2.0:1787826326.237213:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:162066:x1874663043026816:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1787826326.237241:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826326.237269:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cee525 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f338 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.237352:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.237365:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.237376:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.237389:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.237396:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.237402:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238128:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238146:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238154:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238172:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826326.238177:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238191:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238212:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:2.0:1787826326.238215:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826326.238222:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238228:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00cee52c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238253:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238260:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238266:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238271:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826326.238274:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238405:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238415:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8eb47f8ff100) 00010000:00010000:2.0:1787826326.238418:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826326.238421:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238429:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714000/0x878a5eea00cee533 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238702:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cee525 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f338 expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238715:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:2.0:1787826326.238717:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826326.238720:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715e00/0x878a5eea00cee525 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f338 expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826326.238732:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715e00, rc 0) 00000100:00100000:2.0:1787826326.238831:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:162066:x1874663043026816:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1619us (1831us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826326.238841:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1155 00000100:00100000:3.0:1787826326.245490:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826326.245835:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043027072 00000100:00100000:0.0:1787826326.245852:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043027072 00000100:00100000:0.0:1787826326.245935:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1156 00000100:00100000:0.0:1787826326.245948:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:162066:x1874663043027072:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:0.0:1787826326.246024:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826326.246073:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee51e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f331 expref: 7 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246095:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:0.0:1787826326.246100:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826326.246199:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246216:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246227:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246244:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246251:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246258:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246968:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246982:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.246990:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826326.247008:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045abc1a2 reply state 00000000231f50d4 transno 352187318283 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247021:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247029:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:0.0:1787826326.247032:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826326.247036:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787826326.247041:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1787826326.247052:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247060:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247067:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247074:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247080:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826326.247086:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247095:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247107:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:0.0:1787826326.247109:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826326.247114:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247120:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19600/0x878a5eea00cee53a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826326.247132:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045abc1a2 reply state 00000000231f50d4 transno 352187318283 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247140:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826326.247151:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8eb480de3e00) 00010000:00010000:0.0:1787826326.247153:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826326.247155:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787826326.247272:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162066:x1874663043027072:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 1324us (1788us total) trans 352187318283 rc 0/0 00000100:00100000:0.0:1787826326.247281:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1156 00010000:00010000:2.0:1787826326.359591:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826326.869957:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049394816:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870063:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826326.870138:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049395328:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870164:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826326.870189:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049395840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870218:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826326.870251:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826326.870258:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049394944:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870285:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826326.870312:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049395456:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870366:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826326.870500:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049395968:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870527:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826326.870579:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049394816 00000100:00100000:3.0:1787826326.870587:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049394816 00000100:00100000:3.0:1787826326.870660:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049395328 00000100:00100000:3.0:1787826326.870665:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049395328 00000100:00100000:3.0:1787826326.870690:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049395456 00000100:00100000:3.0:1787826326.870692:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049395456 00000100:00100000:3.0:1787826326.870711:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787826326.870721:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049394816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870785:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049394816:12345-0@lo:400:kworker.0 Request processed in 65us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.870792:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787826326.870813:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787826326.870819:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049395328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870849:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049395328:12345-0@lo:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.870854:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787826326.870863:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787826326.870869:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049395456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870893:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049395456:12345-0@lo:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.870898:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787826326.870921:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049394944 00000100:00100000:3.0:1787826326.870926:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049394944 00000100:00100000:3.0:1787826326.870954:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12799 00000100:00100000:3.0:1787826326.870960:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1874663049394944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.870999:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1874663049394944:12345-0@lo:400:kworker.0 Request processed in 40us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.871006:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12799 00000100:00100000:2.0:1787826326.871153:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049394688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871191:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.871213:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049395200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871237:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.871256:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049395712:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871279:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.871302:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787826326.871309:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049394560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871357:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.871394:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049395072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871418:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.871438:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049395584:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871458:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.871475:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049396096:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871496:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.871539:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049395840 00000100:00100000:2.0:1787826326.871544:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049395840 00000100:00100000:2.0:1787826326.871585:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049395968 00000100:00100000:2.0:1787826326.871588:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049395968 00000100:00100000:2.0:1787826326.871610:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049395200 00000100:00100000:2.0:1787826326.871614:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049395200 00000100:00100000:2.0:1787826326.871639:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049395072 00000100:00100000:2.0:1787826326.871642:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049395072 00000100:00100000:2.0:1787826326.871665:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7123 00000100:00100000:2.0:1787826326.871672:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049395840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871713:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049395840:12345-0@lo:400:kworker.0 Request processed in 42us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.871719:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7123 00000100:00100000:2.0:1787826326.871734:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7124 00000100:00100000:2.0:1787826326.871740:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049395968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871767:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049395968:12345-0@lo:400:kworker.0 Request processed in 28us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.871772:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7124 00000100:00100000:2.0:1787826326.871783:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7125 00000100:00100000:2.0:1787826326.871788:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3620:x1874663049395200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871821:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3620:x1874663049395200:12345-0@lo:400:kworker.0 Request processed in 33us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.871828:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7125 00000100:00100000:2.0:1787826326.871841:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7126 00000100:00100000:2.0:1787826326.871847:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049395072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871873:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049395072:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.871881:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7126 00000100:00100000:2.0:1787826326.871901:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049395712 00000100:00100000:2.0:1787826326.871904:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049395712 00000100:00100000:2.0:1787826326.871928:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12800 00000100:00100000:2.0:1787826326.871935:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049395712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.871968:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049395712:12345-0@lo:400:kworker.0 Request processed in 34us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.871975:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12800 00000100:00100000:2.0:1787826326.871997:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049394560 00000100:00100000:2.0:1787826326.872000:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049394560 00000100:00100000:2.0:1787826326.872037:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787826326.872045:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049394560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.872076:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049394560:12345-0@lo:400:kworker.0 Request processed in 33us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.872082:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787826326.872169:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049394560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.872185:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049395072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.872195:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049395200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826326.872206:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049395712:0@lo:400:kworker.0 00000100:00080000:3.0:1787826326.872488:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826326.872495:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826326.872499:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826326.872503:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826326.872521:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049394688 00000100:00100000:3.0:1787826326.872525:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049394688 00000100:00100000:3.0:1787826326.872575:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049395584 00000100:00100000:3.0:1787826326.872579:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049395584 00000100:00100000:3.0:1787826326.872593:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049396096 00000100:00100000:3.0:1787826326.872596:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049396096 00000100:00100000:3.0:1787826326.872609:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787826326.872616:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049394688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.872677:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049394688:12345-0@lo:400:kworker.0 Request processed in 61us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.872683:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787826326.872694:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1787826326.872701:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049395584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.872729:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049395584:12345-0@lo:400:kworker.0 Request processed in 30us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.872735:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1787826326.872745:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787826326.872752:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049396096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.872779:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049396096:12345-0@lo:400:kworker.0 Request processed in 28us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.872785:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787826326.872837:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049395584:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.872848:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049396096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.872859:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049394688:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.872894:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318282 gen 2 00000004:00080000:3.0:1787826326.872901:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318279 committed transno 352187318282 00000020:00080000:3.0:1787826326.872910:0:3617:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8eb44f7fdb40 refcount 2 committed 0 result 0 batchid 12884910965 00000020:00080000:3.0:1787826326.872914:0:3617:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8eb44f7fd600 00000020:00080000:3.0:1787826326.872918:0:3617:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027cd2:0x1:0x0].2 00000020:00080000:3.0:1787826326.872920:0:3617:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb47fa17700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb479876000 00000020:00080000:3.0:1787826326.872923:0:3617:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f5a:0x1:0x0].2 00000004:00080000:3.0:1787826326.872949:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318282 committed transno 352187318282 00000100:00100000:3.0:1787826326.872966:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049394944:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.872981:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049395456:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.872993:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049395968:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.873006:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049394816:0@lo:400:kworker.0 00000100:00100000:3.0:1787826326.873019:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049395328:0@lo:400:kworker.0 00000100:00080000:2.0:1787826326.873139:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826326.873143:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826326.873339:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826326.873355:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049396224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826326.873419:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826326.873460:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049396224 00000100:00100000:1.0:1787826326.873464:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049396224 00000100:00100000:1.0:1787826326.873507:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5874 00000100:00100000:1.0:1787826326.873515:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049396224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826326.873547:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826326.873590:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049396224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826326.873597:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5874 00000100:00100000:1.0:1787826326.873645:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049396224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826326.873853:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826326.873864:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049396352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826326.873895:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.873966:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049396352 00000100:00100000:2.0:1787826326.873971:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049396352 00000100:00100000:2.0:1787826326.874010:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12801 00000100:00100000:2.0:1787826326.874018:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049396352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826326.874169:0:8414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445588992 avail 1299349504 00000100:00100000:2.0:1787826326.874225:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049396352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 208us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.874231:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12801 00000100:00100000:1.0:1787826326.874302:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049396352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826326.875245:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049396480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826326.875300:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826326.875371:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049396480 00000100:00100000:1.0:1787826326.875377:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049396480 00000100:00100000:1.0:1787826326.875502:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5875 00000100:00100000:1.0:1787826326.875511:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049396480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826326.875558:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826326.875604:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049396480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826326.875610:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5875 00000100:00100000:1.0:1787826326.875664:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049396480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826326.875757:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049395840:0@lo:400:kworker.0 00000020:00080000:3.0:1787826326.875808:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 12884910965 committed batchid 12884910964 00000020:00080000:3.0:1787826326.875887:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910964 00000100:00100000:1.0:1787826326.882536:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049396608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826326.882648:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826326.883295:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049396608 00000100:00100000:2.0:1787826326.883307:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049396608 00000100:00100000:2.0:1787826326.883405:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12802 00000100:00100000:2.0:1787826326.883417:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049396608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826326.883466:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445998592 avail 1299759104 00000100:00100000:2.0:1787826326.883553:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049396608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826326.883561:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12802 00000100:00100000:0.0:1787826326.883818:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049396608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826327.304882:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826327.305004:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043027200 00000100:00100000:1.0:1787826327.305018:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043027200 00000100:00100000:1.0:1787826327.305097:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1157 00000100:00100000:1.0:1787826327.305111:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162075:x1874663043027200:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826327.305148:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826327.305186:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee54f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f33f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.305285:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee556 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.305315:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.305356:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826327.305421:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787826327.305426:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826327.305451:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.305485:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee54f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f33f expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.305506:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee556 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f33f expref: 9 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.305523:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826327.305538:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826327.305543:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356a00, rc 0) 00000100:00100000:1.0:1787826327.305617:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:162075:x1874663043027200:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 509us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826327.305626:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1157 00000100:00100000:1.0:1787826327.318959:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826327.319005:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043027328 00000100:00100000:3.0:1787826327.319020:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043027328 00000100:00100000:3.0:1787826327.319105:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1158 00000100:00100000:3.0:1787826327.319120:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:162075:x1874663043027328:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826327.319149:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826327.319177:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee55d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f346 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319269:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319286:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319299:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319312:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319320:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319370:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319499:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cee572 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319508:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cee572 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319515:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cee572 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826327.319572:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1787826327.319578:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826327.319602:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cee572 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319631:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319638:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319645:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319653:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319660:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826327.319666:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319674:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319688:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826327.319692:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826327.319697:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319704:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319719:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319726:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319733:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319739:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826327.319741:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319747:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319754:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8eb480de3e00) 00010000:00010000:3.0:1787826327.319756:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826327.319759:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319764:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee56b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319792:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee55d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f346 expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319806:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cee572 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f346 expref: 10 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.319814:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:3.0:1787826327.319817:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787826327.319820:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511c00, rc 0) 00000100:00100000:3.0:1787826327.319908:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162075:x1874663043027328:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 792us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.319920:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1158 00000100:00100000:3.0:1787826327.332783:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826327.333090:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043027456 00000100:00100000:0.0:1787826327.333103:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043027456 00000100:00100000:0.0:1787826327.338268:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1159 00000100:00100000:0.0:1787826327.338295:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162075:x1874663043027456:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826327.338342:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826327.338370:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee579 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f34d expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338460:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338477:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338491:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338508:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338514:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338522:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338583:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338591:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338598:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338604:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826327.338750:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338763:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338779:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:0.0:1787826327.338783:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826327.338788:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338795:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18000/0x878a5eea00cee580 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338808:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338814:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338822:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338827:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826327.338830:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338837:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338844:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0xf7117594 (ffff8eb480de3500) 00010000:00010000:0.0:1787826327.338847:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826327.338850:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338856:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18800/0x878a5eea00cee587 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338899:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee579 lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f34d expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338910:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:0.0:1787826327.338913:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826327.338917:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18a00/0x878a5eea00cee579 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f34d expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.338928:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18a00, rc 0) 00000100:00100000:0.0:1787826327.339137:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162075:x1874663043027456:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 853us (6369us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826327.339150:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1159 00000100:00100000:1.0:1787826327.346876:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826327.348808:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043027584 00000100:00100000:3.0:1787826327.348829:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043027584 00000100:00100000:3.0:1787826327.348932:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1160 00000100:00100000:3.0:1787826327.348946:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162075:x1874663043027584:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826327.348975:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826327.349004:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee58e lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f354 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349092:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349110:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349124:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349141:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349160:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349168:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349222:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349231:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349239:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349246:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826327.349251:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349260:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349274:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:3.0:1787826327.349278:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826327.349283:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349290:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee595 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349308:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349315:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349321:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349356:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826327.349360:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349366:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349374:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0xf7117594 (ffff8eb472721f00) 00010000:00010000:3.0:1787826327.349376:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826327.349379:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349385:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511400/0x878a5eea00cee59c lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349427:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee58e lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f354 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349439:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:3.0:1787826327.349442:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826327.349446:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee58e lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f354 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.349455:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511e00, rc 0) 00000100:00100000:3.0:1787826327.349557:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162075:x1874663043027584:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 613us (2696us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826327.349565:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1160 00000100:00100000:1.0:1787826327.354316:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826327.354393:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043027712 00000100:00100000:1.0:1787826327.354407:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043027712 00000100:00100000:1.0:1787826327.354483:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1161 00000100:00100000:1.0:1787826327.354498:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162075:x1874663043027712:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826327.354541:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826327.354580:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00cee5a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f35b expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.354676:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.354695:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.354707:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826327.354772:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1787826327.354777:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826327.354801:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.354833:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00cee5a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.354858:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.354867:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:1.0:1787826327.354870:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826327.354874:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356e00, rc 0) 00000100:00100000:1.0:1787826327.355092:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:162075:x1874663043027712:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 596us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826327.355100:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1161 00000100:00100000:3.0:1787826327.367929:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826327.368052:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043027968 00000100:00100000:1.0:1787826327.368077:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043027968 00000100:00100000:1.0:1787826327.368152:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1162 00000100:00100000:1.0:1787826327.368164:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:162075:x1874663043027968:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826327.368198:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826327.368226:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f362 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826327.368390:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1787826327.368547:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f362 expref: 13 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.368571:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826327.368574:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826327.368580:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f362 expref: 13 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.368598:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357400, rc 0) 00000100:00100000:1.0:1787826327.368680:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:162075:x1874663043027968:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 517us (765us total) trans 352187318284 rc 301/301 00000100:00100000:1.0:1787826327.368689:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1162 00010000:00010000:2.0:1787826327.380605:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826327.388699:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826327.395828:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043028224 00000100:00100000:3.0:1787826327.395852:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043028224 00000100:00080000:1.0:1787826327.396475:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826327.396484:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1163 00000100:00100000:0.0:1787826327.396499:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162075:x1874663043028224:12345-192.168.203.47@tcp:36:lfs.0 00000100:00100000:0.0:1787826327.396714:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049396736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826327.396810:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.396856:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a4ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.397424:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049396736 00000100:00100000:1.0:1787826327.397433:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049396736 00000100:00100000:1.0:1787826327.397493:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12803 00000100:00100000:1.0:1787826327.397504:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049396736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.397638:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049396736:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826327.397646:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12803 00000100:00100000:0.0:1787826327.397679:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049396736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826327.397761:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049396864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826327.397792:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.397820:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a4ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.397865:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049396864 00000100:00100000:1.0:1787826327.397870:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049396864 00000100:00100000:1.0:1787826327.397908:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12804 00000100:00100000:1.0:1787826327.397915:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049396864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.397989:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049396864:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826327.397996:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12804 00000100:00100000:0.0:1787826327.398048:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049396864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826327.398087:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049396992:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826327.398126:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826327.398191:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049396992 00000100:00100000:1.0:1787826327.398196:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049396992 00000100:00100000:1.0:1787826327.398220:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12805 00000100:00100000:1.0:1787826327.398226:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049396992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826327.398282:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a4ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.398321:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049396992:12345-0@lo:1000:mdt00_003.0 Request processed in 94us (194us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826327.398343:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049396992:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.398354:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12805 00010000:00010000:0.0:1787826327.398402:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.398413:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.398425:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826327.398442:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397120:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826327.398467:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826327.398488:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb449753d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.399462:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049397120 00000100:00100000:1.0:1787826327.399476:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049397120 00000100:00100000:1.0:1787826327.399544:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12806 00000100:00100000:1.0:1787826327.399554:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049397120:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826327.399570:0:177390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826327.399596:0:177390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee5bf expref: -99 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.399769:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 2/0,1 mode: TXN/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.399785:0:177390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.399794:0:177390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 5/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.399830:0:177390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.399845:0:177390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 11 pid: 187906 timeout: 8494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826327.399865:0:177390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:177390:1874663049397248:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826327.400036:0:177390:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1787826327.400080:0:177390:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787826327.400130:0:177390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0fb40 going to sleep for 11 seconds 00000001:00080000:0.0:1787826327.407414:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318284 is committed 00010000:00010000:0.0:1787826327.407450:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407463:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407471:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407477:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826327.407482:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407490:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407510:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8eb480de3e00) 00010000:00010000:0.0:1787826327.407514:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826327.407519:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407540:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19e00/0x878a5eea00cee541 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407563:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407575:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 2/0,0 mode: TXN/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407582:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,0 mode: TXN/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407586:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826327.407589:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 3/0,0 mode: TXN/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407594:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 4/0,0 mode: TXN/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407602:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:0.0:1787826327.407605:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826327.407612:0:3604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407624:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 2/0,0 mode: --/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.407630:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab18200/0x878a5eea00cee548 lrc: 0/0,0 mode: --/TXN res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826327.411233:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826327.411312:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043028352 00000100:00100000:3.0:1787826327.411433:0:177390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d57100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:177390:1874663049397248:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826327.411474:0:177390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.411487:0:177390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:3.0:1787826327.411491:0:177390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826327.411495:0:177390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 8 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.411505:0:177390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357400, rc 0) 00000100:00100000:3.0:1787826327.411606:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049397120:12345-0@lo:101:mdt00_003.0 Request processed in 12052us (13136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.411615:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12806 00000100:00100000:3.0:1787826327.411693:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397120:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826327.411710:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.411722:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826327.412713:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043028352 00010000:00010000:1.0:1787826327.412780:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 9 pid: 187906 timeout: 8494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826327.412834:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12232 00000100:00100000:1.0:1787826327.412852:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:2391:x1874663043028352:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826327.412873:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826327.412882:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 9 pid: 187906 timeout: 8494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.412897:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 9 pid: 187906 timeout: 8494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.413716:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee5aa lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f35b expref: 9 pid: 187906 timeout: 8494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.413742:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:1.0:1787826327.413750:0:8420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.413765:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.413775:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.413823:0:8420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 7 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826327.413839:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8420:1874663049397376:0@lo:105: 00000100:00100000:1.0:1787826327.413919:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826327.414589:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826327.414812:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049397376 00000100:00100000:3.0:1787826327.414823:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049397376 00000100:00100000:3.0:1787826327.415415:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4776 00000100:00100000:3.0:1787826327.415429:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8420:x1874663049397376:12345-0@lo:105: 00010000:00010000:3.0:1787826327.415446:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.415459:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.415471:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.415481:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 5/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.415489:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.415498:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.415522:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34ab18a00) 00000100:00100000:3.0:1787826327.415620:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8420:x1874663049397376:12345-0@lo:105: Request processed in 195us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.415629:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4776 00010000:00010000:3.0:1787826327.426026:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.426050:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826327.426091:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x4:0x0] 00010000:00010000:3.0:1787826327.426159:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.426167:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.426184:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826327.426215:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397504:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826327.426311:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.427488:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450e1a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.433629:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049397504 00000100:00100000:1.0:1787826327.433657:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049397504 00000100:00100000:1.0:1787826327.433731:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12807 00000100:00100000:1.0:1787826327.433745:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049397504:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826327.433772:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826327.434114:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00cee5d4 lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee5cd expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.434161:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00cee5d4 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee5cd expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.434489:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00cee5d4 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee5cd expref: 9 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.434509:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0xf7117594 (ffff8eb444e01000) 00010000:00010000:1.0:1787826327.434513:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826327.434519:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356800, rc 0) 00000100:00100000:1.0:1787826327.434656:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049397504:12345-0@lo:101:mdt00_003.0 Request processed in 913us (8344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826327.434665:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12807 00000100:00100000:1.0:1787826327.434762:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397504:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826327.434786:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee5d4 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826327.434811:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee5d4 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826327.435134:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x4:0x0] 00000100:00100000:1.0:1787826327.435218:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d55500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397632:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.435575:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826327.435618:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.435660:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049397632 00000100:00100000:1.0:1787826327.435669:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049397632 00000100:00100000:1.0:1787826327.435718:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12808 00000100:00100000:1.0:1787826327.435729:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049397632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.436071:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049397632:12345-0@lo:1000:mdt00_003.0 Request processed in 343us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826327.436080:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12808 00000100:00100000:1.0:1787826327.436141:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8420:1874663049397376:0@lo:105: 00010000:00010000:1.0:1787826327.436168:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826327.436517:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2391:x1874663043028352:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 23667us (25298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826327.436538:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12232 00000100:00100000:3.0:1787826327.436559:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d55500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397632:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826327.436747:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826327.436794:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.436822:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450e1a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.436985:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049397760 00000100:00100000:1.0:1787826327.436991:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049397760 00000100:00100000:1.0:1787826327.437033:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12809 00000100:00100000:1.0:1787826327.437042:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049397760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.437140:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049397760:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (346us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826327.437147:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12809 00000100:00100000:1.0:1787826327.437293:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397760:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.437437:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397888:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.437469:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826327.437486:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.437500:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049397888 00000100:00100000:1.0:1787826327.437504:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049397888 00000100:00100000:1.0:1787826327.437542:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12810 00000100:00100000:1.0:1787826327.437550:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049397888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.437615:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049397888:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (144us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826327.437622:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12810 00000100:00100000:1.0:1787826327.437660:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049397888:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.437711:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049398016:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.437740:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826327.437758:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826327.437765:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049398016 00000100:00100000:3.0:1787826327.437772:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049398016 00000100:00100000:3.0:1787826327.437822:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12811 00000100:00100000:3.0:1787826327.437830:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049398016:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826327.437887:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049398016:12345-0@lo:1000:mdt00_003.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.437894:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12811 00000100:00100000:1.0:1787826327.438050:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049398016:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.438093:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049398144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.438116:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826327.438138:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826327.438455:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049398144 00000100:00100000:3.0:1787826327.438461:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049398144 00000100:00100000:3.0:1787826327.438495:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12812 00000100:00100000:3.0:1787826327.438504:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049398144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826327.438597:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188682:x1874663049398144:12345-0@lo:1000:mdt00_003.0 Request processed in 94us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826327.438604:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12812 00000100:00100000:1.0:1787826327.438706:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049398144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.438761:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049398272:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.438793:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826327.438813:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.438827:0:177386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049398272 00000100:00100000:1.0:1787826327.438831:0:177386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049398272 00000100:00100000:1.0:1787826327.438857:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12813 00000100:00100000:1.0:1787826327.438865:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:188682:x1874663049398272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826327.438920:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:188682:x1874663049398272:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826327.438928:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12813 00000100:00100000:1.0:1787826327.438958:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049398272:0@lo:1000:mdt00_003.0 00000040:00080000:1.0:1787826327.439755:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240001f5a:0x1:0x0].3, 1096 off35384 00000040:00080000:1.0:1787826327.439845:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027cd2:0x1:0x0].3, 1240 off35752 00000004:00080000:1.0:1787826327.439852:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb34df0f540 with version 10 00000004:00080000:1.0:1787826327.440095:0:187966:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb348d2e6c0 version 10 rpc_version 10 00000020:00100000:1.0:1787826327.440127:0:187966:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826327.440137:0:187966:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c141c00 x1874663049398528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826327.440158:0:187966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049398528:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787826327.440215:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826327.440243:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826327.440261:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049398528 00000100:00100000:1.0:1787826327.440268:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049398528 00000100:00100000:1.0:1787826327.440307:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12814 00000100:00100000:1.0:1787826327.440316:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:187966:x1874663049398528:12345-0@lo:1000:osp_up0-1.0 00010000:02000000:1.0:1787826327.441978:0:8414:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00000001:00080000:3.0:1787826327.454019:0:187942:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 17179870055 is committed 00000020:00080000:3.0:1787826327.454045:0:187942:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 12884910965 batchid updated 00000004:00080000:3.0:1787826327.454061:0:187942:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000020:00080000:3.0:1787826327.454089:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910965 00000004:00080000:3.0:1787826327.454169:0:187983:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb450e1ad80 with version 11 00000020:00080000:3.0:1787826327.454192:0:187983:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 12884910965 cancel update log [0x200027cd2:0x1:0x0].2: rc = 0 00010000:00020000:1.0:1787826327.454702:0:8414:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8eb34c143800 x1874663049398528/t352187318285(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:683/0 lens 2520/4320 e 0 to 0 dl 1787826338 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:3.0:1787826327.456278:0:187983:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 12884910965 cancel update log [0x240001f5a:0x1:0x0].2: rc = 0 00000020:00080000:3.0:1787826327.456299:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910965 00000100:00100000:3.0:1787826327.456787:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049398656:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.456890:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.456932:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049399168:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.456954:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.456981:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787826327.456987:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049399040:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.457008:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.457024:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049399552:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.457043:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.457074:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049398784:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.457098:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.457113:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049399296:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.457131:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.457149:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787826327.457154:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049398912:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.457187:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.457205:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049399424:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.457238:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826327.457271:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049398656 00000100:00100000:3.0:1787826327.457280:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049398656 00000100:00100000:3.0:1787826327.458474:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049399168 00000100:00100000:3.0:1787826327.458484:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049399168 00000100:00100000:3.0:1787826327.458516:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049399040 00000100:00100000:3.0:1787826327.458519:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049399040 00000100:00100000:3.0:1787826327.458549:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049399552 00000100:00100000:3.0:1787826327.458552:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049399552 00000100:00100000:3.0:1787826327.458568:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049398784 00000100:00100000:3.0:1787826327.458572:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049398784 00000100:00100000:3.0:1787826327.458588:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049399296 00000100:00100000:3.0:1787826327.458591:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049399296 00000100:00100000:3.0:1787826327.458607:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049398912 00000100:00100000:3.0:1787826327.458610:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049398912 00000100:00100000:3.0:1787826327.458627:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049399424 00000100:00100000:3.0:1787826327.458630:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049399424 00000100:00100000:3.0:1787826327.458652:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22622 00000100:00100000:3.0:1787826327.458667:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+13:3620:x1874663049398656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826327.458709:0:43906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:901 count 1 00000100:00100000:3.0:1787826327.459904:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22623 00000100:00100000:3.0:1787826327.459923:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3620:x1874663049399168:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826327.459950:0:43895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:907 count 1 00000100:00100000:3.0:1787826327.460044:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22624 00000100:00100000:3.0:1787826327.460053:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+13:3620:x1874663049399040:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826327.460067:0:43900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:900 count 1 00000100:00100000:3.0:1787826327.460133:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22625 00000100:00100000:3.0:1787826327.460143:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+13:3620:x1874663049399552:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826327.460159:0:179223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:904 count 1 00000100:00100000:3.0:1787826327.461015:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22626 00000100:00100000:3.0:1787826327.461028:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049398784:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826327.461049:0:16985:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:905 count 1 00000100:00100000:3.0:1787826327.461158:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22627 00000100:00100000:3.0:1787826327.461169:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049399296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826327.461513:0:179226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:899 count 1 00000100:00100000:3.0:1787826327.461620:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22628 00000100:00100000:3.0:1787826327.461631:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049398912:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826327.461646:0:43898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:902 count 1 00000100:00100000:3.0:1787826327.461713:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22629 00000100:00100000:3.0:1787826327.461723:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049399424:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826327.461741:0:8723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:906 count 1 00002000:00010000:3.0:1787826327.462035:0:43895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826327.462046:0:43895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462066:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38b:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:3.0:1787826327.462071:0:43895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826327.462077:0:43895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462097:0:43895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462110:0:43895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462124:0:43895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462150:0:43895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826327.462717:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3620:x1874663049399168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2799us (5759us total) trans 38654705670 rc 0/0 00000100:00100000:3.0:1787826327.462727:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22623 00002000:00010000:3.0:1787826327.462938:0:43900:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x384:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826327.462946:0:43900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462958:0:43900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x384:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:3.0:1787826327.462963:0:43900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826327.462969:0:43900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462980:0:43900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462989:0:43900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.462997:0:43900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.463021:0:43900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787826327.463110:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+14:3620:x1874663049399040:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3057us (6099us total) trans 38654705671 rc 0/0 00000100:00100000:3.0:1787826327.463120:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22624 00000004:00080000:0.0:1787826327.463215:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb34df15f80/2, rc 0, transno 38654705671 00000100:00100000:0.0:1787826327.463232:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049399040:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1787826327.463247:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb34df17480/2, rc 0, transno 38654705670 00000100:00100000:0.0:1787826327.463666:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049399168:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1787826327.463695:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049399680:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1787826327.463752:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1787826327.464096:0:43906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826327.464106:0:43906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.464123:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x385:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:3.0:1787826327.464128:0:43906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x385:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826327.464135:0:43906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.464147:0:43906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.464157:0:43906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.464166:0:43906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.464190:0:43906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1787826327.464358:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+14:3620:x1874663049398656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5694us (7468us total) trans 38654705672 rc 0/0 00000100:00100000:3.0:1787826327.464372:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22622 00000100:00100000:3.0:1787826327.464396:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049399680 00000100:00100000:3.0:1787826327.464405:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049399680 00000004:00080000:0.0:1787826327.464458:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb34df15c00/2, rc 0, transno 38654705672 00000100:00100000:0.0:1787826327.464465:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049398656:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1787826327.464546:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826327.464557:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.464567:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826327.464572:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.464588:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466115:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466141:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d4bb47f/0x878a5eea00cee5db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466178:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826327.466184:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466191:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826327.466196:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466207:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466230:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466238:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba429a7/0x878a5eea00cee5e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466256:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826327.466261:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466267:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826327.466271:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466279:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466293:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466301:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee5e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826327.466314:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826327.466317:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826327.466320:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826327.466369:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22630 00000100:00100000:2.0:1787826327.466393:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3620:x1874663049399680:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:0.0:1787826327.466517:0:8723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1787826327.466517:0:179223:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:2.0:1787826327.466535:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:903 count 1 00010000:00010000:3.0:1787826327.466539:0:179223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.466541:0:8723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.466566:0:8723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38a:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:3.0:1787826327.466566:0:179223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x388:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:3.0:1787826327.466575:0:179223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826327.466576:0:8723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826327.466590:0:8723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.466590:0:179223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.466615:0:8723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.466625:0:8723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.466632:0:8723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.466653:0:8723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826327.466847:0:179223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.466857:0:179223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.466865:0:179223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826327.466868:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3617:x1874663049399424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5145us (9627us total) trans 38654705673 rc 0/0 00000100:00100000:0.0:1787826327.466885:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22629 00010000:00010000:3.0:1787826327.466891:0:179223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787826327.466996:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+15:3620:x1874663049399552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6854us (9951us total) trans 38654705674 rc 0/0 00000100:00100000:3.0:1787826327.467004:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22625 00002000:00010000:3.0:1787826327.467076:0:16985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826327.467081:0:16985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826327.467083:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb479841f80/2, rc 0, transno 38654705674 00000100:00100000:0.0:1787826327.467096:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049399552:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1787826327.467096:0:16985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x389:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:3.0:1787826327.467105:0:16985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x389:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826327.467110:0:16985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467120:0:16985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467127:0:16985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467134:0:16985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467143:0:16985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1787826327.467283:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3617:x1874663049398784:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6258us (10183us total) trans 38654705675 rc 0/0 00000100:00100000:3.0:1787826327.467291:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22626 00010000:00010000:3.0:1787826327.467312:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826327.467319:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467349:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826327.467353:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467366:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467384:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467392:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda47fae/0x878a5eea00cee5f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467410:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826327.467414:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467421:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826327.467423:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467431:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467441:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467447:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3d544c9/0x878a5eea00cee5f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467469:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826327.467472:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467478:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826327.467481:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467489:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467499:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467506:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044559c5d/0x878a5eea00cee5fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.467517:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826327.467518:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826327.467519:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826327.468757:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787826327.468879:0:43898:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x386:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826327.468890:0:43898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.468909:0:43898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x386:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:3.0:1787826327.468915:0:43898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x386:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826327.468922:0:43898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.468935:0:43898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.468946:0:43898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.468955:0:43898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.468984:0:43898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826327.469092:0:179226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x383:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826327.469098:0:179226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469106:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x383:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:3.0:1787826327.469110:0:179226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x383:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826327.469114:0:179226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469122:0:179226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469129:0:179226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469138:0:179226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469156:0:179226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1787826327.469237:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb477dd5500/2, rc 0, transno 38654705673 00000100:00100000:3.0:1787826327.469249:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049399424:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1787826327.469263:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb34df17b80/2, rc 0, transno 38654705675 00000100:00100000:3.0:1787826327.469267:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049398784:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1787826327.469284:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826327.469290:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469298:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826327.469302:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469312:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469359:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469368:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002510adb8/0x878a5eea00cee605 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469396:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826327.469401:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469409:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826327.469412:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469421:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469432:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469440:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee60c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.469453:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826327.469455:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826327.469456:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826327.470145:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826327.471507:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826327.471543:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826327.475695:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826327.475715:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.475739:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x387:0x0].0x0 since=8394s v=(0 0) 00010000:00010000:0.0:1787826327.475744:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x387:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826327.475751:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.475768:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.475781:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.475789:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826327.475809:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826327.477078:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3620:x1874663049399680:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10689us (13317us total) trans 38654705676 rc 0/0 00000100:00100000:0.0:1787826327.477093:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22630 00000004:00080000:0.0:1787826327.477168:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb47a66ce00/2, rc 0, transno 38654705676 00000100:00100000:0.0:1787826327.477177:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049399680:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826327.477240:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+15:3617:x1874663049399296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 16071us (20105us total) trans 38654705677 rc 0/0 00000100:00100000:3.0:1787826327.477250:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22627 00000004:00080000:3.0:1787826327.477289:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb472584e00/2, rc 0, transno 38654705677 00000100:00100000:3.0:1787826327.477295:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049399296:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1787826327.477315:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826327.477343:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.477357:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826327.477363:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.477375:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.477400:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.477408:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b692694c/0x878a5eea00cee613 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826327.477432:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826327.477434:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826327.477436:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826327.477523:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3617:x1874663049398912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15893us (20347us total) trans 38654705678 rc 0/0 00000100:00100000:3.0:1787826327.477542:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22628 00000004:00080000:3.0:1787826327.477569:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb34df15500/2, rc 0, transno 38654705678 00000100:00100000:3.0:1787826327.477574:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049398912:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1787826327.479820:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:187966:x1874663049398528:12345-0@lo:1000:osp_up0-1.0 Request processed in 39491us (39591us total) trans 352187318285 rc 0/0 00000100:00100000:1.0:1787826327.479839:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12814 00000001:00080000:0.0:1787826327.487942:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705675 is committed 00000001:00080000:3.0:1787826327.896381:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975547 is committed 00000001:00080000:2.0:1787826328.181653:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318285 is committed 00000001:00080000:0.0:1787826328.183215:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705678 is committed 00000100:00100000:3.0:1787826328.314148:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826328.314184:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043028480 00000100:00100000:3.0:1787826328.314193:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043028480 00000100:00100000:3.0:1787826328.314252:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1164 00000100:00100000:3.0:1787826328.314264:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162085:x1874663043028480:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:3.0:1787826328.314304:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00000100:00100000:3.0:1787826328.314386:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162085:x1874663043028480:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826328.314394:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1164 00000100:00080000:3.0:1787826328.314428:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826328.325035:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826328.325157:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043028608 00000100:00100000:3.0:1787826328.325167:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043028608 00000100:00100000:3.0:1787826328.325222:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 80 00000100:00100000:3.0:1787826328.325232:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043028608:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826328.325300:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043028608:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 69us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826328.325308:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 80 00000100:00100000:3.0:1787826328.326981:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826328.327031:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826328.327060:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826328.327086:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826328.327126:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043028992 00000100:00100000:3.0:1787826328.327134:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043028992 00000100:00100000:3.0:1787826328.327180:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043028864 00000100:00100000:3.0:1787826328.327184:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043028864 00000100:00100000:3.0:1787826328.327207:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7127 00000100:00100000:3.0:1787826328.327217:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043028992:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826328.327278:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043028992:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826328.327285:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7127 00000100:00100000:3.0:1787826328.327462:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7128 00000100:00100000:3.0:1787826328.327470:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043028864:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826328.327498:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043028864:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826328.327505:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7128 00000100:00080000:3.0:1787826328.327551:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826328.327556:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826328.328234:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043029120 00000100:00100000:0.0:1787826328.328242:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043029120 00000100:00100000:0.0:1787826328.328291:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043028736 00000100:00100000:0.0:1787826328.328295:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043028736 00000100:00100000:0.0:1787826328.328341:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 363 00000100:00100000:0.0:1787826328.328351:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2392:x1874663043028736:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826328.328394:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2392:x1874663043028736:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 45us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826328.328412:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 363 00000100:00100000:0.0:1787826328.328431:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1165 00000100:00100000:0.0:1787826328.328438:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162085:x1874663043029120:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826328.328462:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:0.0:1787826328.328491:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162085:x1874663043029120:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 53us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826328.328497:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1165 00000100:00100000:2.0:1787826328.335645:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826328.344872:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043029248 00000100:00100000:0.0:1787826328.344888:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043029248 00000100:00100000:0.0:1787826328.344960:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5876 00000100:00100000:0.0:1787826328.344971:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162085:x1874663043029248:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826328.345401:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826328.345478:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162085:x1874663043029248:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 508us (9841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826328.345486:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5876 00000100:00100000:0.0:1787826328.351730:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826328.351806:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043029376 00000100:00100000:2.0:1787826328.351815:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043029376 00000100:00100000:2.0:1787826328.351872:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5877 00000100:00100000:2.0:1787826328.351883:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162085:x1874663043029376:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:2.0:1787826328.351914:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826328.351984:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162085:x1874663043029376:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 103us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826328.352000:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5877 00010000:00010000:1.0:1787826328.409353:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826328.423811:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826328.423874:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043029632 00000100:00100000:1.0:1787826328.423884:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043029632 00000100:00100000:1.0:1787826328.423938:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1166 00000100:00100000:1.0:1787826328.423949:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162092:x1874663043029632:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00010000:1.0:1787826328.424010:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826328.424036:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee556 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f33f expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424056:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826328.424062:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826328.424135:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424160:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424171:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424186:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424193:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424200:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424590:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424599:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424605:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424610:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826328.424614:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424621:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424631:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826328.424634:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826328.424637:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424643:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee61a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826328.424669:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b50dfeb reply state 00000000d901c9df transno 352187318286 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424679:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.424685:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb348b07800) 00010000:00010000:1.0:1787826328.424688:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826328.424690:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826328.424770:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:162092:x1874663043029632:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 821us (967us total) trans 352187318286 rc 0/0 00000100:00100000:1.0:1787826328.424778:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1166 00000100:00100000:2.0:1787826328.456884:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826328.456962:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043029760 00000100:00100000:1.0:1787826328.456972:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043029760 00000100:00100000:1.0:1787826328.457043:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1167 00000100:00100000:1.0:1787826328.457053:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:162095:x1874663043029760:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:1.0:1787826328.457081:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826328.457101:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cee628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f369 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.457177:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee62f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.457190:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee62f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.457206:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee62f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826328.457248:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787826328.457252:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826328.457270:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee62f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.457293:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356200/0x878a5eea00cee628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f369 expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.457312:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee62f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f369 expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.457320:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826328.457347:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826328.457351:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357c00, rc 0) 00000100:00100000:1.0:1787826328.457406:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162095:x1874663043029760:12345-192.168.203.47@tcp:101:rm.0 Request processed in 354us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826328.457413:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1167 00000100:00100000:2.0:1787826328.465308:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826328.466120:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043029888 00000100:00100000:1.0:1787826328.466131:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043029888 00000100:00100000:1.0:1787826328.467070:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1168 00000100:00100000:1.0:1787826328.467082:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162095:x1874663043029888:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:1.0:1787826328.467103:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826328.467123:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f370 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467289:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467305:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467316:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467355:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467362:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467370:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467455:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cee64b lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467462:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cee64b lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467469:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cee64b lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826328.467508:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x5:0x0]: returning size 0 00000004:00200000:1.0:1787826328.467511:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826328.467541:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cee64b lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467555:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cee64b lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467564:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467736:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467744:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467751:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826328.467755:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467764:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467776:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826328.467779:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826328.467783:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467789:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee63d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467806:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467812:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467819:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467825:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826328.467828:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467833:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467841:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb348b07800) 00010000:00010000:1.0:1787826328.467843:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826328.467846:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467852:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee644 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467876:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f370 expref: 12 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467889:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cee64b lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f370 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826328.467897:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x5:0x0].0x0 (ffff8eb348b07b00) 00010000:00010000:1.0:1787826328.467900:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826328.467901:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:1.0:1787826328.468006:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:162095:x1874663043029888:12345-192.168.203.47@tcp:101:rm.0 Request processed in 926us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826328.468019:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1168 00000100:00100000:1.0:1787826328.477888:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826328.477975:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043030144 00000100:00100000:3.0:1787826328.477984:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043030144 00000100:00100000:3.0:1787826328.478044:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1169 00000100:00100000:3.0:1787826328.478055:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:162095:x1874663043030144:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826328.478107:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826328.478134:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357000/0x878a5eea00cee64b lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f370 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478167:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x5:0x0].0x0 (ffff8eb348b07b00) 00010000:00010000:3.0:1787826328.478187:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee62f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f369 expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478196:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826328.478199:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826328.478220:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478232:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478242:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478252:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478259:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478267:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478384:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478392:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478414:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478881:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478892:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478900:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478912:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478919:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478926:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478945:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826328.478960:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478967:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478974:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478980:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826328.478984:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.478992:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479001:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x5:0x0].0x0 (ffff8eb34d1bd200) 00010000:00010000:3.0:1787826328.479004:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826328.479008:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479019:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee660 lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479035:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479041:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479047:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479053:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826328.479056:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479062:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479068:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826328.479071:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826328.479073:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479079:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee652 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826328.479089:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbf13e13 reply state 00000000f2af6a6e transno 352187318287 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479099:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479106:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb348b07800) 00010000:00010000:3.0:1787826328.479108:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826328.479111:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826328.479244:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:162095:x1874663043030144:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1188us (1363us total) trans 352187318287 rc 0/0 00000100:00100000:3.0:1787826328.479253:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1169 00010000:00010000:3.0:1787826328.479286:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826328.479291:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479297:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826328.479301:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479307:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479316:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x5:0x0].0x0 (ffff8eb34d1bd200) 00010000:00010000:3.0:1787826328.479319:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826328.479345:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 1/0,0 mode: --/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479351:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee667 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826328.479363:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826328.479365:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826328.479367:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826329.428915:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826329.429111:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826329.429134:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049399808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826329.429203:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826329.429356:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049399808 00000100:00100000:1.0:1787826329.429365:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049399808 00000100:00100000:1.0:1787826329.429418:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:1.0:1787826329.429429:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049399808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826329.429452:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826329.429501:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049399808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826329.429507:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5878 00000100:00100000:1.0:1787826329.429576:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 2 00000004:00080000:1.0:1787826329.429581:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479b40e00, transno 38654705669 00000004:00080000:1.0:1787826329.429592:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb34df17480, transno 38654705670 00000004:00080000:1.0:1787826329.429595:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb34df15f80, transno 38654705671 00000004:00080000:1.0:1787826329.429598:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb34df15c00, transno 38654705672 00000004:00080000:1.0:1787826329.429600:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb477dd5500, transno 38654705673 00000004:00080000:1.0:1787826329.429604:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479841f80, transno 38654705674 00000004:00080000:1.0:1787826329.429606:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb34df17b80, transno 38654705675 00000004:00080000:1.0:1787826329.429609:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb47a66ce00, transno 38654705676 00000004:00080000:1.0:1787826329.429612:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb472584e00, transno 38654705677 00000004:00080000:1.0:1787826329.429615:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb34df15500, transno 38654705678 00000100:00100000:1.0:1787826329.429626:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049399808:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1787826329.429801:0:187968:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00080000:3.0:1787826329.430053:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826330.455687:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826330.455711:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049399936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826330.455780:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826330.455843:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049399936 00000100:00100000:0.0:1787826330.455851:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049399936 00000100:00100000:0.0:1787826330.455910:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5879 00000100:00100000:0.0:1787826330.455919:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049399936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826330.455948:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826330.456002:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049399936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826330.456008:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5879 00000100:00080000:0.0:1787826330.456030:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826330.456458:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975547 gen 2 00000004:00080000:1.0:1787826330.456465:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb47a425500, transno 4294975538 00000004:00080000:1.0:1787826330.456471:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479b40700, transno 4294975539 00000004:00080000:1.0:1787826330.456474:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479b42a00, transno 4294975540 00000004:00080000:1.0:1787826330.456477:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479b40a80, transno 4294975541 00000004:00080000:1.0:1787826330.456479:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb348ae8700, transno 4294975542 00000004:00080000:1.0:1787826330.456482:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb348ae8000, transno 4294975543 00000004:00080000:1.0:1787826330.456484:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb477f66300, transno 4294975544 00000004:00080000:1.0:1787826330.456487:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479b41f80, transno 4294975545 00000004:00080000:1.0:1787826330.456489:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479b40380, transno 4294975546 00000004:00080000:1.0:1787826330.456491:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb479b41c00, transno 4294975547 00000100:00100000:1.0:1787826330.456501:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049399936:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1787826330.456766:0:187970:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 10 done 00010000:00010000:0.0:1787826330.464893:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826331.478515:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826331.988617:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049400064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826331.988731:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826331.988819:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826331.988826:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049400192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826331.988857:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826331.989914:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049400320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826331.989976:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826331.996919:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826331.996951:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049400448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826331.997037:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826331.999533:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049400192 00000100:00100000:3.0:1787826331.999555:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049400192 00000100:00100000:3.0:1787826331.999644:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049400448 00000100:00100000:3.0:1787826331.999648:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049400448 00000100:00100000:3.0:1787826331.999688:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12815 00000100:00100000:3.0:1787826331.999781:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049400192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826331.999968:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:3.0:1787826332.000084:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049400192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 385us (11224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.000093:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12815 00000100:00100000:3.0:1787826332.000118:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12816 00000100:00100000:3.0:1787826332.000128:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3617:x1874663049400448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826332.000149:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:3.0:1787826332.000165:0:177390:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472584e00 x1874663049400448/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:687/0 lens 224/368 e 0 to 0 dl 1787826342 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826332.000205:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3617:x1874663049400448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.000213:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12816 00000100:00100000:3.0:1787826332.000461:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049400064 00000100:00100000:3.0:1787826332.000468:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049400064 00000100:00100000:3.0:1787826332.000529:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049400320 00000100:00100000:3.0:1787826332.000533:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049400320 00000100:00100000:3.0:1787826332.000554:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5880 00000100:00100000:3.0:1787826332.000561:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049400064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826332.000585:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00080000:2.0:1787826332.000622:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826332.000627:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049400064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (11895us total) trans 0 rc 0/0 00000100:00080000:2.0:1787826332.000630:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826332.000635:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5880 00000100:00100000:3.0:1787826332.000649:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:3.0:1787826332.000656:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049400320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826332.000668:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826332.002170:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049400832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826332.002265:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826332.002313:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049401344:0@lo:400:kworker.0 00000100:00100000:1.0:1787826332.002363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826332.002429:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049400448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826332.002458:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049400320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826332.002519:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787826332.002527:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb45eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049400960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826332.002557:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826332.002580:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049401472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826332.002607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826332.002659:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049400832 00000100:00100000:1.0:1787826332.002668:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049400832 00000100:00100000:0.0:1787826332.004371:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049400576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.004475:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826332.004686:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049401088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.004723:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826332.004748:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f6f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049401600:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.004774:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826332.004963:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049400192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826332.004992:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049400064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826332.005023:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787826332.005033:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049400704:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.005050:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049400320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (10721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.005062:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826332.005070:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00000100:00100000:0.0:1787826332.005079:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049401216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.005103:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826332.005166:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049401344 00000100:00100000:3.0:1787826332.005174:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049401344 00000100:00100000:3.0:1787826332.005214:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049401472 00000100:00100000:3.0:1787826332.005218:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049401472 00000100:00100000:3.0:1787826332.005238:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049401600 00000100:00100000:3.0:1787826332.005241:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049401600 00000100:00100000:3.0:1787826332.005252:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049400704 00000100:00100000:3.0:1787826332.005255:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049400704 00000100:00100000:3.0:1787826332.005267:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049401216 00000100:00100000:3.0:1787826332.005269:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049401216 00000100:00100000:3.0:1787826332.005287:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787826332.005296:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049401344:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826332.005345:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde0a80 x1874663049401344/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:688/0 lens 224/224 e 0 to 0 dl 1787826343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826332.005402:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049401344:12345-0@lo:400:kworker.0 Request processed in 106us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826332.005409:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787826332.005424:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1787826332.005430:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049401472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.005458:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049400576 00000100:00100000:3.0:1787826332.005461:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049401472:12345-0@lo:400:kworker.0 Request processed in 31us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.005465:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049400576 00000100:00100000:0.0:1787826332.005527:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787826332.005537:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049400576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.005578:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049400576:12345-0@lo:400:kworker.0 Request processed in 44us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.005586:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787826332.005622:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049400960 00000100:00100000:0.0:1787826332.005627:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049400960 00000100:00100000:0.0:1787826332.005656:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049401088 00000100:00100000:0.0:1787826332.005659:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049401088 00000100:00100000:0.0:1787826332.005680:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7129 00000100:00100000:0.0:1787826332.005687:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049400960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.005721:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049400960:12345-0@lo:400:kworker.0 Request processed in 35us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.005731:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7129 00000100:00100000:0.0:1787826332.005743:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7130 00000100:00100000:0.0:1787826332.005749:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049401088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.005780:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049401088:12345-0@lo:400:kworker.0 Request processed in 31us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826332.005786:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7130 00000100:00100000:2.0:1787826332.006428:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787826332.006445:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049401600:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826332.006466:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481108000 x1874663049401600/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:688/0 lens 224/224 e 0 to 0 dl 1787826343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826332.006531:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049401600:12345-0@lo:400:kworker.0 Request processed in 93us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826332.006539:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787826332.006578:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787826332.006587:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049400704:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826332.006602:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481108700 x1874663049400704/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:688/0 lens 224/224 e 0 to 0 dl 1787826343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826332.006632:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049400704:12345-0@lo:400:kworker.0 Request processed in 47us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826332.006639:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787826332.006656:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787826332.006663:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049401216:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826332.006676:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb48110aa00 x1874663049401216/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:688/0 lens 224/224 e 0 to 0 dl 1787826343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826332.006705:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049401216:12345-0@lo:400:kworker.0 Request processed in 42us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826332.006711:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787826332.006777:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb45eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049400960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.006793:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049401472:0@lo:400:kworker.0 00000100:00100000:2.0:1787826332.006806:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049401344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826332.008484:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787826332.010993:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787826332.011025:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049400832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826332.011169:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049400832:12345-0@lo:400:kworker.0 Request processed in 159us (8906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826332.011178:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:1.0:1787826332.011223:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826332.011231:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826332.011236:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826332.011239:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826332.011287:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049400832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.012901:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049400704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.012921:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049401216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.012934:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049400576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.012946:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049401088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826332.012958:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f6f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049401600:0@lo:400:kworker.0 00010000:00010000:1.0:1787826332.509948:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826333.438899:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826333.438949:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826333.438981:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826333.439008:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826333.439054:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826333.439076:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043030528 00000100:00100000:1.0:1787826333.439087:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043030784 00000100:00100000:2.0:1787826333.439090:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043030528 00000100:00100000:1.0:1787826333.439094:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043030784 00000100:00100000:1.0:1787826333.439165:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043030656 00000100:00100000:1.0:1787826333.439169:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043030656 00000100:00100000:2.0:1787826333.439171:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043030400 00000100:00100000:2.0:1787826333.439176:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043030400 00000100:00100000:1.0:1787826333.439208:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7131 00000100:00100000:2.0:1787826333.439219:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 370 00000100:00100000:1.0:1787826333.439225:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043030784:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826333.439234:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663043030528:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826333.439479:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663043030528:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 248us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826333.439501:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 370 00000100:00100000:2.0:1787826333.439521:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 371 00000100:00100000:2.0:1787826333.439530:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2389:x1874663043030400:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:2.0:1787826333.439553:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47758c380 x1874663043030400/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:689/0 lens 224/224 e 0 to 0 dl 1787826344 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826333.440202:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043030272 00000100:00100000:3.0:1787826333.440211:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043030272 00000100:00100000:3.0:1787826333.440272:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:3.0:1787826333.440282:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663043030272:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826333.443491:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043030784:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 4243us (4479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826333.443516:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7131 00000100:00100000:1.0:1787826333.443575:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7132 00000100:00100000:1.0:1787826333.443595:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043030656:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826333.443661:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043030656:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 76us (4607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826333.443668:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7132 00000100:00080000:1.0:1787826333.443714:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826333.443721:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826333.443725:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826333.443728:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826333.446695:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2389:x1874663043030400:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 7146us (7665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826333.446717:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 371 00000100:00100000:3.0:1787826333.448531:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663043030272:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 8236us (9632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826333.448791:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 82 00010000:00010000:3.0:1787826333.524746:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787826334.234437:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318287 is committed 00010000:00010000:2.0:1787826334.236117:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236137:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236146:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236154:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826334.236160:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236169:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236194:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb348b07800) 00010000:00010000:2.0:1787826334.236198:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826334.236204:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236211:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cee621 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236237:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236249:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236255:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236261:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826334.236264:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236271:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236278:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb348b07800) 00010000:00010000:2.0:1787826334.236281:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826334.236284:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826334.236290:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee659 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826334.548450:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826334.548657:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049401728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826334.548750:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826334.548824:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049401728 00000100:00100000:1.0:1787826334.548834:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049401728 00000100:00100000:1.0:1787826334.548908:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:1.0:1787826334.548922:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049401728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826334.548961:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826334.549087:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049401728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826334.549096:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000100:00080000:1.0:1787826334.549126:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826334.549942:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049401728:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1787826335.262391:0:197692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:1.0:1787826335.572710:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826335.572729:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049401856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826335.572799:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.573050:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049401856 00000100:00100000:3.0:1787826335.573060:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049401856 00000100:00100000:3.0:1787826335.573123:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5883 00000100:00100000:3.0:1787826335.573135:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049401856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826335.573163:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826335.573209:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049401856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.573228:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5883 00000100:00080000:1.0:1787826335.574179:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826335.574235:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049401856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826336.204000:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826336.204124:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043030912 00000100:00100000:0.0:1787826336.204140:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043030912 00000100:00100000:0.0:1787826336.204216:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1170 00000100:00100000:0.0:1787826336.204226:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:162176:x1874663043030912:12345-192.168.203.47@tcp:101:lfs.0 00000100:00080000:2.0:1787826336.204254:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787826336.204374:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826336.204393:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cee66e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f377 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.204451:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee675 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.204475:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.204492:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826336.204534:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787826336.204537:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826336.204552:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.204573:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19200/0x878a5eea00cee66e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f377 expref: 9 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.204586:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee675 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f377 expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.204595:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:0.0:1787826336.204597:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826336.204600:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab19000, rc 0) 00010000:00000080:0.0:1787826336.204607:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a66d500 x1874663043030912/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:692/0 lens 576/688 e 0 to 0 dl 1787826347 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826336.204656:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162176:x1874663043030912:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 432us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.204663:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1170 00000100:00100000:1.0:1787826336.208131:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826336.208577:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043031040 00000100:00100000:2.0:1787826336.208587:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043031040 00000100:00100000:2.0:1787826336.208649:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1171 00000100:00100000:2.0:1787826336.208660:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162176:x1874663043031040:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826336.208694:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:2.0:1787826336.208714:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34ddd7800 x1874663043031040/t0(0) o41->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:731/0 lens 224/368 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826336.208774:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162176:x1874663043031040:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 116us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.208782:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1171 00000100:00100000:0.0:1787826336.216860:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826336.217358:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043031168 00000100:00100000:2.0:1787826336.217370:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043031168 00000100:00100000:2.0:1787826336.217440:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1172 00000100:00100000:2.0:1787826336.217451:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162176:x1874663043031168:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826336.217501:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:2.0:1787826336.217582:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162176:x1874663043031168:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 133us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.217590:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1172 00000100:00080000:3.0:1787826336.217857:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826336.226136:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826336.226208:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043031296 00000100:00100000:1.0:1787826336.226218:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043031296 00000100:00080000:3.0:1787826336.226292:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826336.226296:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5884 00000100:00100000:1.0:1787826336.226307:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162176:x1874663043031296:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:1.0:1787826336.226372:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826336.226451:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162176:x1874663043031296:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.226459:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5884 00000100:00100000:2.0:1787826336.232834:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826336.233840:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043031424 00000100:00100000:3.0:1787826336.233851:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043031424 00000100:00100000:3.0:1787826336.234012:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5885 00000100:00100000:3.0:1787826336.234028:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162176:x1874663043031424:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826336.234053:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826336.234139:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:162176:x1874663043031424:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 117us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826336.234147:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5885 00000100:00080000:2.0:1787826336.235404:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826336.284563:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826336.284592:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043031680 00000100:00100000:2.0:1787826336.284604:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043031680 00000100:00100000:2.0:1787826336.284808:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1173 00000100:00100000:2.0:1787826336.284820:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162183:x1874663043031680:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00010000:2.0:1787826336.284873:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826336.284900:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34ab19000/0x878a5eea00cee675 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f377 expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.284919:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:2.0:1787826336.284924:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826336.284993:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285007:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285017:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285033:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285040:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285050:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285481:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285491:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285497:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285504:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285509:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826336.285513:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285520:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285531:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:2.0:1787826336.285534:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826336.285538:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285545:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715000/0x878a5eea00cee67c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826336.285557:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094648067 reply state 000000004ab56959 transno 352187318288 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285568:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.285575:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8ff100) 00010000:00010000:2.0:1787826336.285577:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826336.285580:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1787826336.285608:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb44f6f8380 x1874663043031680/t352187318288(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:731/0 lens 528/448 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826336.285676:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:162183:x1874663043031680:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 858us (1126us total) trans 352187318288 rc 0/0 00000100:00100000:2.0:1787826336.285684:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1173 00000100:00100000:2.0:1787826336.309933:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826336.309986:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043031808 00000100:00100000:3.0:1787826336.310000:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043031808 00000100:00100000:3.0:1787826336.310059:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1174 00000100:00100000:3.0:1787826336.310068:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:162186:x1874663043031808:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826336.310091:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826336.310110:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee68a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f37e expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.310173:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee691 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.310186:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.310196:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826336.310238:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787826336.310242:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826336.310261:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.310285:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee68a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f37e expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.310300:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f37e expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.310307:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826336.310311:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826336.310314:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00010000:00000080:3.0:1787826336.310343:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46ea6b800 x1874663043031808/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:731/0 lens 576/688 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826336.310412:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162186:x1874663043031808:12345-192.168.203.47@tcp:101:rm.0 Request processed in 344us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826336.310419:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1174 00000100:00100000:2.0:1787826336.312762:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826336.312814:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043031936 00000100:00100000:1.0:1787826336.312823:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043031936 00000100:00100000:1.0:1787826336.312881:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1175 00000100:00100000:1.0:1787826336.312891:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:162186:x1874663043031936:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:1.0:1787826336.312911:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826336.312930:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee698 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f385 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313001:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313014:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313024:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313036:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313044:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313050:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313153:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee6ad lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313162:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee6ad lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313169:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee6ad lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826336.313210:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x6:0x0]: returning size 0 00000004:00200000:1.0:1787826336.313214:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826336.313231:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee6ad lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313243:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee6ad lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313252:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313258:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313268:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313275:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313281:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826336.313285:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313292:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313303:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826336.313306:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826336.313310:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313316:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356e00/0x878a5eea00cee69f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313353:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313360:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313365:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313380:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826336.313383:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313389:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313396:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8ff100) 00010000:00010000:1.0:1787826336.313399:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826336.313402:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313408:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356c00/0x878a5eea00cee6a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313433:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee698 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f385 expref: 12 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313446:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee6ad lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f385 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.313453:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x6:0x0].0x0 (ffff8eb444e01700) 00010000:00010000:1.0:1787826336.313455:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826336.313457:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356a00, rc 0) 00010000:00000080:1.0:1787826336.313476:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb44f6c0000 x1874663043031936/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:731/0 lens 600/584 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787826336.313553:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:162186:x1874663043031936:12345-192.168.203.47@tcp:101:rm.0 Request processed in 663us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.313561:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1175 00000100:00100000:0.0:1787826336.325965:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826336.327834:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043032192 00000100:00100000:3.0:1787826336.327849:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043032192 00000100:00100000:3.0:1787826336.327913:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1176 00000100:00100000:3.0:1787826336.327926:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:162186:x1874663043032192:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826336.327973:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826336.328000:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cee6ad lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f385 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328017:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x6:0x0].0x0 (ffff8eb444e01700) 00010000:00010000:3.0:1787826336.328032:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510c00/0x878a5eea00cee691 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f37e expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328041:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826336.328044:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826336.328063:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328075:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328084:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328094:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328100:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328106:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328192:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328200:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328206:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328407:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328416:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328423:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328429:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328435:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328440:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328457:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826336.328482:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328487:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328493:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328498:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826336.328502:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328508:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328525:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x6:0x0].0x0 (ffff8eb34d1bd500) 00010000:00010000:3.0:1787826336.328528:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826336.328532:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328538:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510a00/0x878a5eea00cee6c2 lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328552:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328561:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328566:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328569:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826336.328572:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328576:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328582:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:3.0:1787826336.328584:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826336.328587:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328591:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511a00/0x878a5eea00cee6b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826336.328597:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c702ef7 reply state 00000000070cf2a9 transno 352187318289 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328607:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328612:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8ff100) 00010000:00010000:3.0:1787826336.328614:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826336.328616:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1787826336.328633:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481109500 x1874663043032192/t352187318289(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:731/0 lens 512/456 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826336.328698:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:162186:x1874663043032192:12345-192.168.203.47@tcp:36:rm.0 Request processed in 777us (2744us total) trans 352187318289 rc 0/0 00000100:00100000:3.0:1787826336.328706:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1176 00010000:00010000:3.0:1787826336.328734:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826336.328739:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328745:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826336.328749:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328755:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328763:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x6:0x0].0x0 (ffff8eb34d1bd500) 00010000:00010000:3.0:1787826336.328765:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826336.328768:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 1/0,0 mode: --/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328773:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511800/0x878a5eea00cee6c9 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.328783:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826336.328785:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826336.328786:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826336.596930:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826337.108580:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049401984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826337.108588:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049402112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826337.110902:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.110903:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.111003:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049402496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826337.111010:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049402624:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.111093:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049402112 00000100:00100000:3.0:1787826337.111104:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049402112 00000100:00100000:3.0:1787826337.111183:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12817 00000100:00100000:3.0:1787826337.111196:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049402112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826337.111236:0:177390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00000100:00100000:0.0:1787826337.111308:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826337.112445:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826337.112508:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049403136:0@lo:400:kworker.0 00000100:00100000:1.0:1787826337.112554:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826337.112588:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049403136 00000100:00100000:1.0:1787826337.112595:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049403136 00000100:00100000:1.0:1787826337.112788:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7133 00000100:00100000:1.0:1787826337.112800:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049403136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826337.112849:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049403136:12345-0@lo:400:kworker.0 Request processed in 52us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826337.112856:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7133 00000100:00100000:1.0:1787826337.112888:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049402240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826337.112925:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826337.112957:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049402752:0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.112980:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049402624 00000100:00100000:1.0:1787826337.112987:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826337.112988:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049402624 00000100:00100000:1.0:1787826337.113011:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049403264:0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.113028:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049402752 00000100:00100000:2.0:1787826337.113032:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049402752 00000100:00100000:1.0:1787826337.113038:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826337.113054:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049403264 00000100:00100000:2.0:1787826337.113059:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049403264 00000100:00100000:1.0:1787826337.113063:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049403776:0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.113077:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787826337.113088:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049402624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826337.113094:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:2.0:1787826337.113108:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34ddd4000 x1874663049402624/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:693/0 lens 224/224 e 0 to 0 dl 1787826348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826337.113135:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049401984 00000100:00100000:1.0:1787826337.113140:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049401984 00000100:00100000:2.0:1787826337.113157:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049402624:12345-0@lo:400:kworker.0 Request processed in 71us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826337.113166:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787826337.113187:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787826337.113188:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5886 00000100:00100000:2.0:1787826337.113197:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049402752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826337.113202:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049401984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826337.113225:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826337.113254:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049402752:12345-0@lo:400:kworker.0 Request processed in 58us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826337.113262:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787826337.113282:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787826337.113283:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049401984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826337.113293:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049403264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826337.113294:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5886 00010000:00000080:2.0:1787826337.113312:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448d17b80 x1874663049403264/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:693/0 lens 224/224 e 0 to 0 dl 1787826348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826337.113346:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049403776 00000100:00100000:1.0:1787826337.113351:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049403776 00000100:00100000:2.0:1787826337.113380:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049403264:12345-0@lo:400:kworker.0 Request processed in 89us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826337.113387:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:2.0:1787826337.113407:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826337.113414:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826337.113417:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826337.113420:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826337.113476:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7134 00000100:00100000:1.0:1787826337.113485:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049403776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.113487:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049402752:0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.113511:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049403264:0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.113560:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049402240 00000100:00100000:2.0:1787826337.113564:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049402240 00000100:00100000:2.0:1787826337.113591:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12818 00000100:00100000:2.0:1787826337.113598:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3620:x1874663049402240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826337.113619:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:2.0:1787826337.113634:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448d16a00 x1874663049402240/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:693/0 lens 224/368 e 0 to 0 dl 1787826348 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826337.114635:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049402112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3436us (3737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826337.114649:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12817 00000100:00100000:0.0:1787826337.114731:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049403008:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.114784:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826337.114784:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3620:x1874663049402240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1183us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826337.114809:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12818 00000100:00100000:0.0:1787826337.114815:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049403520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.114843:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826337.114870:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049402240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826337.114879:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049404032:0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.114899:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049403520 00000100:00100000:2.0:1787826337.114905:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049403520 00000100:00100000:0.0:1787826337.114910:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.114948:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48110a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049401984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826337.114950:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049404032 00000100:00100000:2.0:1787826337.114955:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049404032 00000100:00100000:0.0:1787826337.114972:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787826337.114975:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787826337.114983:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049402368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826337.114987:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049403520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.115019:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826337.115035:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049403520:12345-0@lo:400:kworker.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.115045:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049402880:0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.115045:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1787826337.115061:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787826337.115068:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049404032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.115079:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:2.0:1787826337.115083:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a425500 x1874663049404032/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:693/0 lens 224/224 e 0 to 0 dl 1787826348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826337.115101:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049403392:0@lo:400:kworker.0 00000100:00100000:2.0:1787826337.115117:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049404032:12345-0@lo:400:kworker.0 Request processed in 49us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826337.115124:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787826337.115134:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.115152:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049403904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.115172:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.115191:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049403520:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.115201:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049404032:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.115233:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049403008 00000100:00100000:3.0:1787826337.115238:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049403008 00000100:00100000:3.0:1787826337.115273:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049403904 00000100:00100000:3.0:1787826337.115276:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049403904 00000100:00100000:3.0:1787826337.115299:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7135 00000100:00100000:3.0:1787826337.115306:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049403008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.115366:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049402496 00000100:00100000:0.0:1787826337.115371:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049402496 00000100:00100000:3.0:1787826337.115372:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049403008:12345-0@lo:400:kworker.0 Request processed in 66us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826337.115381:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7135 00000100:00100000:3.0:1787826337.115395:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7136 00000100:00100000:3.0:1787826337.115403:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049403904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.115413:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787826337.115423:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049402496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.115433:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049403904:12345-0@lo:400:kworker.0 Request processed in 31us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826337.115440:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7136 00000100:00100000:3.0:1787826337.115471:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049402368 00000100:00100000:3.0:1787826337.115475:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049402368 00000100:00100000:3.0:1787826337.115496:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5887 00000100:00100000:3.0:1787826337.115503:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049402368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826337.115519:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826337.115605:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049403776:12345-0@lo:400:kworker.0 Request processed in 2121us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826337.115613:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7134 00000100:00100000:2.0:1787826337.115669:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049403392 00000100:00100000:2.0:1787826337.115673:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049403392 00000100:00100000:0.0:1787826337.115700:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049402496:12345-0@lo:400:kworker.0 Request processed in 276us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826337.115702:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787826337.115714:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787826337.115717:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049403392:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826337.115734:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479bf5180 x1874663049403392/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:693/0 lens 224/224 e 0 to 0 dl 1787826348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826337.115792:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049402368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826337.115799:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5887 00000100:00100000:0.0:1787826337.115827:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049403136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.115838:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049403648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.115869:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049402368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826337.115870:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826337.115902:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049402112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826337.115923:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049403392:12345-0@lo:400:kworker.0 Request processed in 208us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826337.115932:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787826337.115940:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049402624:0@lo:400:kworker.0 00000100:00080000:2.0:1787826337.115957:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826337.115963:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826337.115966:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826337.115968:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826337.115983:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049402880 00000100:00100000:2.0:1787826337.115988:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049402880 00000100:00100000:2.0:1787826337.116012:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049403648 00000100:00100000:2.0:1787826337.116016:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049403648 00000100:00100000:2.0:1787826337.116030:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12819 00000100:00100000:2.0:1787826337.116038:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3618:x1874663049402880:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826337.116054:0:8414:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb477f66300 x1874663049402880/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:693/0 lens 224/224 e 0 to 0 dl 1787826348 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826337.116091:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3618:x1874663049402880:12345-0@lo:400:kworker.0 Request processed in 55us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.116099:0:177386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12820 00000100:00100000:2.0:1787826337.116107:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12819 00000100:00100000:0.0:1787826337.116111:0:177386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049403648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.116153:0:177386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049403648:12345-0@lo:400:kworker.0 Request processed in 45us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826337.116159:0:177386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12820 00000100:00100000:0.0:1787826337.116189:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049403648:0@lo:400:kworker.0 00000100:00100000:0.0:1787826337.116230:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049403776:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.130095:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049403392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.130180:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049403904:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.130194:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049402496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.130207:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049403008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826337.130263:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049402880:0@lo:400:kworker.0 00010000:00010000:3.0:1787826337.620615:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826338.558277:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826338.558406:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826338.558431:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826338.558463:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826338.559561:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826338.559655:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043032448 00000100:00100000:2.0:1787826338.559666:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043032448 00000100:00100000:2.0:1787826338.559726:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043032576 00000100:00100000:2.0:1787826338.559730:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043032576 00000100:00100000:2.0:1787826338.559755:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 378 00000100:00100000:2.0:1787826338.559765:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2389:x1874663043032448:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:2.0:1787826338.559798:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34ddd5180 x1874663043032448/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:733/0 lens 224/224 e 0 to 0 dl 1787826388 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826338.559854:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2389:x1874663043032448:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 91us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826338.559863:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 378 00000100:00100000:2.0:1787826338.559881:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 379 00000100:00100000:2.0:1787826338.559888:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663043032576:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:2.0:1787826338.559900:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34ddd6680 x1874663043032576/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:733/0 lens 224/224 e 0 to 0 dl 1787826388 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826338.559923:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663043032576:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 36us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826338.559929:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 379 00000100:00100000:1.0:1787826338.559991:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043032320 00000100:00100000:1.0:1787826338.559995:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043032320 00000100:00100000:1.0:1787826338.560039:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 84 00000100:00100000:1.0:1787826338.560046:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043032320:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826338.560073:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043032320:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826338.560079:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 84 00000100:00100000:0.0:1787826338.563845:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043032704 00000100:00100000:0.0:1787826338.563857:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043032704 00000100:00100000:0.0:1787826338.564248:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043032832 00000100:00100000:0.0:1787826338.564253:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043032832 00000100:00100000:0.0:1787826338.564299:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7137 00000100:00100000:0.0:1787826338.564311:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043032704:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826338.564539:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043032704:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 230us (6074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826338.564552:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7137 00000100:00100000:0.0:1787826338.564571:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7138 00000100:00100000:0.0:1787826338.564578:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043032832:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826338.564603:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043032832:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826338.564609:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7138 00000100:00080000:2.0:1787826338.565875:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826338.565883:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826338.565887:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826338.565889:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787826338.644649:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826338.645060:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f000 going to sleep for 1 seconds 00000100:00100000:1.0:1787826339.668533:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049404160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826339.668604:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826339.668662:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049404160 00000100:00100000:1.0:1787826339.668670:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049404160 00000100:00100000:1.0:1787826339.668721:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5888 00000100:00100000:1.0:1787826339.668732:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049404160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826339.668782:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826339.668829:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049404160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826339.668838:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5888 00000100:00080000:1.0:1787826339.668861:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826339.668895:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049404160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826339.672110:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f000 going to sleep for 1 seconds 00010000:00010000:3.0:1787826339.672859:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826340.692614:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826340.692675:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f000 going to sleep for 1 seconds 00000100:00100000:2.0:1787826340.693194:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826340.693220:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049404288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826340.693351:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826340.693507:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049404288 00000100:00100000:3.0:1787826340.693518:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049404288 00000100:00100000:3.0:1787826340.693596:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5889 00000100:00100000:3.0:1787826340.693612:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049404288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826340.693650:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826340.693707:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049404288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826340.693715:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5889 00000100:00080000:2.0:1787826340.694347:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826340.694401:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049404288:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826341.716621:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826341.717132:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f000 going to sleep for 1 seconds 00000001:00080000:1.0:1787826342.231991:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318289 is committed 00000100:00100000:3.0:1787826342.235390:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049404544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235470:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235522:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049405056:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235549:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235568:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049405568:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235592:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235612:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049406080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235644:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235669:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787826342.235675:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049404416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826342.235700:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235718:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049404928:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235738:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235755:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049405440:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235776:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235790:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049405952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235808:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235833:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049404672:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235856:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235873:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049405184:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235894:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235910:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049405696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235931:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235950:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787826342.235956:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049404800:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.235978:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.235988:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049405312:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.236008:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.236018:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049405824:0@lo:400:kworker.0 00010000:00010000:0.0:1787826342.236717:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236729:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236737:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236744:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826342.236749:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236756:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236774:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8ff100) 00010000:00010000:0.0:1787826342.236778:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826342.236784:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236790:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00cee683 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236808:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236815:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236821:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236826:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826342.236829:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236834:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236842:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb47f8ff100) 00010000:00010000:0.0:1787826342.236844:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826342.236847:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826342.236852:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee6bb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826342.237166:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049406464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826342.237200:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.237232:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049406208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826342.237256:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826342.237272:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826342.237275:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826342.237281:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049406336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826342.237302:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826342.237310:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049404928 00000100:00100000:1.0:1787826342.237317:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049404928 00000100:00100000:1.0:1787826342.237369:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049405696 00000100:00100000:1.0:1787826342.237373:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049405696 00000100:00100000:1.0:1787826342.237383:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049406464 00000100:00100000:1.0:1787826342.237385:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049406464 00000100:00100000:1.0:1787826342.237393:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049406336 00000100:00100000:1.0:1787826342.237395:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049406336 00000100:00100000:1.0:1787826342.238131:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12821 00000100:00100000:1.0:1787826342.238145:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3618:x1874663049404928:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826342.238173:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479b41880 x1874663049404928/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:698/0 lens 224/224 e 0 to 0 dl 1787826353 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826342.238375:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3618:x1874663049404928:12345-0@lo:400:kworker.0 Request processed in 234us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.238384:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12821 00000100:00100000:1.0:1787826342.238484:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12822 00000100:00100000:1.0:1787826342.238492:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049405696:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826342.238506:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348aebb80 x1874663049405696/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:698/0 lens 224/224 e 0 to 0 dl 1787826353 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826342.238614:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049405696:12345-0@lo:400:kworker.0 Request processed in 123us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.238620:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12822 00000100:00100000:1.0:1787826342.238634:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12823 00000100:00100000:1.0:1787826342.238639:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049406464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826342.238662:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445994496 avail 1299755008 00010000:00000080:1.0:1787826342.238671:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb477df4700 x1874663049406464/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:698/0 lens 224/368 e 0 to 0 dl 1787826353 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826342.238698:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049406464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.238703:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12823 00000100:00100000:1.0:1787826342.238713:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12824 00000100:00100000:1.0:1787826342.238719:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049406336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826342.238733:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:1.0:1787826342.238741:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481b75500 x1874663049406336/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:698/0 lens 224/368 e 0 to 0 dl 1787826353 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826342.238766:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049406336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.238771:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12824 00000100:00100000:1.0:1787826342.238816:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049406464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826342.240293:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049404544 00000100:00100000:3.0:1787826342.240306:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049404544 00000100:00100000:3.0:1787826342.240373:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787826342.240383:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049404544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.240463:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049404544:12345-0@lo:400:kworker.0 Request processed in 81us (4993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.240470:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787826342.240508:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049405056 00000100:00100000:3.0:1787826342.240512:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049405056 00000100:00100000:3.0:1787826342.240551:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049405952 00000100:00100000:3.0:1787826342.240554:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049405952 00000100:00100000:3.0:1787826342.240574:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049405184 00000100:00100000:3.0:1787826342.240577:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049405184 00000100:00100000:3.0:1787826342.240597:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049405824 00000100:00100000:3.0:1787826342.240600:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049405824 00000100:00100000:3.0:1787826342.240623:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7139 00000100:00100000:1.0:1787826342.240630:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7140 00000100:00100000:3.0:1787826342.240630:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049405056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826342.240638:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049405952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.240664:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049405056:12345-0@lo:400:kworker.0 Request processed in 35us (5114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.240668:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049405952:12345-0@lo:400:kworker.0 Request processed in 32us (4859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.240670:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7139 00000100:00100000:1.0:1787826342.240673:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7140 00000100:00100000:3.0:1787826342.240682:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7141 00000100:00100000:3.0:1787826342.240688:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049405184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.240716:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049405184:12345-0@lo:400:kworker.0 Request processed in 29us (4822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.247590:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7142 00000100:00100000:1.0:1787826342.247617:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049405824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826342.247709:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049405824:12345-0@lo:400:kworker.0 Request processed in 106us (10508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.247717:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7142 00000100:00100000:3.0:1787826342.250365:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7141 00000100:00100000:3.0:1787826342.250432:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049405568 00000100:00100000:3.0:1787826342.250442:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049405568 00000100:00100000:3.0:1787826342.250480:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049406080 00000100:00100000:3.0:1787826342.250484:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049406080 00000100:00100000:3.0:1787826342.250501:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049405440 00000100:00100000:3.0:1787826342.250504:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049405440 00000100:00100000:3.0:1787826342.250517:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049404672 00000100:00100000:3.0:1787826342.250519:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049404672 00000100:00100000:3.0:1787826342.250533:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049404800 00000100:00100000:3.0:1787826342.250536:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049404800 00000100:00100000:3.0:1787826342.250548:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049405312 00000100:00100000:3.0:1787826342.250550:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049405312 00000100:00100000:3.0:1787826342.250567:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787826342.250575:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049405568:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826342.250602:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479b40380 x1874663049405568/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1787826392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826342.250670:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049405568:12345-0@lo:400:kworker.0 Request processed in 96us (15076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.250677:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787826342.250691:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787826342.250699:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049406080:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826342.250714:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479b41c00 x1874663049406080/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1787826392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826342.250741:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049406080:12345-0@lo:400:kworker.0 Request processed in 44us (15109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.250746:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787826342.250764:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787826342.250771:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049405440:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826342.250781:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348ae8700 x1874663049405440/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1787826392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826342.250807:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049405440:12345-0@lo:400:kworker.0 Request processed in 38us (15030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.250813:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787826342.250826:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787826342.250832:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049404672:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826342.250842:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348aead80 x1874663049404672/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1787826392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826342.250868:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049404672:12345-0@lo:400:kworker.0 Request processed in 37us (15012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.250874:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787826342.250885:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787826342.250891:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049404800:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826342.250903:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348ae8e00 x1874663049404800/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1787826392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826342.250928:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049404800:12345-0@lo:400:kworker.0 Request processed in 38us (14950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.250933:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787826342.250944:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787826342.250950:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049405312:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826342.250963:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348aeb480 x1874663049405312/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1787826392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826342.250989:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049405312:12345-0@lo:400:kworker.0 Request processed in 40us (14981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.250995:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787826342.251161:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049404416 00000100:00100000:3.0:1787826342.251167:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049404416 00000100:00100000:3.0:1787826342.251210:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049406208 00000100:00100000:3.0:1787826342.251214:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049406208 00000100:00100000:3.0:1787826342.251246:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5890 00000100:00100000:3.0:1787826342.251253:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049404416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826342.251276:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826342.251281:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5891 00000100:00100000:1.0:1787826342.251290:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049406208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826342.251305:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826342.251309:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049404416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (15608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.251314:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5890 00000100:00100000:1.0:1787826342.251357:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049406208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (14099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826342.251363:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5891 00000100:00100000:3.0:1787826342.251401:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049404416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826342.251416:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049404928:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251436:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049405440:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251446:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049405952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251457:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049404544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251468:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049405056:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251478:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049405568:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251487:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049406080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251554:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049406336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826342.251568:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049406208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826342.251579:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049404800:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251588:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049405312:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251596:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049405824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251606:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049404672:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251616:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049405184:0@lo:400:kworker.0 00000100:00100000:3.0:1787826342.251626:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049405696:0@lo:400:kworker.0 00000100:00080000:3.0:1787826342.251659:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826342.251663:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826342.251666:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826342.251668:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826342.744180:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826342.744282:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f000 going to sleep for 1 seconds 00000001:02000400:2.0:1787826342.953964:0:198087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00100000:2.0:1787826343.677908:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826343.677952:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826343.677987:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826343.678015:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043033216 00000100:00100000:2.0:1787826343.678021:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826343.678026:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043033216 00000100:00100000:2.0:1787826343.678067:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826343.678090:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043033088 00000100:00100000:3.0:1787826343.678094:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043033088 00000100:00100000:2.0:1787826343.678098:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043033472 00000100:00100000:2.0:1787826343.678104:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043033472 00000100:00100000:3.0:1787826343.678123:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 386 00000100:00100000:3.0:1787826343.678135:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663043033216:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:3.0:1787826343.678166:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e84df80 x1874663043033216/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:738/0 lens 224/224 e 0 to 0 dl 1787826393 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826343.678223:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663043033216:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826343.678230:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 386 00000100:00100000:3.0:1787826343.678247:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 387 00000100:00100000:3.0:1787826343.678255:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2389:x1874663043033088:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:3.0:1787826343.678267:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e84d880 x1874663043033088/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:738/0 lens 224/224 e 0 to 0 dl 1787826393 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826343.678382:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2389:x1874663043033088:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 36us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826343.678390:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 387 00000100:00080000:3.0:1787826343.678423:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826343.678428:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826343.678430:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826343.678508:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043032960 00000100:00100000:2.0:1787826343.678686:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043033344 00000100:00100000:2.0:1787826343.678691:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043033344 00000100:00100000:1.0:1787826343.678694:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043032960 00000100:00080000:3.0:1787826343.678894:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826343.678935:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7143 00000100:00100000:0.0:1787826343.678947:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043033472:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826343.678956:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 86 00000100:00100000:1.0:1787826343.678967:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663043032960:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826343.678993:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043033472:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 49us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826343.679002:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663043032960:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.679002:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7144 00000100:00100000:1.0:1787826343.679008:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 86 00000100:00100000:2.0:1787826343.679011:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043033344:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826343.679038:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043033344:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826343.679224:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7143 00000100:00100000:2.0:1787826343.685303:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7144 00010000:00010000:3.0:1787826343.764504:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787826343.765464:0:187966:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826327/real 1787826327] req@ffff8eb34c141c00 x1874663049398528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1787826343 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826343.808521:0:187966:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826343.808534:0:187966:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787826343.808540:0:187966:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1787826343.808789:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826343.808794:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826343.808796:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826343.808802:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8373 00000100:00080000:2.0:1787826343.808810:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb48165c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826343.808831:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb44f744380 x1874663049406976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826343.808919:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049406976:0@lo:38:kworker.0 00000100:00100000:2.0:1787826343.808933:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049406592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.809001:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826343.809001:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826343.809044:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049407232:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809069:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826343.809087:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049407744:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809110:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.809114:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f000 going to sleep for 0 seconds 00000100:00100000:2.0:1787826343.809135:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787826343.809142:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049407104:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809163:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826343.809188:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049407616:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809213:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.809232:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049407232 00000100:00100000:2.0:1787826343.809241:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049408128:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.809242:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049407232 00000100:00100000:2.0:1787826343.809272:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.809289:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049407104 00000100:00100000:0.0:1787826343.809292:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049407104 00000100:00100000:2.0:1787826343.809314:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049406720:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.809317:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7145 00000100:00100000:0.0:1787826343.809346:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049407232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809368:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826343.809395:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049407360:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.809409:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049407232:12345-0@lo:400:kworker.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826343.809436:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7145 00000100:00100000:2.0:1787826343.809438:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.809458:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7146 00000100:00100000:2.0:1787826343.809465:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049407872:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.809469:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049407104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809496:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.809510:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049407104:12345-0@lo:400:kworker.0 Request processed in 44us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826343.809517:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7146 00000100:00100000:2.0:1787826343.809522:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826343.809530:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049407872 00000100:00100000:2.0:1787826343.809532:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb45eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049406848:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.809535:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049407872 00000100:00100000:2.0:1787826343.809563:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.809567:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7147 00000100:00100000:0.0:1787826343.809577:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049407872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809579:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049407488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809601:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826343.809610:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049408000:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809630:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826343.809657:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049406592 00000100:00100000:2.0:1787826343.809661:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049406592 00000100:00100000:2.0:1787826343.809689:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826343.809696:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049406592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.809727:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049406592:12345-0@lo:400:kworker.0 Request processed in 31us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.809732:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826343.809946:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049406976 00000100:00100000:2.0:1787826343.809951:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049406976 00000100:00100000:2.0:1787826343.809973:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049407744 00000100:00100000:2.0:1787826343.809976:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049407744 00000100:00100000:2.0:1787826343.809995:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12825 00000100:00100000:2.0:1787826343.810001:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3616:x1874663049406976:12345-0@lo:38:kworker.0 00010000:02000400:2.0:1787826343.810022:0:8414:0:(ldlm_lib.c:1363:target_handle_connect()) lustre-MDT0000: Received new MDS connection from 0@lo, keep former export from same NID 00000100:00100000:0.0:1787826343.810159:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049407872:12345-0@lo:400:kworker.0 Request processed in 584us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826343.810166:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7147 00000100:00100000:0.0:1787826343.810178:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049408000 00000100:00100000:0.0:1787826343.810182:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049408000 00000100:00100000:0.0:1787826343.810205:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7148 00000100:00100000:0.0:1787826343.810211:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049408000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.810237:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049408000:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826343.810242:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7148 00000100:00100000:0.0:1787826343.810286:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049408000:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.810295:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049407872:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.810320:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049407104:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.810349:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049406592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826343.810357:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049407232:0@lo:400:kworker.0 00000100:00100000:1.0:1787826343.814708:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12826 00000100:00100000:1.0:1787826343.814735:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049407744:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826343.814767:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479939880 x1874663049407744/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:699/0 lens 224/224 e 0 to 0 dl 1787826354 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826343.814848:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049407744:12345-0@lo:400:kworker.0 Request processed in 124us (5736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826343.814857:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12826 00000100:00100000:0.0:1787826343.815029:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049407744:0@lo:400:kworker.0 00010000:00080000:2.0:1787826343.824592:0:8414:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp ffff8eb34b9e1800 cur 8410 last 1787826300 00000100:00100000:2.0:1787826343.824625:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049407616 00000100:00100000:2.0:1787826343.824634:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049407616 00000100:00100000:2.0:1787826343.824678:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049408128 00000100:00100000:2.0:1787826343.824682:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049408128 00000100:00100000:2.0:1787826343.824694:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049406720 00000100:00100000:2.0:1787826343.824697:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049406720 00000100:00100000:2.0:1787826343.824707:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049407360 00000100:00100000:2.0:1787826343.824710:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049407360 00000100:00100000:2.0:1787826343.824719:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049406848 00000100:00100000:2.0:1787826343.824721:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049406848 00000100:00100000:2.0:1787826343.824731:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049407488 00000100:00100000:2.0:1787826343.824733:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049407488 00000100:00100000:2.0:1787826343.824747:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787826343.824756:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049407616:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826343.824783:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34df17480 x1874663049407616/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:699/0 lens 224/224 e 0 to 0 dl 1787826354 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.824867:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049407616:12345-0@lo:400:kworker.0 Request processed in 112us (15653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.824875:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787826343.824892:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787826343.824898:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049408128:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826343.824909:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34df15f80 x1874663049408128/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:699/0 lens 224/224 e 0 to 0 dl 1787826354 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.824937:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049408128:12345-0@lo:400:kworker.0 Request processed in 41us (15666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.824944:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787826343.824955:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787826343.824960:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049406720:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826343.824970:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34df15c00 x1874663049406720/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:699/0 lens 224/224 e 0 to 0 dl 1787826354 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.824998:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049406720:12345-0@lo:400:kworker.0 Request processed in 38us (15631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.825004:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787826343.825014:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1787826343.825019:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049407360:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826343.825031:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34df17b80 x1874663049407360/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:699/0 lens 224/224 e 0 to 0 dl 1787826354 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.825054:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049407360:12345-0@lo:400:kworker.0 Request processed in 35us (15620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.825059:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1787826343.825068:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787826343.825073:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049406848:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826343.825083:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34df16300 x1874663049406848/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:699/0 lens 224/224 e 0 to 0 dl 1787826354 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.825105:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049406848:12345-0@lo:400:kworker.0 Request processed in 31us (15544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.825110:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787826343.825120:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787826343.825125:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049407488:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826343.825135:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34df14380 x1874663049407488/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:699/0 lens 224/224 e 0 to 0 dl 1787826354 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.825159:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049407488:12345-0@lo:400:kworker.0 Request processed in 35us (15558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.825165:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787826343.825234:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb45eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049406848:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.825248:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049407488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.825259:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049406720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.825270:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049407360:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.825319:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049407616:0@lo:400:kworker.0 00000100:00100000:2.0:1787826343.825364:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049408128:0@lo:400:kworker.0 00000004:00100000:2.0:1787826343.825407:0:8414:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli 0@lo does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826343.825434:0:8414:0:(import.c:65:import_set_state_nolock()) ffff8eb343211000 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1787826343.825443:0:8414:0:(import.c:65:import_set_state_nolock()) ffff8eb343211000 : changing import state from RECOVER to FULL 00010000:00000080:2.0:1787826343.825457:0:8414:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69ed80 x1874663049406976/t0(0) o38->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787826363 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.825496:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3616:x1874663049406976:12345-0@lo:38:kworker.0 Request processed in 15494us (16499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826343.825504:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12825 00000100:00080000:2.0:1787826343.825533:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 82 00000100:00080000:2.0:1787826343.825544:0:3616:0:(import.c:1297:ptlrpc_connect_interpret()) reconnected to lustre-MDT0000_UUID@0@lo after partition 00000100:00080000:2.0:1787826343.825546:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787826343.825550:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787826343.825566:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787826343.825624:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826343.825638:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049408256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826343.825678:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.825713:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049408256 00000100:00100000:0.0:1787826343.825717:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049408256 00000100:00100000:0.0:1787826343.825757:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12827 00000100:00100000:0.0:1787826343.825765:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3617:x1874663049408256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826343.825791:0:8415:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:0.0:1787826343.825802:0:8415:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69e680 x1874663049408256/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:699/0 lens 224/368 e 0 to 0 dl 1787826354 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826343.825836:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3617:x1874663049408256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826343.825842:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12827 00000100:00100000:0.0:1787826343.825873:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049408256:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787826343.837197:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a843334a): req@ffff8eb34c141c00 x1874663049398528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1787826343 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.837229:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049406976:0@lo:38:kworker.0 00000100:00100000:0.0:1787826343.837993:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.838101:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34df0f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826343.839673:0:177390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049398528 00000100:00100000:2.0:1787826343.839687:0:177390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049398528 00000100:00100000:2.0:1787826343.839744:0:177390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12828 00000100:00100000:2.0:1787826343.839755:0:177390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47bfc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187966:x1874663049398528:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1787826343.839790:0:177390:0:(tgt_handler.c:3156:tgt_check_resent()) @@@ reconstruct resent RPC req@ffff8eb47bfc5050 x1874663049398528/t352187318285(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:699/0 lens 2520/4320 e 0 to 0 dl 1787826354 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:2.0:1787826343.839809:0:177390:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb469f4a208 index 0: rc = 0 00000020:00080000:2.0:1787826343.839814:0:177390:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb469f4a208 index 1: rc = 0 00000020:00080000:2.0:1787826343.839817:0:177390:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb469f4a208 index 2: rc = 0 00000020:00080000:2.0:1787826343.839822:0:177390:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb469f4a208 index 3: rc = 0 00000020:00080000:2.0:1787826343.839827:0:177390:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb469f4a208 index 4: rc = 0 00000020:00080000:2.0:1787826343.839829:0:177390:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb469f4a208 index 5: rc = 0 00000020:00080000:2.0:1787826343.839832:0:177390:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb469f4a208 index 6: rc = 0 00000020:00080000:2.0:1787826343.839834:0:177390:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb469f4a208 index 7: rc = 0 00010000:00000080:2.0:1787826343.839841:0:177390:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47bfc5050 x1874663049398528/t352187318285(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:699/0 lens 2520/4320 e 0 to 0 dl 1787826354 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826343.839917:0:177390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47bfc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187966:x1874663049398528:12345-0@lo:1000:osp_up0-1.0 Request processed in 164us (1926us total) trans 352187318285 rc 0/0 00000100:00100000:2.0:1787826343.839925:0:177390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12828 00000100:00100000:0.0:1787826343.840407:0:187966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049398528:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787826343.840432:0:187966:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb348d2e6c0 version 11 rpc_version 11 00000020:00100000:0.0:1787826343.840457:0:187966:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826343.840463:0:187966:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34c69c700 x1874663049408512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826343.840483:0:187966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049408512:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787826343.840562:0:187966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826343.840584:0:187966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ede5480 going to sleep for 11 seconds 00010000:00010000:2.0:1787826343.840762:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.840778:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.840792:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826343.840810:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052f20905 reply state 00000000b39f1523 transno 17179870055 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.840820:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.840827:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb47f8ff300) 00010000:00010000:2.0:1787826343.840831:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826343.840835:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787826343.840840:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x16:0x0]: returning size 4096 00000004:00080000:2.0:1787826343.840849:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x4:0x0] 00010000:00010000:2.0:1787826343.840859:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.840867:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.840875:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.840900:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826343.840906:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x4:0x0] 00010000:00010000:2.0:1787826343.840912:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee5d4 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.840919:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee5d4 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1787826343.840951:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4725e8000 x1874663043028224/t17179870055(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:708/0 lens 560/448 e 1 to 0 dl 1787826363 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787826343.841000:0:188682:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787826343.841012:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162075:x1874663043028224:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 16444517us (16452328us total) trans 17179870055 rc 0/0 00000100:00100000:2.0:1787826343.841019:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1163 00000100:00100000:2.0:1787826343.841058:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049408512 00000100:00100000:2.0:1787826343.841063:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049408512 00000100:00100000:2.0:1787826343.841097:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826343.841105:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:187966:x1874663049408512:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787826343.841107:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826343.841114:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826343.841123:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:1.0:1787826343.841137:0:9495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826343.841146:0:9495:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826343.841169:0:9495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826343.841175:0:9495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826343.841193:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 1/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826343.841199:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34ab18a00/0x878a5eea00cee5bf lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee5c6 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826343.841213:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826343.841215:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:2.0:1787826343.841215:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69f480 x1874663049408512/t352187318290(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:699/0 lens 488/4320 e 0 to 0 dl 1787826354 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787826343.841217:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826343.841265:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:187966:x1874663049408512:12345-0@lo:1000:osp_up0-1.0 Request processed in 160us (702us total) trans 352187318290 rc 0/0 00000100:00100000:2.0:1787826343.841272:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787826343.841320:0:187966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187966:1874663049408512:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787826343.841385:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.841395:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.841401:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.841406:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826343.841551:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.841561:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.841572:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb47f8ff300) 00010000:00010000:2.0:1787826343.841574:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826343.841578:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826343.841583:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00cee6d0 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826343.841613:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826343.841624:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049408640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826343.841656:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826343.842863:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049408640 00000100:00100000:1.0:1787826343.842873:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049408640 00000100:00100000:1.0:1787826343.842918:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4241 00000100:00100000:1.0:1787826343.842925:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3620:x1874663049408640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826343.842938:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826343.842956:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357400/0x878a5eea00cee5c6 lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee5bf expref: 10 pid: 177390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826343.842972:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:1.0:1787826343.842975:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826343.843020:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3620:x1874663049408640:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826343.843026:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4241 00000100:00100000:2.0:1787826343.843999:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049408640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826343.844999:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826343.845123:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043033728 00000100:00100000:0.0:1787826343.845198:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043033728 00000100:00100000:0.0:1787826343.845278:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:0.0:1787826343.845288:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:162075:x1874663043033728:12345-192.168.203.47@tcp:35:lfs.0 00010000:00000080:0.0:1787826343.845488:0:187907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb477df6300 x1874663043033728/t352187318291(0) o35->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:699/0 lens 392/456 e 0 to 0 dl 1787826354 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826343.845552:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162075:x1874663043033728:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 265us (558us total) trans 352187318291 rc 0/0 00000100:00100000:0.0:1787826343.845563:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 34 00000020:01000004:2.0:1787826344.655991:0:198185:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787826344.656048:0:198185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.656062:0:198185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.656069:0:198185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.656077:0:198185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.656093:0:198185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787826344.656098:0:198185:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787826344.656121:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787826344.656126:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787826344.656133:0:198185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787826344.656158:0:198185:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787826344.656189:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049408768:0@lo:39:umount.0 00000100:00100000:2.0:1787826344.656256:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826344.656306:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049408768 00000100:00100000:2.0:1787826344.656313:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049408768 00000100:00100000:2.0:1787826344.656374:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1787826344.656383:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874663049408768:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787826344.656421:0:188992:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedc73 00000100:00080000:2.0:1787826344.656435:0:188992:0:(import.c:65:import_set_state_nolock()) ffff8eb4770dc800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1787826344.656459:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479840a80 x1874663049408768/t0(0) o39->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:700/0 lens 224/224 e 0 to 0 dl 1787826355 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826344.656501:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+1:3616:x1874663049408768:12345-0@lo:39:umount.0 Request processed in 119us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826344.656508:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000020:00000080:2.0:1787826344.656517:0:188992:0:(genops.c:885:class_export_put()) final put ffff8eb4770da800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787826344.656561:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4770da800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1787826344.657559:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826344.657568:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.657577:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826344.657581:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.657591:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826344.657600:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826344.657607:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826344.657609:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787826344.657612:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787826344.657644:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.657650:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826344.657672:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.657680:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34a569e00/0x878a5eea00cedbaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbb6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.657693:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826344.657695:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826344.657698:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826344.657712:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049408896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826344.657760:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1787826344.657835:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb4770dc800 for lustre-MDT0000 00010000:00010000:3.0:1787826344.658244:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826344.661307:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049408896 00000100:00100000:0.0:1787826344.661335:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049408896 00000100:00100000:0.0:1787826344.661404:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4242 00000100:00100000:0.0:1787826344.661426:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3620:x1874663049408896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826344.661442:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826344.661464:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce2e00/0x878a5eea00cedbb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedbaf expref: 24 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.661481:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826344.661547:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3620:x1874663049408896:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (3786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826344.661554:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4242 00000100:00100000:0.0:1787826344.661593:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049408896:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787826344.665174:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb450c26000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787826344.665203:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049408768:0@lo:39:umount.0 00000100:00080000:2.0:1787826344.665790:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787826344.665795:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787826344.665800:0:198185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787826344.666812:0:198185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666828:0:198185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666836:0:198185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666843:0:198185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666872:0:198185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826344.666878:0:198185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666885:0:198185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666890:0:198185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666895:0:198185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666909:0:198185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787826344.666915:0:198185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666922:0:198185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666928:0:198185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666934:0:198185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666952:0:198185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787826344.666958:0:198185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666965:0:198185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666977:0:198185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666983:0:198185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.666995:0:198185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787826344.666998:0:198185:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1787826344.667363:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787826344.667370:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667378:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826344.667382:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667391:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826344.667398:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826344.667415:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826344.667418:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1787826344.667420:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1787826344.667454:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667459:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826344.667482:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667489:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d65800/0x878a5eea00cedbcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbd2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667502:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787826344.667505:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667510:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826344.667513:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667519:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826344.667526:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826344.667530:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826344.667533:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787826344.667535:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787826344.667549:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667554:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826344.667559:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667564:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2200/0x878a5eea00cedbbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbc4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667572:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826344.667574:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667580:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826344.667582:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667588:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826344.667593:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826344.667598:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787826344.667600:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787826344.667601:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787826344.667610:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667615:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826344.667627:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667632:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38600/0x878a5eea00cedbe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667640:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826344.667642:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667647:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826344.667650:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667655:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826344.667660:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826344.667665:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787826344.667667:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787826344.667669:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787826344.667694:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667701:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826344.667717:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667724:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d64600/0x878a5eea00cedbd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedbe0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.667737:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826344.667738:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826344.667740:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826344.667757:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049409024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826344.667820:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826344.667864:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826344.667870:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049409152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826344.667893:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826344.667921:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049409280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826344.667946:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826344.667961:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826344.667965:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049409408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826344.667985:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826344.668014:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049409024 00000100:00100000:0.0:1787826344.668020:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049409024 00010000:00010000:1.0:1787826344.668182:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826344.668193:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049409152 00000100:00100000:1.0:1787826344.668197:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049409152 00000100:00100000:1.0:1787826344.668267:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049409280 00000100:00100000:1.0:1787826344.668270:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049409280 00000100:00100000:1.0:1787826344.668287:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049409408 00000100:00100000:1.0:1787826344.668290:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049409408 00000100:00100000:1.0:1787826344.668306:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4243 00000100:00100000:1.0:1787826344.668314:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+26:3617:x1874663049409152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826344.668350:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826344.668365:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a568600/0x878a5eea00cedbc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedbbd expref: 26 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826344.668379:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826344.668432:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+25:3617:x1874663049409152:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826344.668439:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4243 00000100:00100000:1.0:1787826344.668458:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4244 00000100:00100000:1.0:1787826344.668464:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eda1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049409280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826344.668473:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826344.668482:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a569400/0x878a5eea00cedbee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedbe7 expref: 24 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826344.668489:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826344.668516:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eda1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3619:x1874663049409280:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826344.668521:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4244 00000100:00100000:1.0:1787826344.668537:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4245 00000100:00100000:1.0:1787826344.668544:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3619:x1874663049409408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826344.668551:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826344.668559:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce2a00/0x878a5eea00cedbe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedbd9 expref: 22 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826344.668566:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826344.668587:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3619:x1874663049409408:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826344.668595:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4245 00000100:00100000:1.0:1787826344.668659:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049409408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826344.668669:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049409280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826344.668693:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049409152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826344.668791:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4246 00000100:00100000:0.0:1787826344.668799:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:3617:x1874663049409024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826344.668808:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826344.668816:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf38a00/0x878a5eea00cedbd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedbcb expref: 20 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.668825:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826344.668853:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3617:x1874663049409024:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826344.668860:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4246 00010000:00010000:3.0:1787826344.668961:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826344.668967:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787826344.669309:0:198185:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787826344.669314:0:198185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:2.0:1787826344.669321:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1787826344.669353:0:198185:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0001 00000100:00100000:1.0:1787826344.670155:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049409024:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1787826344.672002:0:198185:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1787826344.672256:0:198185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1787826344.672264:0:198185:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8eb448c3e000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826344.672271:0:198185:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8eb348a3c000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826344.672278:0:198185:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8eb46e35a000 c0d7758a-4501-4a89-8ec1-407fef4f0c7f 192.168.203.47@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 17179870055 stale:0 00000020:00080000:2.0:1787826344.672284:0:198185:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8eb47a4e9800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826344.672288:0:198185:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8eb481784d28) has exports, disconnecting them 00000020:00080000:2.0:1787826344.672292:0:198185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8eb448c3e000), last request at 1787826300 00000020:00000080:2.0:1787826344.672300:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedaf9 00000100:00080000:2.0:1787826344.672309:0:198185:0:(import.c:65:import_set_state_nolock()) ffff8eb481223800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826344.672363:0:198185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb448c3e000): rc 0 00000020:00000080:2.0:1787826344.672366:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb448c3e000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1787826344.672374:0:198185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8eb348a3c000), last request at 1787826343 00000020:00000080:2.0:1787826344.672376:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced779 00000100:00080000:2.0:1787826344.672381:0:198185:0:(import.c:65:import_set_state_nolock()) ffff8eb348a3e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826344.672388:0:198185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb348a3c000): rc 0 00000020:00000080:2.0:1787826344.672389:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb348a3c000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:2.0:1787826344.672394:0:198185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.203.47@tcp (ffff8eb46e35a000), last request at 1787826343 00000020:00000080:2.0:1787826344.672397:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced6f4 00000100:00080000:2.0:1787826344.672416:0:198185:0:(import.c:65:import_set_state_nolock()) ffff8eb46e35d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826344.672445:0:198185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb46e35a000): rc 0 00000020:00000080:2.0:1787826344.672448:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb46e35a000/c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00080000:2.0:1787826344.672452:0:198185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8eb47a4e9800), last request at 1787826343 00000020:00000080:2.0:1787826344.672455:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce732d 00000100:00080000:2.0:1787826344.672462:0:198185:0:(import.c:65:import_set_state_nolock()) ffff8eb47a4eb800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787826344.672469:0:198185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb47a4e9800): rc 0 00000020:00000080:2.0:1787826344.672471:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb47a4e9800/lustre-MDT0001-lwp-OST0001_UUID 00000004:00000080:2.0:1787826344.672479:0:198185:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb65b87ed3ae0 00000100:00080000:2.0:1787826344.672495:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787826344.672498:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318282 gen 3 00000100:00100000:2.0:1787826344.672507:0:198185:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb34c141c00 x1874663049398528/t352187318285(352187318285) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 1787826359 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787826344.672516:0:198185:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318285 committed transno 352187318282 00000020:00080000:2.0:1787826344.672521:0:198185:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8eb34df0fa80 refcount 2 committed 0 result 1 batchid 12884910966 00000020:00080000:2.0:1787826344.672524:0:198185:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb449176800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8eb34df0f540 00000020:00080000:2.0:1787826344.672528:0:198185:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027cd2:0x1:0x0].3 00000020:00080000:2.0:1787826344.672530:0:198185:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb449176400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb479865e00 00000020:00080000:2.0:1787826344.672532:0:198185:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f5a:0x1:0x0].3 00000100:00100000:2.0:1787826344.672554:0:198185:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb34c69c700 x1874663049408512/t352187318290(352187318290) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787826359 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787826344.672560:0:198185:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 352187318290 committed transno 352187318282 00010000:00010000:2.0:1787826344.672687:0:198185:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedee9 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826344.672699:0:198185:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedee9 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787826344.673106:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c3e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787826344.673154:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb348a3c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787826344.673176:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e35a000/c0d7758a-4501-4a89-8ec1-407fef4f0c7f for lustre-MDT0001 00000020:00000080:0.0:1787826344.673201:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a4e9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787826344.673224:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb481223800 for lustre-MDT0001 00000020:00000080:0.0:1787826344.673228:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb348a3e800 for lustre-MDT0001 00000020:00000080:0.0:1787826344.673231:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46e35d800 for lustre-MDT0001 00000020:00000080:0.0:1787826344.673235:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47a4eb800 for lustre-MDT0001 00010000:00010000:1.0:1787826344.673371:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826344.673378:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826344.673763:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826344.673769:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787826344.673775:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910965 00000020:00080000:3.0:1787826344.673778:0:187983:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910965 00000004:00080000:2.0:1787826344.673906:0:198185:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787826344.673940:0:198185:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826344.673954:0:198185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ede00/0x878a5eea00cedee2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedee9 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.674002:0:198185:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 4/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x878a5eea00cee5d4 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826344.674011:0:198185:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 4/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x878a5eea00cee5d4 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826344.674018:0:198185:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826344.674022:0:198185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb441511e00/0x878a5eea00cee5cd lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x878a5eea00cee5d4 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787826344.675162:0:198185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787826344.675191:0:198185:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787826344.675473:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049409536:0@lo:39:umount.0 00000100:00100000:3.0:1787826344.675542:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826344.675644:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049409536 00000100:00100000:0.0:1787826344.675652:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049409536 00000100:00100000:0.0:1787826344.675710:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787826344.675721:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3616:x1874663049409536:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787826344.675747:0:187909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedac8 00000020:00010000:0.0:1787826344.675759:0:187909:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb34b9e1800: total 0 00000100:00080000:0.0:1787826344.675762:0:187909:0:(import.c:65:import_set_state_nolock()) ffff8eb343211000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787826344.675788:0:187909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 82, last_transno is 352187318291 00010000:00000080:0.0:1787826344.675893:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481b75880 x1874663049409536/t352187318292(0) o39->lustre-MDT0001-mdtlov_UUID@0@lo:700/0 lens 224/224 e 0 to 0 dl 1787826355 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826344.675937:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3616:x1874663049409536:12345-0@lo:39:umount.0 Request processed in 218us (395us total) trans 352187318292 rc 0/0 00000100:00100000:0.0:1787826344.675944:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00010000:1.0:1787826344.676124:0:9495:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb34b9e1800: total 0 00010000:00010000:1.0:1787826344.676128:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826344.676178:0:9495:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb34b9e1800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787826344.676210:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0xf7117594 (ffff8eb444e01000) 00010000:00010000:1.0:1787826344.676215:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826344.676222:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356800/0x878a5eea00cee5d4 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee5cd expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826344.676248:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb348b07500) 00010000:00010000:1.0:1787826344.676250:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826344.676253:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cedee9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedee2 expref: 5 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826344.676269:0:9495:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb34b9e1800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787826344.676281:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826344.676282:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826344.676284:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826344.676428:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787826344.676432:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 3 00000004:00080000:2.0:1787826344.676444:0:198185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787826344.676499:0:198185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787826344.676515:0:198185:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787826344.676523:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787826344.676526:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975547 gen 3 00000004:00080000:2.0:1787826344.676539:0:198185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787826344.676595:0:198185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787826344.676604:0:198185:0:(import.c:65:import_set_state_nolock()) ffff8eb3496af000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787826344.676641:0:198185:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8eb481784d28) has no exports 00000100:00100000:1.0:1787826344.676744:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826344.676761:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1874663049409920:0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1787826344.676882:0:187983:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8eb34df0fa80 refcount 1 committed 1 result 1 batchid 12884910966 00000020:00080000:3.0:1787826344.676887:0:187983:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb449176800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8eb34df0f540 00000020:00080000:3.0:1787826344.676889:0:187983:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200027cd2:0x1:0x0].3 00000020:00080000:3.0:1787826344.676892:0:187983:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8eb449176400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eb479865e00 00000020:00080000:3.0:1787826344.676895:0:187983:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240001f5a:0x1:0x0].3 00000100:00100000:3.0:1787826344.676971:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049409664:0@lo:9:umount.0 00000100:00100000:3.0:1787826344.677019:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826344.677057:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049409792:0@lo:9:umount.0 00000100:00100000:3.0:1787826344.677080:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826344.677109:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb48165c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787826344.677115:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049409536:0@lo:39:umount.0 00000100:00100000:3.0:1787826344.677137:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049409664 00000100:00100000:3.0:1787826344.677142:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049409664 00000100:00100000:3.0:1787826344.677182:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049409792 00000100:00100000:3.0:1787826344.677185:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049409792 00000100:00100000:3.0:1787826344.677205:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22631 00000100:00100000:3.0:1787826344.677213:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3616:x1874663049409664:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787826344.677235:0:179223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ced733 00000100:00080000:3.0:1787826344.677241:0:179223:0:(import.c:65:import_set_state_nolock()) ffff8eb44905a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787826344.677273:0:179223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705678 00000100:00100000:3.0:1787826344.677683:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2:3616:x1874663049409664:12345-0@lo:9:umount.0 Request processed in 470us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826344.677691:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22631 00000100:00100000:3.0:1787826344.677763:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22632 00000100:00100000:3.0:1787826344.677771:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3616:x1874663049409792:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787826344.677784:0:179223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7254 00000100:00080000:3.0:1787826344.677789:0:179223:0:(import.c:65:import_set_state_nolock()) ffff8eb472757800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787826344.677811:0:179223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975547 00000100:00100000:3.0:1787826344.677886:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2:3616:x1874663049409792:12345-0@lo:9:umount.0 Request processed in 117us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826344.677895:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22632 00000100:00080000:3.0:1787826344.677915:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826344.677919:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826344.677931:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826344.677951:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787826344.677958:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787826344.677960:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787826344.677962:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049409664:0@lo:9:umount.0 00000100:00080000:3.0:1787826344.677971:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3496af000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787826344.677975:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787826344.677976:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787826344.677978:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049409792:0@lo:9:umount.0 00010000:00010000:1.0:1787826344.678263:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787826344.678455:0:198185:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000020:00080000:1.0:1787826344.678916:0:198185:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8eb481784d28) has no exports 00000020:01000000:0.0:1787826344.730472:0:198185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb3430c6960 - data ffff8eb447a581b0/ffff8eb47f7c2c00 00000020:01000000:0.0:1787826344.730645:0:198185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb3430c6120 - data ffff8eb4723e66c0/ffff8eb34bb03000 00000100:00080000:3.0:1787826344.787716:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787826344.787724:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318282 gen 4 00000100:00100000:3.0:1787826344.787738:0:198185:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb479840e00 x1874663049409536/t352187318292(352187318292) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826354 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826344.787763:0:198185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787826344.792760:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826344.793143:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787826344.793148:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 4 00000004:00080000:3.0:1787826344.793508:0:198185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787826344.793511:0:198185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787826344.794133:0:187968:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787826344.794138:0:187968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 11 count 1 00000040:00080000:1.0:1787826344.794148:0:187968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 4 count 2 00000100:00080000:3.0:1787826344.794741:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787826344.794746:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975547 gen 4 00000004:00080000:3.0:1787826344.794764:0:198185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787826344.794767:0:198185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787826344.795315:0:187970:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787826344.795321:0:187970:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 1 00000040:00080000:0.0:1787826344.795356:0:187970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 4 count 2 00000020:00000080:3.0:1787826344.796281:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce71d6 00000020:00000080:3.0:1787826344.796291:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb342751000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787826344.796388:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb342751000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787826344.797001:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce71eb 00000020:00000080:3.0:1787826344.797009:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb3492c4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787826344.801573:0:198185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787826344.801587:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826344.801600:0:198185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787826344.801605:0:198185:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8eb481780000) has no exports 00000004:01000000:3.0:1787826344.801784:0:198185:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787826344.801793:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce724d 00000020:00000080:3.0:1787826344.801801:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb47754c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787826344.805014:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3492c4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787826344.805224:0:198185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787826344.805235:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826344.805252:0:198185:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787826344.805258:0:198185:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8eb343ea0000) has no exports 00000020:00000080:3.0:1787826344.805266:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce723f 00000020:00000080:3.0:1787826344.805275:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb3496ab800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787826344.805688:0:198185:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787826344.805692:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787826344.805696:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975547 gen 5 00000004:00080000:3.0:1787826344.805701:0:198185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787826344.805704:0:198185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826344.805736:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787826344.805745:0:198185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787826344.805752:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7231 00000020:00000080:3.0:1787826344.805756:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb48165c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787826344.805760:0:198185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787826344.805764:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826344.805768:0:198185:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787826344.805770:0:198185:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8eb348ce3370) has no exports 00000020:00000080:3.0:1787826344.805775:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce722a 00000020:00000080:3.0:1787826344.805777:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb34c51f800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787826344.806122:0:198185:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787826344.806126:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787826344.806128:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 5 00000004:00080000:3.0:1787826344.806132:0:198185:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787826344.806134:0:198185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787826344.806155:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787826344.806161:0:198185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787826344.806173:0:198185:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787826344.806179:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce721c 00000020:00000080:3.0:1787826344.806184:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb48165d000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787826344.806187:0:198185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:3.0:1787826344.806191:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787826344.806195:0:198185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787826344.806197:0:198185:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8eb3449f4d28) has no exports 00000020:00000080:3.0:1787826344.806201:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce7215 00000020:00000080:3.0:1787826344.806204:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb48165f800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787826344.806969:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47754c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787826344.806981:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3496ab800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787826344.806987:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3496af000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787826344.806993:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb48165a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787826344.806995:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb48165a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787826344.806999:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787826344.807078:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb48165c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787826344.807083:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c51f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787826344.807087:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb34c51d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787826344.807090:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb477548800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787826344.807092:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb477548800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787826344.807095:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787826344.807124:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb48165d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787826344.807128:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb48165f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787826344.809543:0:198185:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787826344.809552:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826344.809556:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 352187318282 gen 5 00000100:00100000:0.0:1787826344.809565:0:198185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826344.809682:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826344.809700:0:198185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787826344.809737:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826344.809742:0:198185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787826344.809747:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb481227800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787826344.809752:0:198185:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481227800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787826344.809759:0:198185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787826344.809870:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce71f2 00000020:00000080:0.0:1787826344.809877:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb3492c6000/lustre-MDD0001_UUID 00000020:00000080:1.0:1787826344.809900:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb48165c000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787826344.809906:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb481659000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787826344.809908:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481659000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787826344.809913:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787826344.814060:0:198185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787826344.814070:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826344.814082:0:198185:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826344.814087:0:198185:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8eb481783370) has no exports 00000020:00000080:0.0:1787826344.814116:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826344.814122:0:198185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787826344.814127:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce71f9 00000020:00000080:0.0:1787826344.814136:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb3492c1000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787826344.814146:0:198185:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb34df96000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787826344.814149:0:198185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb34df96000 2 00000020:01000004:0.0:1787826344.814153:0:198185:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb34df96000 from lustre-MDT0001 00000020:00000080:0.0:1787826344.814171:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826344.814176:0:198185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787826344.814178:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb342752000/lustre-MDT0001_UUID 00000020:00000080:0.0:1787826344.814181:0:198185:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb342752000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787826344.814192:0:198185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787826344.814278:0:198185:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1787826344.814282:0:198185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787826344.814285:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826344.814292:0:198185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826344.814298:0:198185:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8eb472750000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826344.814303:0:198185:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8eb344e63370) has exports, disconnecting them 00000020:00080000:0.0:1787826344.814307:0:198185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8eb472750000), last request at 1787825987 00000020:00000080:0.0:1787826344.814311:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce728c 00000020:00080000:0.0:1787826344.814344:0:198185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb472750000): rc 0 00000020:00000080:0.0:1787826344.814348:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb472750000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787826344.815042:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3492c6000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787826344.815050:0:185677:0:(genops.c:885:class_export_put()) final put ffff8eb481227000/lustre-MDD0001_UUID 00000020:00000080:1.0:1787826344.815052:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481227000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787826344.815057:0:185677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787826344.815116:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3492c1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787826344.815120:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb472750000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787826344.816174:0:198185:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787826344.816180:0:198185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787826344.816184:0:198185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787826344.816192:0:198185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826344.816218:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb450c26000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787826344.816392:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826344.816416:0:198185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787826344.816421:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb34c993800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787826344.816424:0:198185:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c993800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787826344.816429:0:198185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787826344.816493:0:198185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb34df96000 1 00000020:00000080:1.0:1787826344.816499:0:198185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ce719e 00000020:00000080:1.0:1787826344.816505:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb47bfd7000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787826344.816514:0:198185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787826344.816522:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47bfd7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787826344.816531:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826344.816536:0:198185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787826344.816539:0:198185:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8eb4815f0000) has no exports 00000020:00000080:1.0:1787826345.039995:0:198185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826345.040011:0:198185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787826345.040016:0:198185:0:(genops.c:885:class_export_put()) final put ffff8eb34df97800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787826345.040021:0:198185:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34df97800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787826345.040031:0:198185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787826345.040156:0:198185:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8eb34df90800 00000020:02000400:1.0:1787826345.040218:0:198185:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787826345.819477:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826346.836500:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826347.348688:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826347.348718:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049410176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826347.348742:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049410048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826347.348812:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826347.348876:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410176 00000100:00100000:1.0:1787826347.348883:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826347.348885:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410176 00000100:00100000:1.0:1787826347.348938:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410048 00000100:00100000:1.0:1787826347.348942:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410048 00000100:00100000:0.0:1787826347.348956:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5892 00000100:00100000:3.0:1787826347.348998:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826347.349009:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049410304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826347.349046:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826347.349107:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049410176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826347.349150:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826347.349195:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049410176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 229us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826347.349314:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5893 00000100:00100000:1.0:1787826347.349363:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049410048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826347.349382:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826347.349431:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049410048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826347.349448:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5893 00000100:00100000:1.0:1787826347.349508:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049410048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826347.351639:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5892 00000100:00080000:0.0:1787826347.351710:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826347.351718:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826347.351744:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410304 00000100:00100000:0.0:1787826347.351754:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410304 00000100:00100000:0.0:1787826347.351819:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826347.351828:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1874663049410304:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:0.0:1787826347.351839:0:187909:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787826347.351928:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1874663049410304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (2881us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826347.351935:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826347.352005:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049410176:0@lo:13:osp-pre-0-0.0 00000100:02020000:1.0:1787826347.352903:0:3619:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787826347.370306:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787826347.370318:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787826347.370700:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787826347.370709:0:3619:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826347.370716:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8367 00000100:00080000:1.0:1787826347.370728:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826347.370881:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481230e00 x1874663049410432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826347.370953:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049410432:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787826347.371081:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826347.371183:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410432 00000100:00100000:0.0:1787826347.371194:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410432 00000100:00100000:0.0:1787826347.371255:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826347.371264:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1874663049410432:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787826347.371291:0:187909:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826347.374203:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1874663049410432:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 2925us (3109us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826347.374223:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787826347.374553:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826347.374561:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826347.374565:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049410432:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1787826347.861973:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826348.800714:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826348.800782:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826348.800819:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826348.800849:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826348.800887:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826348.800933:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043034112 00000100:00100000:2.0:1787826348.800947:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043034112 00000100:00100000:3.0:1787826348.801216:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043033984 00000100:00100000:3.0:1787826348.801222:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043033984 00000100:00100000:3.0:1787826348.801288:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 394 00000100:00100000:3.0:1787826348.801302:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2390:x1874663043033984:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:3.0:1787826348.801368:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479842680 x1874663043033984/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:704/0 lens 224/224 e 0 to 0 dl 1787826359 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826348.801448:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2390:x1874663043033984:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 150us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826348.801457:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 394 00000100:00100000:3.0:1787826348.801482:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1178 00000100:00100000:3.0:1787826348.801487:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1874663043034112:12345-192.168.203.47@tcp:400:kworker.0 00000020:00080000:3.0:1787826348.801494:0:187904:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.47@tcp 00000100:00100000:3.0:1787826348.801518:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1874663043034112:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (735us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826348.801524:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1178 00000100:00080000:3.0:1787826348.801549:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826348.801649:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043034368 00000100:00100000:0.0:1787826348.801654:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043034368 00000100:00100000:0.0:1787826348.801704:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043034240 00000100:00100000:0.0:1787826348.801707:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043034240 00000100:00100000:0.0:1787826348.801733:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7149 00000100:00100000:0.0:1787826348.801742:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043034368:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826348.801785:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043034368:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 45us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826348.801793:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7149 00000100:00100000:0.0:1787826348.801808:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7150 00000100:00100000:0.0:1787826348.801815:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043034240:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826348.801841:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043034240:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826348.801847:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7150 00000100:00080000:3.0:1787826348.801957:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826348.801961:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826348.802640:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043033856 00000100:00100000:1.0:1787826348.802647:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043033856 00000100:00100000:1.0:1787826348.802696:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:1.0:1787826348.802705:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34518d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043033856:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826348.802750:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34518d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043033856:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 46us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826348.802757:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:3.0:1787826348.837302:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826348.837900:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043034496 00000100:00100000:2.0:1787826348.837914:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043034496 00000100:00100000:2.0:1787826348.837983:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1179 00000100:00100000:2.0:1787826348.841659:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663043034496:12345-192.168.203.47@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1787826348.841716:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826348.841847:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663043034496:12345-192.168.203.47@tcp:38:ptlrpcd_00_01.0 Request processed in 3851us (4559us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826348.841860:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1179 00010000:00010000:2.0:1787826348.885405:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826348.885630:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826348.885636:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787826348.885640:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826348.885650:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8414 00000100:00080000:3.0:1787826348.885657:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826348.885664:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826348.885690:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46e80ed80 x1874663049411200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826348.885749:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049411200:0@lo:38:kworker.0 00000100:00100000:3.0:1787826348.885837:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826348.886225:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049410944:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.886267:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826348.886296:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049411584:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.886319:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826348.886374:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787826348.886392:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049410816:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.886416:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826348.886593:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410944 00000100:00100000:3.0:1787826348.886604:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410944 00000100:00100000:3.0:1787826348.886667:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049411584 00000100:00100000:3.0:1787826348.886671:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049411584 00000100:00100000:3.0:1787826348.886688:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410816 00000100:00100000:3.0:1787826348.886692:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410816 00000100:00100000:3.0:1787826348.886707:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1787826348.886718:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049410944:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826348.886745:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69dc00 x1874663049410944/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:704/0 lens 224/224 e 0 to 0 dl 1787826359 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826348.886789:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1874663049410944:12345-0@lo:400:kworker.0 Request processed in 73us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826348.886797:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1787826348.886814:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787826348.886820:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049411584:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826348.886832:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69ce00 x1874663049411584/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:704/0 lens 224/224 e 0 to 0 dl 1787826359 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826348.886858:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049411584:12345-0@lo:400:kworker.0 Request processed in 39us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826348.886864:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787826348.886875:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1787826348.886879:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1874663049410816:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787826348.886886:0:188992:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826348.886909:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1874663049410816:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826348.886915:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00080000:3.0:1787826348.886938:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787826348.886990:0:196423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1787826348.887016:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318292 is committed 00000001:00080000:3.0:1787826348.887023:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318291 is committed 00000020:00000080:3.0:1787826348.887029:0:196423:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787826348.887058:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787826348.887125:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb343211000 for lustre-MDT0000 00000100:00100000:3.0:1787826348.887167:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049411200 00000100:00100000:3.0:1787826348.887172:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049411200 00000100:00100000:3.0:1787826348.887193:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787826348.887199:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1874663049411200:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826348.887222:0:187909:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826348.887262:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1874663049411200:12345-0@lo:38:kworker.0 Request processed in 61us (1425us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826348.887268:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787826348.887316:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826348.887347:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826348.887352:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049411200:0@lo:38:kworker.0 00000100:00080000:0.0:1787826348.887623:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826348.887628:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826348.887631:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826348.887636:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826348.887641:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8055 00000100:00080000:0.0:1787826348.887647:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8eb3431bc800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826348.887674:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69ea00 x1874663049411712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826348.887693:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049410816:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.887703:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049411456:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.887737:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826348.887781:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1874663049410944:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.887794:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049411584:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.887823:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049411456 00000100:00100000:0.0:1787826348.887827:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049411456 00000100:00100000:0.0:1787826348.887860:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7151 00000100:00100000:0.0:1787826348.887867:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049411456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.887905:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049411456:12345-0@lo:400:kworker.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826348.887912:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7151 00000100:00100000:0.0:1787826348.887973:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049411456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826348.889183:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049410688:0@lo:400:kworker.0 00000100:00100000:1.0:1787826348.889251:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826348.889297:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049411328:0@lo:400:kworker.0 00000100:00100000:1.0:1787826348.889359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826348.889409:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787826348.889417:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049410560:0@lo:400:kworker.0 00000100:00100000:1.0:1787826348.889524:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826348.889553:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049411072:0@lo:400:kworker.0 00000100:00100000:1.0:1787826348.889580:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826348.889618:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049411328 00000100:00100000:1.0:1787826348.889625:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049411328 00000100:00100000:1.0:1787826348.889674:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7152 00000100:00100000:1.0:1787826348.889684:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049411328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826348.889740:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049411328:12345-0@lo:400:kworker.0 Request processed in 58us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826348.889748:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7152 00000100:00100000:1.0:1787826348.889776:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410560 00000100:00100000:1.0:1787826348.889781:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410560 00000100:00100000:1.0:1787826348.889808:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787826348.889815:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3618:x1874663049410560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826348.889845:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3618:x1874663049410560:12345-0@lo:400:kworker.0 Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826348.889851:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787826348.889890:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410688 00000100:00100000:1.0:1787826348.889895:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410688 00000100:00100000:1.0:1787826348.889936:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049411072 00000100:00100000:1.0:1787826348.889940:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049411072 00000100:00100000:1.0:1787826348.889954:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787826348.889960:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049410688:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826348.889974:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481230e00 x1874663049410688/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:704/0 lens 224/224 e 0 to 0 dl 1787826359 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826348.890123:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1787826348.890130:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874663049411072:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787826348.890138:0:187906:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826348.890272:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049410688:12345-0@lo:400:kworker.0 Request processed in 311us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826348.890279:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00080000:1.0:1787826348.890298:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826348.891406:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049411712:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787826348.891485:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826348.891567:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049411712 00000100:00100000:3.0:1787826348.891575:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049411712 00000100:00100000:3.0:1787826348.891610:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1787826348.891617:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049411712:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1787826348.891645:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826348.891689:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049411712:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 70us (203us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826348.891697:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00080000:3.0:1787826348.891740:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826348.891746:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826348.891750:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049411712:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787826348.895272:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1874663049411072:12345-0@lo:400:kworker.0 Request processed in 5125us (5675us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826348.895292:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1787826348.896764:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049410560:0@lo:400:kworker.0 00000100:00080000:0.0:1787826348.896804:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826348.896810:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826348.896814:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826348.896821:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826348.896826:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8309 00000100:00080000:0.0:1787826348.896837:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8eb341a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826348.896885:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69c380 x1874663049411840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826348.896923:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049411072:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.896946:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049410688:0@lo:400:kworker.0 00000100:00100000:0.0:1787826348.896961:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049411328:0@lo:400:kworker.0 00000100:00100000:3.0:1787826348.898153:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049411840:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787826348.898248:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826348.898443:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049411840 00000100:00100000:1.0:1787826348.898453:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049411840 00000100:00100000:1.0:1787826348.898509:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1787826348.898519:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049411840:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1787826348.898547:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826348.898618:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049411840:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 98us (369us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826348.898625:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00080000:0.0:1787826348.898820:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826348.898826:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826348.898830:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049411840:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1787826349.913090:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787826349.914817:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787826349.914826:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb472756000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787826349.915607:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb472756000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787826349.915658:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb472757800 for lustre-OST0001 00000001:00100000:1.0:1787826349.916721:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787826349.916726:0:194610:0:(genops.c:885:class_export_put()) final put ffff8eb349791800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787826349.916788:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb349791800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787826349.916833:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb44905a800 for lustre-OST0000 00010000:00010000:3.0:1787826350.933938:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826351.956750:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826352.471075:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049411968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826352.471145:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826352.471314:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049411968 00000100:00100000:3.0:1787826352.471360:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049411968 00000100:00100000:3.0:1787826352.471424:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5894 00000100:00100000:3.0:1787826352.471435:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049411968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826352.471464:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826352.471515:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049411968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.471522:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5894 00000100:00100000:3.0:1787826352.471567:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049411968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787826352.471671:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826352.472490:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049412096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826352.472530:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826352.472664:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049412096 00000100:00100000:0.0:1787826352.472670:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049412096 00000100:00100000:0.0:1787826352.472722:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:0.0:1787826352.472731:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049412096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826352.472751:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826352.472801:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049412096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.472807:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00000100:00080000:1.0:1787826352.473067:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826352.473131:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049412096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787826352.981807:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826353.919192:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826353.919242:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826353.919287:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826353.919368:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826353.919396:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826353.919490:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043034752 00000100:00100000:1.0:1787826353.919501:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043034752 00000100:00100000:1.0:1787826353.919580:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043034880 00000100:00100000:1.0:1787826353.919584:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043034880 00000100:00100000:1.0:1787826353.919607:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 398 00000100:00100000:1.0:1787826353.919618:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2392:x1874663043034752:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:1.0:1787826353.919658:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1fe300 x1874663043034752/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:723/0 lens 224/224 e 0 to 0 dl 1787826378 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826353.919716:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2392:x1874663043034752:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 100us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826353.919723:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 398 00000100:00100000:1.0:1787826353.919742:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1184 00000100:00100000:1.0:1787826353.919746:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663043034880:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:1.0:1787826353.919767:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826353.919795:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663043034880:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 46us (398us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826353.919801:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1184 00000100:00080000:3.0:1787826353.920268:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826353.920485:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043035136 00000100:00100000:2.0:1787826353.920491:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043035136 00000100:00100000:2.0:1787826353.920541:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043035008 00000100:00100000:2.0:1787826353.920544:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043035008 00000100:00100000:2.0:1787826353.920580:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7153 00000100:00100000:2.0:1787826353.920589:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043035136:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826353.920631:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043035136:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 44us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826353.920648:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7153 00000100:00100000:2.0:1787826353.920663:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7154 00000100:00100000:2.0:1787826353.920670:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043035008:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826353.920693:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043035008:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826353.920700:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7154 00000100:00100000:0.0:1787826353.921362:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043034624 00000100:00100000:0.0:1787826353.921369:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043034624 00000100:00100000:0.0:1787826353.921417:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 90 00000100:00100000:0.0:1787826353.921424:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043034624:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826353.921466:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043034624:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826353.921472:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 90 00000100:00080000:3.0:1787826353.922176:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826353.922192:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826354.004548:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826354.006411:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826354.006417:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787826354.006421:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826354.006428:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8415 00000100:00080000:3.0:1787826354.006434:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826354.006440:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8eb3431bc800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826354.006463:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e72d80 x1874663049412480/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826354.006507:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826354.006510:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787826354.006512:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826354.006515:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8415 00000100:00080000:3.0:1787826354.006518:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826354.006521:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8eb341a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826354.006532:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e70000 x1874663049412736/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826354.006541:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826354.006545:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787826354.006546:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826354.006549:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8415 00000100:00080000:3.0:1787826354.006551:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826354.006554:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826354.006577:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e73800 x1874663049412864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826354.006617:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049412992:0@lo:400:kworker.0 00000100:00100000:3.0:1787826354.006681:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826354.006744:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826354.006750:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049412608:0@lo:400:kworker.0 00000100:00100000:3.0:1787826354.006776:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826354.006806:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049412608 00000100:00100000:3.0:1787826354.006813:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049412608 00000100:00100000:3.0:1787826354.006860:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787826354.006872:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049412608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.006989:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049412352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.007031:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826354.007052:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049413248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.007072:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826354.007087:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787826354.007093:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049412224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.007121:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826354.007143:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049413120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.007163:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826354.007205:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049412992 00000100:00100000:0.0:1787826354.007210:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049412992 00000100:00100000:0.0:1787826354.007239:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049413120 00000100:00100000:0.0:1787826354.007242:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049413120 00000100:00100000:0.0:1787826354.007262:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7155 00000100:00100000:0.0:1787826354.007269:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049412992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.007314:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049412992:12345-0@lo:400:kworker.0 Request processed in 45us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826354.007320:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7155 00000100:00100000:0.0:1787826354.007370:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7156 00000100:00100000:0.0:1787826354.007377:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049413120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.007410:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049413120:12345-0@lo:400:kworker.0 Request processed in 34us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826354.007419:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7156 00000100:00100000:0.0:1787826354.007461:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049413120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.007483:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049412352 00000100:00100000:0.0:1787826354.007486:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049412352 00000100:00100000:0.0:1787826354.007509:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049413248 00000100:00100000:0.0:1787826354.007512:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049413248 00000100:00100000:0.0:1787826354.007523:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787826354.007529:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049412352:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826354.007541:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69ca80 x1874663049412352/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:724/0 lens 224/224 e 0 to 0 dl 1787826379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826354.007576:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049412352:12345-0@lo:400:kworker.0 Request processed in 46us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826354.007583:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787826354.007595:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1787826354.007601:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049413248:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826354.007612:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69f100 x1874663049413248/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:724/0 lens 224/224 e 0 to 0 dl 1787826379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826354.007637:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049413248:12345-0@lo:400:kworker.0 Request processed in 36us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826354.007643:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1787826354.007669:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049412352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826354.007679:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049413248:0@lo:400:kworker.0 00000100:00080000:0.0:1787826354.007714:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826354.007718:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826354.007721:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826354.007745:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049412992:0@lo:400:kworker.0 00000100:00100000:1.0:1787826354.008126:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049412224 00000100:00100000:1.0:1787826354.008131:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049412224 00000100:00100000:1.0:1787826354.008169:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826354.008176:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3620:x1874663049412224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826354.008232:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3620:x1874663049412224:12345-0@lo:400:kworker.0 Request processed in 57us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826354.008238:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826354.008275:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049412224:0@lo:400:kworker.0 00010000:00000080:3.0:1787826354.008661:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4725e9500 x1874663049412608/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:724/0 lens 224/224 e 0 to 0 dl 1787826379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826354.008707:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049412608:12345-0@lo:400:kworker.0 Request processed in 1838us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826354.008714:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1787826354.008790:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049412480:0@lo:38:kworker.0 00000100:00100000:2.0:1787826354.008826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826354.008857:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049412736:0@lo:38:kworker.0 00000100:00100000:2.0:1787826354.008879:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826354.008913:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049412864:0@lo:38:kworker.0 00000100:00100000:2.0:1787826354.008940:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826354.009253:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049412480 00000100:00100000:2.0:1787826354.009258:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049412480 00000100:00100000:2.0:1787826354.009280:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049412736 00000100:00100000:2.0:1787826354.009283:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049412736 00000100:00100000:2.0:1787826354.009296:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1787826354.009302:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049412480:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826354.009322:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826354.009392:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049412480:12345-0@lo:38:kworker.0 Request processed in 89us (566us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826354.009399:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1787826354.009412:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1787826354.009416:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049412736:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826354.009425:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826354.009448:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049412736:12345-0@lo:38:kworker.0 Request processed in 31us (568us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826354.009453:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1787826354.009480:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049412864 00000100:00100000:2.0:1787826354.009483:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049412864 00000100:00100000:2.0:1787826354.009499:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787826354.009504:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049412864:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826354.009513:0:187910:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826354.009539:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049412864:12345-0@lo:38:kworker.0 Request processed in 34us (599us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826354.009545:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787826354.009586:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826354.009591:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826354.009594:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049412480:0@lo:38:kworker.0 00000100:00080000:2.0:1787826354.009602:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826354.009604:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826354.009607:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049412736:0@lo:38:kworker.0 00000100:00080000:2.0:1787826354.009615:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826354.009618:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826354.009620:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049412864:0@lo:38:kworker.0 00000100:00100000:0.0:1787826354.010307:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049412608:0@lo:400:kworker.0 00010000:00010000:3.0:1787826355.028487:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826356.052870:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826357.076695:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826357.595199:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4725e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049413376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826357.595539:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826357.595609:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049413376 00000100:00100000:3.0:1787826357.595617:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049413376 00000100:00100000:3.0:1787826357.595671:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5896 00000100:00100000:3.0:1787826357.595680:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049413376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826357.595707:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580800 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826357.595750:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049413376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826357.596209:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5896 00000100:00100000:0.0:1787826357.596594:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049413504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826357.596633:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826357.596674:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826357.596684:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049413504 00000100:00100000:0.0:1787826357.596688:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049413504 00000100:00100000:0.0:1787826357.596723:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5897 00000100:00100000:0.0:1787826357.596730:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049413504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826357.596750:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826357.596785:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049413504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826357.596792:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5897 00000100:00080000:0.0:1787826357.596811:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826357.596834:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049413504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826357.597202:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4725e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049413376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787826358.108914:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826359.036574:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826359.036612:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826359.036642:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826359.036665:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826359.036690:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826359.036717:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043035392 00000100:00100000:3.0:1787826359.036726:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043035392 00000100:00100000:3.0:1787826359.036779:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043035520 00000100:00100000:3.0:1787826359.036783:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043035520 00000100:00100000:3.0:1787826359.036806:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 402 00000100:00100000:3.0:1787826359.036817:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043035392:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:3.0:1787826359.036846:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4725e9f80 x1874663043035392/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:715/0 lens 224/224 e 0 to 0 dl 1787826370 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826359.036903:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043035392:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826359.036911:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 402 00000100:00100000:3.0:1787826359.036929:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1187 00000100:00100000:3.0:1787826359.036933:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663043035520:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:3.0:1787826359.036953:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826359.036979:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663043035520:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 44us (337us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826359.036985:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1187 00000100:00100000:0.0:1787826359.037344:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043035264 00000100:00100000:0.0:1787826359.037349:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043035264 00000100:00100000:0.0:1787826359.037384:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 92 00000100:00100000:0.0:1787826359.037392:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34212ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043035264:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826359.037426:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34212ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043035264:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.037432:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 92 00000100:00100000:0.0:1787826359.037461:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043035648 00000100:00100000:0.0:1787826359.037465:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043035648 00000100:00100000:0.0:1787826359.037490:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043035776 00000100:00100000:0.0:1787826359.037493:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043035776 00000100:00100000:0.0:1787826359.037513:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22633 00000100:00100000:0.0:1787826359.037519:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2388:x1874663043035648:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:0.0:1787826359.037537:0:179224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cede87 00000100:00080000:0.0:1787826359.037546:0:179224:0:(import.c:65:import_set_state_nolock()) ffff8eb47f952000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787826359.037581:0:179224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705678 00000100:00100000:0.0:1787826359.037705:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+2:2388:x1874663043035648:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 185us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.037713:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22633 00000100:00100000:0.0:1787826359.037726:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22634 00000100:00100000:0.0:1787826359.037733:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2388:x1874663043035776:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:0.0:1787826359.037743:0:179224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cede8e 00000100:00080000:0.0:1787826359.037749:0:179224:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787826359.037771:0:179224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975547 00000100:00100000:0.0:1787826359.037836:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+2:2388:x1874663043035776:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 103us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.037842:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22634 00000100:00080000:0.0:1787826359.037860:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826359.037863:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826359.037865:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787826359.037962:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826359.038055:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826359.124543:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826359.124809:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826359.124814:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787826359.124818:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826359.124826:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8420 00000100:00080000:0.0:1787826359.124831:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826359.124836:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8eb3431bc800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826359.124856:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69d500 x1874663049413888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826359.124884:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826359.124888:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787826359.124890:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826359.124894:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8420 00000100:00080000:0.0:1787826359.124896:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826359.124900:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8eb341a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826359.124912:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69c380 x1874663049414144/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826359.124920:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826359.124923:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787826359.124936:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826359.124941:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8420 00000100:00080000:0.0:1787826359.124943:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787826359.124947:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826359.124960:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69ea00 x1874663049414272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826359.125006:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049413632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.125067:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125107:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049414528:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.125132:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125165:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787826359.125172:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049413760:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.125199:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125215:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049414656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.125234:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125257:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049413888:0@lo:38:kworker.0 00000100:00100000:0.0:1787826359.125278:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125295:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049414144:0@lo:38:kworker.0 00000100:00100000:0.0:1787826359.125340:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125357:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049414272:0@lo:38:kworker.0 00000100:00100000:0.0:1787826359.125388:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125415:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049414016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.125440:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125457:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826359.125462:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049414400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.125483:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826359.125513:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049413632 00000100:00100000:0.0:1787826359.125520:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049413632 00000100:00100000:0.0:1787826359.125557:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826359.125566:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3619:x1874663049413632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.125612:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3619:x1874663049413632:12345-0@lo:400:kworker.0 Request processed in 46us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.125618:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826359.125648:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049413760 00000100:00100000:0.0:1787826359.125652:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049413760 00000100:00100000:0.0:1787826359.125677:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049414656 00000100:00100000:0.0:1787826359.125681:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049414656 00000100:00100000:0.0:1787826359.125691:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049413888 00000100:00100000:0.0:1787826359.125694:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049413888 00000100:00100000:0.0:1787826359.125702:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049414144 00000100:00100000:0.0:1787826359.125705:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049414144 00000100:00100000:0.0:1787826359.125711:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049414016 00000100:00100000:0.0:1787826359.125713:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049414016 00000100:00100000:0.0:1787826359.125727:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1787826359.125734:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049413760:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826359.125747:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb476e70000 x1874663049413760/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:715/0 lens 224/224 e 0 to 0 dl 1787826370 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826359.125774:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049413760:12345-0@lo:400:kworker.0 Request processed in 40us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.125780:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1787826359.125792:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1787826359.125798:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049414656:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826359.125808:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb476e72d80 x1874663049414656/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:715/0 lens 224/224 e 0 to 0 dl 1787826370 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826359.125833:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049414656:12345-0@lo:400:kworker.0 Request processed in 36us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.125839:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1787826359.125854:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1787826359.125860:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049414016:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826359.125869:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479b40700 x1874663049414016/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:715/0 lens 224/224 e 0 to 0 dl 1787826370 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826359.125898:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049414016:12345-0@lo:400:kworker.0 Request processed in 39us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.125904:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1787826359.125918:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1787826359.125922:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049413888:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826359.125939:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826359.125972:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049413888:12345-0@lo:38:kworker.0 Request processed in 49us (693us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826359.125978:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1787826359.125990:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1787826359.125994:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049414144:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826359.126002:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826359.126023:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049414144:12345-0@lo:38:kworker.0 Request processed in 29us (683us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826359.126028:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1787826359.126051:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049414272 00000100:00100000:0.0:1787826359.126055:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049414272 00000100:00100000:0.0:1787826359.126075:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826359.126080:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049414272:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826359.126090:0:187910:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826359.126115:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049414272:12345-0@lo:38:kworker.0 Request processed in 34us (727us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826359.126120:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826359.126139:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049414528 00000100:00100000:0.0:1787826359.126142:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049414528 00000100:00100000:0.0:1787826359.126165:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049414400 00000100:00100000:0.0:1787826359.126168:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049414400 00000100:00100000:0.0:1787826359.126187:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7157 00000100:00100000:0.0:1787826359.126193:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049414528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.126224:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049414528:12345-0@lo:400:kworker.0 Request processed in 31us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.126231:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7157 00000100:00100000:0.0:1787826359.126243:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7158 00000100:00100000:0.0:1787826359.126249:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049414400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.126273:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049414400:12345-0@lo:400:kworker.0 Request processed in 25us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826359.126278:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7158 00000100:00080000:0.0:1787826359.126297:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826359.126300:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826359.126302:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826359.126370:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049414400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.126382:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049414016:0@lo:400:kworker.0 00000100:00080000:0.0:1787826359.126413:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826359.126418:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826359.126421:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049413888:0@lo:38:kworker.0 00000100:00080000:0.0:1787826359.126428:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826359.126431:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826359.126434:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049414144:0@lo:38:kworker.0 00000100:00080000:0.0:1787826359.126441:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826359.126443:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826359.126446:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049414272:0@lo:38:kworker.0 00000100:00100000:0.0:1787826359.126471:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049413760:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.126483:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049414656:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.126490:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049413632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826359.126500:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049414528:0@lo:400:kworker.0 00010000:00010000:3.0:1787826360.148880:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826361.175478:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826362.196475:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826362.708567:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826362.708590:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049414784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826362.708657:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826362.708730:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049414784 00000100:00100000:3.0:1787826362.708738:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049414784 00000100:00100000:3.0:1787826362.708791:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5898 00000100:00100000:3.0:1787826362.708802:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049414784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826362.708830:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826362.708874:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049414784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826362.708881:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5898 00000100:00080000:3.0:1787826362.708901:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826362.708934:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049414784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826362.713646:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049414912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826362.713716:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826362.713874:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049414912 00000100:00100000:2.0:1787826362.713882:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049414912 00000100:00100000:2.0:1787826362.713955:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5899 00000100:00100000:2.0:1787826362.713967:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049414912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826362.713997:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826362.714045:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049414912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826362.714051:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5899 00000100:00100000:2.0:1787826362.714100:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb343e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049414912:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787826362.715018:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826363.225461:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826364.154692:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826364.154802:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826364.154907:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826364.155261:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043035904 00000100:00100000:2.0:1787826364.155284:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043035904 00000100:00100000:2.0:1787826364.155395:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 94 00000100:00100000:2.0:1787826364.155409:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb342128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663043035904:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826364.155518:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb342128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663043035904:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 111us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.155530:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 94 00000100:00100000:3.0:1787826364.156477:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043036160 00000100:00100000:3.0:1787826364.156551:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043036160 00000100:00100000:3.0:1787826364.156635:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043036032 00000100:00100000:3.0:1787826364.156640:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043036032 00000100:00100000:1.0:1787826364.156707:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 406 00000100:00100000:1.0:1787826364.156721:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2389:x1874663043036032:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:1.0:1787826364.156750:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479b40a80 x1874663043036032/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:720/0 lens 224/224 e 0 to 0 dl 1787826375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826364.156807:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2389:x1874663043036032:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 90us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.156815:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 406 00000100:00100000:1.0:1787826364.156834:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1190 00000100:00100000:1.0:1787826364.156839:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663043036160:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:1.0:1787826364.156866:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826364.156894:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663043036160:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 53us (2218us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826364.156902:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1190 00000100:00080000:2.0:1787826364.156942:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826364.247600:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826364.247609:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787826364.247613:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826364.247626:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8425 00000100:00080000:3.0:1787826364.247632:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826364.247640:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8eb3431bc800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826364.251407:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049415168:0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.251488:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826364.251551:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826364.251559:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049415040:0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.251589:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826364.251641:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049415168 00000100:00100000:2.0:1787826364.251649:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049415168 00000100:00100000:2.0:1787826364.251710:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1787826364.251720:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb343e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049415168:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826364.251745:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb343e57480 x1874663049415168/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:720/0 lens 224/224 e 0 to 0 dl 1787826375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826364.251785:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb343e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049415168:12345-0@lo:400:kworker.0 Request processed in 67us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.251793:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1787826364.251818:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049415040 00000100:00100000:2.0:1787826364.251822:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049415040 00000100:00100000:2.0:1787826364.251847:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787826364.251853:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3620:x1874663049415040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.251884:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3620:x1874663049415040:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.251890:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787826364.251932:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049415040:0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.251946:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049415168:0@lo:400:kworker.0 00000100:00080000:2.0:1787826364.251975:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826364.252278:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c141880 x1874663049415296/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826364.252314:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826364.252318:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787826364.252321:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826364.252343:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8425 00000100:00080000:3.0:1787826364.252348:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826364.252353:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8eb341a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826364.252365:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c142300 x1874663049415552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826364.252373:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826364.252377:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787826364.252378:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826364.252381:0:185677:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8425 00000100:00080000:3.0:1787826364.252384:0:185677:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826364.252387:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826364.252397:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c143800 x1874663049415680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826364.252478:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049415424:0@lo:400:kworker.0 00000100:00100000:3.0:1787826364.252510:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826364.252532:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826364.252538:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049415808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826364.252562:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826364.252585:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826364.252594:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049415808 00000100:00100000:3.0:1787826364.252598:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049415808 00000100:00100000:3.0:1787826364.252638:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7159 00000100:00100000:3.0:1787826364.252645:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049415808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826364.252679:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049415808:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.252685:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7159 00000100:00100000:3.0:1787826364.252716:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049415808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826364.252735:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049415424 00000100:00100000:3.0:1787826364.252739:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049415424 00000100:00100000:3.0:1787826364.252763:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1787826364.252769:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049415424:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826364.252781:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb477f66a00 x1874663049415424/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:720/0 lens 224/224 e 0 to 0 dl 1787826375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826364.252813:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049415424:12345-0@lo:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.252819:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1787826364.252847:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049415424:0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.253319:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049415296:0@lo:38:kworker.0 00000100:00100000:2.0:1787826364.253383:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826364.253406:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049415552:0@lo:38:kworker.0 00000100:00100000:2.0:1787826364.253433:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826364.253453:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049415680:0@lo:38:kworker.0 00000100:00100000:2.0:1787826364.253479:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826364.253512:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049416064:0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.253533:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826364.253550:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826364.253555:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049415936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.253577:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826364.253602:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049415296 00000100:00100000:2.0:1787826364.253606:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049415296 00000100:00100000:2.0:1787826364.253625:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049415552 00000100:00100000:2.0:1787826364.253628:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049415552 00000100:00100000:2.0:1787826364.253639:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049416064 00000100:00100000:2.0:1787826364.253642:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049416064 00000100:00100000:2.0:1787826364.254393:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1787826364.254418:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049416064:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826364.254444:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4815e0700 x1874663049416064/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:720/0 lens 224/224 e 0 to 0 dl 1787826375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826364.254497:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1874663049416064:12345-0@lo:400:kworker.0 Request processed in 96us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.254504:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1787826364.254523:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1787826364.254529:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049415296:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826364.254548:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826364.254583:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049415296:12345-0@lo:38:kworker.0 Request processed in 53us (1202us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826364.254590:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1787826364.254605:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1787826364.254609:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049415552:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826364.254619:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826364.254651:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049415552:12345-0@lo:38:kworker.0 Request processed in 40us (1217us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826364.254669:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1787826364.254699:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049415680 00000100:00100000:2.0:1787826364.254704:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049415680 00000100:00100000:2.0:1787826364.254728:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826364.254732:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049415680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826364.254743:0:187910:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826364.254770:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4815e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049415680:12345-0@lo:38:kworker.0 Request processed in 37us (1291us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826364.254777:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826364.254805:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049415936 00000100:00100000:2.0:1787826364.254809:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049415936 00000100:00100000:2.0:1787826364.254855:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7160 00000100:00100000:2.0:1787826364.254866:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049415936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.254899:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049415936:12345-0@lo:400:kworker.0 Request processed in 38us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.254905:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7160 00000100:00100000:2.0:1787826364.255613:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049415936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826364.255627:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1874663049416064:0@lo:400:kworker.0 00000100:00080000:2.0:1787826364.255677:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826364.255682:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826364.255685:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049415296:0@lo:38:kworker.0 00000100:00080000:2.0:1787826364.255694:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826364.255697:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826364.255700:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049415552:0@lo:38:kworker.0 00000100:00080000:2.0:1787826364.255709:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826364.255712:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826364.255714:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049415680:0@lo:38:kworker.0 00000100:00080000:2.0:1787826364.255738:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826364.255743:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826364.255746:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826365.268496:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787826365.284783:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:3.0:1787826365.284793:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb47f9a7800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:3.0:1787826365.286832:0:185677:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f9a7800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f for lustre-OST0001 00000020:00000080:3.0:1787826365.286900:0:185677:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f7e6800 for lustre-OST0001 00000001:00100000:2.0:1787826365.288860:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:2.0:1787826365.288869:0:194610:0:(genops.c:885:class_export_put()) final put ffff8eb3434f2800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:0.0:1787826365.288931:0:172937:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb3434f2800/c0d7758a-4501-4a89-8ec1-407fef4f0c7f for lustre-OST0000 00000020:00000080:0.0:1787826365.288972:0:172937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f952000 for lustre-OST0000 00010000:00010000:0.0:1787826366.294607:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826367.329300:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826367.828552:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826367.828575:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049416192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826367.828641:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826367.828715:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049416192 00000100:00100000:1.0:1787826367.828722:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049416192 00000100:00100000:1.0:1787826367.828894:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5900 00000100:00100000:1.0:1787826367.828905:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049416192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826367.828935:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826367.829126:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049416192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 222us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826367.829134:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5900 00000100:00080000:1.0:1787826367.829157:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826367.829235:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049416192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826367.835159:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049416320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826367.835231:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826367.837091:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049416320 00000100:00100000:0.0:1787826367.837105:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049416320 00000100:00100000:0.0:1787826367.837200:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:0.0:1787826367.837212:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049416320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826367.837259:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826367.837364:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049416320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826367.837372:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00000100:00100000:0.0:1787826367.837428:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049416320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787826367.837565:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826368.341837:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787826368.942573:0:198804:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787826368.942578:0:198804:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787826368.942950:0:198804:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787826368.943064:0:198804:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8eb349795000 00000020:01000004:0.0:1787826368.943083:0:198804:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787826368.943098:0:198804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787826368.943112:0:198804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8eb46a874d28) 00000020:00000080:0.0:1787826368.943131:0:198804:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1787826369.275816:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826369.275977:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043036288 00000100:00100000:0.0:1787826369.275993:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043036288 00000100:00100000:0.0:1787826369.276066:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:0.0:1787826369.276078:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043036288:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826369.276167:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043036288:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 91us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826369.276174:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:2.0:1787826369.280859:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826369.281291:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043036416 00000100:00100000:0.0:1787826369.281305:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043036416 00000100:00100000:0.0:1787826369.281426:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 410 00000100:00100000:0.0:1787826369.281437:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043036416:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826369.281468:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348ffe680 x1874663043036416/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:725/0 lens 224/224 e 0 to 0 dl 1787826380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826369.281537:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043036416:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 103us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826369.281545:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 410 00000100:00080000:3.0:1787826369.284845:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826369.285578:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826369.285716:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043036544 00000100:00100000:2.0:1787826369.285732:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043036544 00000100:00100000:2.0:1787826369.285798:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1193 00000100:00100000:2.0:1787826369.285807:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2388:x1874663043036544:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:2.0:1787826369.285831:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826369.285926:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2388:x1874663043036544:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 118us (359us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826369.285934:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1193 00000100:00080000:1.0:1787826369.364561:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826369.364568:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826369.364572:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826369.364591:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8431 00000100:00080000:1.0:1787826369.364596:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826369.364603:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8eb3431bc800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826369.364625:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb3427e6d80 x1874663049416704/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826369.364660:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826369.364664:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826369.364666:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826369.364670:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8431 00000100:00080000:1.0:1787826369.364672:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826369.364675:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8eb341a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826369.364690:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348aebb80 x1874663049416960/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826369.364699:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826369.364702:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826369.364703:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826369.364707:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8431 00000100:00080000:1.0:1787826369.364709:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826369.364712:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826369.364724:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb45eb70700 x1874663049417088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826369.364767:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049416832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826369.364832:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826369.364886:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826369.364892:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb45eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049417216:0@lo:400:kworker.0 00000100:00100000:1.0:1787826369.364938:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826369.364977:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049417216 00000100:00100000:1.0:1787826369.364984:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049417216 00000100:00100000:1.0:1787826369.365040:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7161 00000100:00100000:1.0:1787826369.365051:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049417216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826369.365101:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049417216:12345-0@lo:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826369.365111:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7161 00000100:00080000:1.0:1787826369.365133:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826369.365164:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb45eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049417216:0@lo:400:kworker.0 00000100:00100000:3.0:1787826369.366749:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049416448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826369.366810:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826369.366855:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049417344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826369.366882:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826369.366906:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787826369.366913:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049416576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826369.366937:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826369.366956:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049417472:0@lo:400:kworker.0 00000100:00100000:3.0:1787826369.366977:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826369.367005:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049417344 00000100:00100000:3.0:1787826369.367012:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049417344 00000100:00100000:3.0:1787826369.367058:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7162 00000100:00100000:3.0:1787826369.367068:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049417344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826369.367116:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049417344:12345-0@lo:400:kworker.0 Request processed in 51us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826369.367123:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7162 00000100:00080000:3.0:1787826369.367142:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826369.367170:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4774f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049417344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826369.367197:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049416832 00000100:00100000:3.0:1787826369.367201:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049416832 00000100:00100000:3.0:1787826369.367231:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049416576 00000100:00100000:3.0:1787826369.367244:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049416576 00000100:00100000:3.0:1787826369.367263:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049417472 00000100:00100000:3.0:1787826369.367266:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049417472 00000100:00100000:3.0:1787826369.367280:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1787826369.367286:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049416832:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826369.367299:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479939880 x1874663049416832/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:725/0 lens 224/224 e 0 to 0 dl 1787826380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826369.367362:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049416832:12345-0@lo:400:kworker.0 Request processed in 75us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826369.367370:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1787826369.367383:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1787826369.367389:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049416576:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826369.367400:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c142300 x1874663049416576/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:725/0 lens 224/224 e 0 to 0 dl 1787826380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826369.367428:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049416576:12345-0@lo:400:kworker.0 Request processed in 40us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826369.367434:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1787826369.367458:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1787826369.367464:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049417472:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826369.367474:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c141880 x1874663049417472/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:725/0 lens 224/224 e 0 to 0 dl 1787826380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826369.367496:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049417472:12345-0@lo:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826369.367501:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1787826369.367532:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049416832:0@lo:400:kworker.0 00000100:00080000:3.0:1787826369.367548:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826369.367561:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049416576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826369.367569:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049417472:0@lo:400:kworker.0 00010000:00010000:2.0:1787826369.370272:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826369.370306:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb3427e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049416704:0@lo:38:kworker.0 00000100:00100000:2.0:1787826369.370397:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826369.370432:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049416960:0@lo:38:kworker.0 00000100:00100000:2.0:1787826369.370458:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826369.370478:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb45eb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049417088:0@lo:38:kworker.0 00000100:00100000:2.0:1787826369.370505:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826369.370545:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049416704 00000100:00100000:2.0:1787826369.370552:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049416704 00000100:00100000:2.0:1787826369.370579:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049416960 00000100:00100000:2.0:1787826369.370582:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049416960 00000100:00100000:2.0:1787826369.370594:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1787826369.370601:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049416704:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826369.370626:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826369.370669:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049416704:12345-0@lo:38:kworker.0 Request processed in 66us (271us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826369.370676:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1787826369.370691:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1787826369.370695:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049416960:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826369.370705:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826369.370730:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049416960:12345-0@lo:38:kworker.0 Request processed in 34us (272us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826369.370736:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1787826369.370759:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049417088 00000100:00100000:2.0:1787826369.370763:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049417088 00000100:00100000:2.0:1787826369.370783:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826369.370788:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049417088:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826369.370798:0:187910:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826369.370823:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049417088:12345-0@lo:38:kworker.0 Request processed in 34us (318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826369.370830:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787826369.370879:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826369.370885:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826369.370889:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb3427e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049416704:0@lo:38:kworker.0 00000100:00080000:2.0:1787826369.370899:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826369.370902:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826369.370905:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049416960:0@lo:38:kworker.0 00000100:00080000:2.0:1787826369.370913:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826369.370917:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826369.370919:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb45eb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049417088:0@lo:38:kworker.0 00000100:00100000:1.0:1787826369.372727:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049416448 00000100:00100000:1.0:1787826369.372739:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049416448 00000100:00100000:1.0:1787826369.372794:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787826369.372804:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3455d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3619:x1874663049416448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826369.372900:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3455d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3619:x1874663049416448:12345-0@lo:400:kworker.0 Request processed in 98us (6089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826369.372917:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787826369.372970:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049416448:0@lo:400:kworker.0 00100000:10000000:1.0:1787826369.882501:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787826369.883244:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.884201:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787826369.884538:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787826369.885113:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787826369.885364:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787826369.886211:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787826369.887090:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787826369.887810:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787826369.888290:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787826369.889158:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787826369.890486:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787826369.891404:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787826369.891998:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787826369.892496:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.893561:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.894379:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.895306:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.897143:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.897451:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.897656:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.898556:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.899219:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.899542:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.900206:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.901381:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.902498:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.903835:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.905094:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.906050:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.906810:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.914185:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.914689:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.915141:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.915463:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.915831:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.916241:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.916604:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.917470:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.917867:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.918258:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.918575:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.919042:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787826369.919374:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.919857:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787826369.920408:0:198804:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:2.0:1787826369.953769:0:198804:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787826369.954431:0:198804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787826369.954441:0:198804:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787826369.954454:0:198804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x878a5eea00cee6de 00000020:01000004:2.0:1787826369.954461:0:198804:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787826369.954488:0:198804:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787826369.954492:0:198804:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787826369.954498:0:198804:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787826369.954527:0:198804:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787826369.954532:0:198804:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787826369.974283:0:198804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787826369.974365:0:198804:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.147@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787826369.974370:0:198804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787826369.974372:0:198804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787826369.974373:0:198804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826369.974375:0:198804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826369.974376:0:198804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826369.974378:0:198804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826369.974379:0:198804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826369.974381:0:198804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826369.974382:0:198804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826369.974386:0:198804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787826369.974389:0:198804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826369.974390:0:198804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787826369.974391:0:198804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826369.974392:0:198804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826369.974393:0:198804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826369.974395:0:198804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826369.974396:0:198804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826369.974397:0:198804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826369.974397:0:198804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826369.974427:0:198804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787826369.974447:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049417600:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787826369.974520:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826369.975665:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826369.980774:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049417600 00000100:00100000:1.0:1787826369.980986:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049417600 00000100:00100000:1.0:1787826369.981099:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787826369.981111:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:198804:x1874663049417600:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787826369.981160:0:196427:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787826369.981164:0:196427:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787826369.981172:0:196427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787826369.981302:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:198804:x1874663049417600:12345-0@lo:253:mount.lustre.0 Request processed in 193us (6782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826369.981310:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787826369.981423:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049417600:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787826369.981437:0:198804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787826369.981441:0:198804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787826369.981442:0:198804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787826369.981443:0:198804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826369.981444:0:198804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826369.981446:0:198804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826369.981447:0:198804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826369.981448:0:198804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826369.981450:0:198804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826369.981451:0:198804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787826369.981472:0:198804:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb349795000 from lustre-MDT0001 10000000:01000000:0.0:1787826369.981499:0:198804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787826369.981502:0:198804:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787826369.981510:0:198804:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8eb46a873370 local copy 00010000:00010000:0.0:1787826369.981520:0:198804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826369.981611:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049417728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826369.981659:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.001028:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984600 going to sleep for 10 seconds 00000100:00100000:3.0:1787826370.006066:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049417728 00000100:00100000:3.0:1787826370.006083:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049417728 00000100:00100000:3.0:1787826370.009743:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787826370.009757:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:198804:x1874663049417728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826370.010109:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:198804:x1874663049417728:12345-0@lo:501:mount.lustre.0 Request processed in 353us (28447us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787826370.010119:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787826370.010216:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049417728:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787826370.010250:0:198804:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787826370.010278:0:198804:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787826370.010288:0:198804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.010299:0:198804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826370.010364:0:198804:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8eb349795000 10000000:01000000:0.0:1787826370.010370:0:198804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787826370.010376:0:198804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8eb349795000 10000000:01000000:0.0:1787826370.010379:0:198804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787826370.010383:0:198804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb349795000 from 1 10000000:01000000:0.0:1787826370.010386:0:198804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787826370.010415:0:198804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.010423:0:198804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.010432:0:198804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826370.010450:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049417856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826370.010487:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.010521:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.011091:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049417856 00000100:00100000:3.0:1787826370.011099:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049417856 00000100:00100000:3.0:1787826370.011144:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787826370.011153:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:198804:x1874663049417856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826370.011165:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826370.011178:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb441511a00/0x878a5eea00cee6ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee6e5 expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826370.011201:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb441511a00/0x878a5eea00cee6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee6e5 expref: 20 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826370.011213:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb441511a00/0x878a5eea00cee6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee6e5 expref: 20 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826370.011222:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511a00, rc 0) 00000100:00100000:3.0:1787826370.011274:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:198804:x1874663049417856:12345-0@lo:101:mount.lustre.0 Request processed in 122us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.011281:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787826370.011378:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049417856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826370.011392:0:198804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee6ec expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.011401:0:198804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee6ec expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826370.011415:0:198804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787826370.011427:0:198804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee6ec expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.011434:0:198804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee6ec expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826370.011441:0:198804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787826370.011444:0:198804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787826370.011449:0:198804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8eb349795000 10000000:01000000:0.0:1787826370.011452:0:198804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787826370.011455:0:198804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787826370.011457:0:198804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787826370.011472:0:198804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.011480:0:198804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.011487:0:198804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826370.011501:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049417984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826370.011531:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.011556:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049417984 00000100:00100000:0.0:1787826370.011560:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049417984 00000100:00100000:0.0:1787826370.011584:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787826370.011590:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:198804:x1874663049417984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826370.011596:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826370.011605:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34ab18c00/0x878a5eea00cee6fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee6f3 expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.011618:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34ab18c00/0x878a5eea00cee6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee6f3 expref: 21 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.011626:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34ab18c00/0x878a5eea00cee6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee6f3 expref: 21 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.011633:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18c00, rc 0) 00000100:00100000:0.0:1787826370.011670:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049417984:12345-0@lo:101:mount.lustre.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.011676:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787826370.011708:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826370.011721:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049417984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826370.011729:0:198804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee6fa expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.011738:0:198804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee6fa expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826370.012214:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 46 count 46 00000040:00080000:0.0:1787826370.012589:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826370.027207:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:2.0:1787826370.027280:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 136 off8552 00000040:00080000:2.0:1787826370.027295:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 176 off8728 00000040:00080000:2.0:1787826370.027306:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8952 00000040:00080000:2.0:1787826370.027321:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 224 off9176 00000040:00080000:2.0:1787826370.029091:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 120 off9296 00000040:00080000:2.0:1787826370.029106:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 112 off9408 00000040:00080000:2.0:1787826370.029119:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 160 off9568 00000040:00080000:2.0:1787826370.029130:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9792 00000040:00080000:2.0:1787826370.029145:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].10, 224 off10016 00000040:00080000:2.0:1787826370.029161:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].11, 88 off10104 00000040:00080000:2.0:1787826370.029175:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].12, 144 off10248 00000040:00080000:2.0:1787826370.029188:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].13, 152 off10400 00000040:00080000:2.0:1787826370.029200:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].14, 168 off10568 00000040:00080000:2.0:1787826370.029213:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].15, 224 off10792 00000040:00080000:2.0:1787826370.029225:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].16, 224 off11016 00000040:00080000:2.0:1787826370.029249:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].17, 80 off11096 00000040:00080000:2.0:1787826370.029262:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].18, 224 off11320 00000040:00080000:2.0:1787826370.029274:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].19, 224 off11544 00000040:00080000:2.0:1787826370.029285:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].20, 160 off11704 00000040:00080000:2.0:1787826370.029301:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].21, 224 off11928 00000040:00080000:2.0:1787826370.029315:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].22, 224 off12152 00000040:00080000:2.0:1787826370.029356:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].23, 80 off12232 00000040:00080000:2.0:1787826370.029375:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].24, 224 off12456 00000040:00080000:2.0:1787826370.029391:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].25, 224 off12680 00000040:00080000:2.0:1787826370.029402:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].26, 88 off12768 00000040:00080000:2.0:1787826370.029413:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].27, 144 off12912 00000040:00080000:2.0:1787826370.029426:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].28, 152 off13064 00000040:00080000:2.0:1787826370.029439:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].29, 136 off13200 00000040:00080000:2.0:1787826370.029451:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].30, 224 off13424 00000040:00080000:2.0:1787826370.029463:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].31, 224 off13648 00000040:00080000:2.0:1787826370.029476:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].32, 80 off13728 00000040:00080000:2.0:1787826370.029490:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].33, 224 off13952 00000040:00080000:2.0:1787826370.029504:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].34, 224 off14176 00000040:00080000:2.0:1787826370.029516:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].35, 88 off14264 00000040:00080000:2.0:1787826370.029529:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].36, 144 off14408 00000040:00080000:2.0:1787826370.029542:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].37, 152 off14560 00000040:00080000:2.0:1787826370.029555:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].38, 136 off14696 00000040:00080000:2.0:1787826370.029567:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].39, 224 off14920 00000040:00080000:2.0:1787826370.029582:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].40, 224 off15144 00000040:00080000:2.0:1787826370.029595:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].41, 80 off15224 00000040:00080000:2.0:1787826370.029610:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].42, 224 off15448 00000040:00080000:2.0:1787826370.029624:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].43, 224 off15672 00000040:00080000:2.0:1787826370.029652:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].44, 120 off15792 00000040:00080000:2.0:1787826370.029687:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].45, 224 off16016 00000040:00080000:2.0:1787826370.029692:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 45 count 46 00000100:00100000:2.0:1787826370.029841:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049418112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826370.029982:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.030023:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826370.030356:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049418112 00000100:00100000:0.0:1787826370.030364:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049418112 00000100:00100000:0.0:1787826370.030419:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787826370.030429:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049418112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787826370.030560:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049418112:12345-0@lo:501:mount.lustre.0 Request processed in 132us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.030568:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787826370.030690:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049418112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826370.030729:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049418240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826370.030790:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826370.030810:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826370.031015:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049418240 00000100:00100000:1.0:1787826370.031021:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049418240 00000100:00100000:1.0:1787826370.031056:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787826370.031064:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049418240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826370.031153:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049418240:12345-0@lo:503:mount.lustre.0 Request processed in 90us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.031160:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787826370.031359:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c140e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049418240:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826370.031961:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826370.032035:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049418368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826370.032087:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.032237:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45890d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.033771:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049418368 00000100:00100000:3.0:1787826370.034022:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049418368 00000100:00100000:2.0:1787826370.034146:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787826370.034159:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049418368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826370.035439:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049418368:12345-0@lo:502:mount.lustre.0 Request processed in 1278us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.035450:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787826370.036410:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049418368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787826370.036722:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:0.0:1787826370.036758:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 136 off8552 00000040:00080000:0.0:1787826370.036774:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 176 off8728 00000040:00080000:0.0:1787826370.037012:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8952 00000040:00080000:0.0:1787826370.037028:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 224 off9176 00000040:00080000:0.0:1787826370.037040:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 120 off9296 00000040:00080000:0.0:1787826370.037051:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 112 off9408 00000040:00080000:0.0:1787826370.037063:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 160 off9568 00000040:00080000:0.0:1787826370.037074:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9792 00000040:00080000:0.0:1787826370.037084:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10016 00000040:00080000:0.0:1787826370.037097:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 88 off10104 00000040:00080000:0.0:1787826370.037111:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 144 off10248 00000040:00080000:0.0:1787826370.037124:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].13, 152 off10400 00000040:00080000:0.0:1787826370.037137:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].14, 168 off10568 00000040:00080000:0.0:1787826370.037152:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].15, 224 off10792 00000040:00080000:0.0:1787826370.037167:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].16, 224 off11016 00000040:00080000:0.0:1787826370.037181:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].17, 80 off11096 00000040:00080000:0.0:1787826370.037194:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].18, 224 off11320 00000040:00080000:0.0:1787826370.037206:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].19, 224 off11544 00000040:00080000:0.0:1787826370.037219:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].20, 160 off11704 00000040:00080000:0.0:1787826370.037243:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].21, 224 off11928 00000040:00080000:0.0:1787826370.037259:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].22, 224 off12152 00000040:00080000:0.0:1787826370.037273:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].23, 80 off12232 00000040:00080000:0.0:1787826370.037287:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].24, 224 off12456 00000040:00080000:0.0:1787826370.037301:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].25, 224 off12680 00000040:00080000:0.0:1787826370.037314:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].26, 88 off12768 00000040:00080000:1.0:1787826370.037617:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].27, 144 off12912 00000040:00080000:1.0:1787826370.037650:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].28, 152 off13064 00000040:00080000:1.0:1787826370.037667:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].29, 136 off13200 00000040:00080000:1.0:1787826370.037680:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].30, 224 off13424 00000040:00080000:1.0:1787826370.037695:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].31, 224 off13648 00000040:00080000:1.0:1787826370.037708:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].32, 80 off13728 00000040:00080000:1.0:1787826370.037720:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].33, 224 off13952 00000040:00080000:1.0:1787826370.037731:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].34, 224 off14176 00000040:00080000:1.0:1787826370.037742:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].35, 88 off14264 00000040:00080000:1.0:1787826370.037754:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].36, 144 off14408 00000040:00080000:1.0:1787826370.037766:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].37, 152 off14560 00000040:00080000:1.0:1787826370.037795:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].38, 136 off14696 00000040:00080000:1.0:1787826370.037811:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].39, 224 off14920 00000040:00080000:1.0:1787826370.037823:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].40, 224 off15144 00000040:00080000:1.0:1787826370.037835:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].41, 80 off15224 00000040:00080000:1.0:1787826370.038188:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].42, 224 off15448 00000040:00080000:1.0:1787826370.038219:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].43, 224 off15672 00000040:00080000:1.0:1787826370.038248:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].44, 120 off15792 00000100:00100000:1.0:1787826370.038297:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049418496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826370.038414:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.038458:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb480cd33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.038578:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049418496 00000100:00100000:3.0:1787826370.038585:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049418496 00000100:00100000:3.0:1787826370.038720:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787826370.038732:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47277d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049418496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826370.038892:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47277d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049418496:12345-0@lo:502:mount.lustre.0 Request processed in 162us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.038899:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787826370.038984:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049418496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826370.039033:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].45, 224 off16016 00000040:00080000:1.0:1787826370.039042:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787826370.039589:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826370.039600:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826370.039603:0:198808:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787826370.039609:0:198808:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787826370.039612:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826370.039625:0:198808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8eb48145b370) 00000020:00000080:1.0:1787826370.039662:0:198808:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787826370.039669:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787826370.039740:0:198808:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826370.039750:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x878a5eea00cee708 00000020:00000080:1.0:1787826370.039965:0:198808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787826370.039970:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826370.039974:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826370.039976:0:198808:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787826370.039979:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826370.039982:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826370.039983:0:198808:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787826370.039987:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826370.039995:0:198808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8eb4814599b8) 00000020:00000080:1.0:1787826370.040007:0:198808:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787826370.040011:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787826370.040013:0:198808:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787826370.040015:0:198808:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787826370.040021:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826370.040069:0:198808:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb349795000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787826370.040080:0:198808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8eb481458000) 00000020:00000080:1.0:1787826370.040090:0:198808:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787826370.040146:0:198808:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787826370.040151:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x878a5eea00cee71d 00000020:00000080:1.0:1787826370.040253:0:198808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787826370.040261:0:198808:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787826370.040265:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x878a5eea00cee724 00080000:01000000:1.0:1787826370.040270:0:198808:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787826370.040273:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x878a5eea00cee72b 00010000:00010000:2.0:1787826370.112486:0:198808:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:2.0:1787826370.112620:0:198808:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 17179869984 lx: 0 gen 87 00000001:00080000:2.0:1787826370.112803:0:198808:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: c0d7758a-4501-4a89-8ec1-407fef4f0c7f idx: 1 lr: 0 srv lr: 17179869984 lx: 0 gen 86 00000001:00000004:2.0:1787826370.112829:0:198808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 17179869984 00000001:00080000:2.0:1787826370.113063:0:198808:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1787826370.113121:0:198808:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8eb47a62e180: xid 1874663043028224, transno 17179870055, client gen 86, slot idx 0 00000001:00080000:2.0:1787826370.113187:0:198808:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8eb47a62e780: xid 1874663043025152, transno 17179870054, client gen 86, slot idx 1 00000020:00000080:2.0:1787826370.115838:0:198808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787826370.115865:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826370.115874:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.115876:0:198808:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787826370.115880:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826370.115885:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.115886:0:198808:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787826370.115890:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826370.115895:0:198808:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:2.0:1787826370.115919:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826370.115934:0:198808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8eb45eb819b8) 00000020:00000080:2.0:1787826370.115959:0:198808:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787826370.115963:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826370.116034:0:198808:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787826370.116040:0:198808:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787826370.116046:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x878a5eea00cee747 00010000:00080000:2.0:1787826370.116077:0:198808:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb341ac8800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1787826370.120483:0:198808:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:2.0:1787826370.125247:0:198808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787826370.125263:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787826370.125307:0:198808:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787826370.125944:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x878a5eea00cee74e 00000100:00080000:2.0:1787826370.125956:0:198808:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826370.125962:0:198808:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb341ac8800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826370.125994:0:198808:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb348aebb80 x1874663049418624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826370.126067:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049418624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826370.126135:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826370.126199:0:198808:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787826370.126295:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826370.126299:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.126301:0:198808:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787826370.126304:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826370.126307:0:198808:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787826370.126309:0:198808:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826370.126310:0:198808:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826370.126312:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826370.126314:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.126315:0:198808:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826370.126317:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826370.126322:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.126340:0:198808:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787826370.126345:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787826370.126384:0:198808:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787826370.126397:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826370.126401:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.126402:0:198808:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787826370.126404:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826370.126406:0:198808:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787826370.126407:0:198808:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826370.126408:0:198808:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826370.126410:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826370.126412:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.126413:0:198808:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826370.126416:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826370.126419:0:198808:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787826370.126422:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.126424:0:198808:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787826370.126426:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826370.126430:0:198808:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:2.0:1787826370.126451:0:198808:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787826370.126453:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826370.126467:0:198808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8eb45eb80000) 00000020:00000080:2.0:1787826370.126482:0:198808:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787826370.126487:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826370.126548:0:198808:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787826370.126554:0:198808:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787826370.126560:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x878a5eea00cee75c 00010000:00080000:2.0:1787826370.126589:0:198808:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb442c28000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1787826370.126799:0:198808:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000100:00100000:1.0:1787826370.128381:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049418624 00000100:00100000:1.0:1787826370.128393:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049418624 00000100:00100000:1.0:1787826370.128428:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787826370.128436:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049418624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787826370.128464:0:187910:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8436 last 0 00000020:00000080:1.0:1787826370.128502:0:187910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x878a5eea00cee763 00000004:00100000:1.0:1787826370.128520:0:187910:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826370.128608:0:187910:0:(import.c:65:import_set_state_nolock()) ffff8eb45eb95800 : changing import state from RECOVER to FULL 00010000:00000080:1.0:1787826370.128628:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69c000 x1874663049418624/t0(0) o38->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787826390 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000040:01000000:2.0:1787826370.129186:0:198808:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787826370.129218:0:198808:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787826370.129635:0:198808:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 3, last_idx 4 00000040:00080000:2.0:1787826370.130460:0:198808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826370.130486:0:198808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].5, 64 off8512 00000040:00080000:2.0:1787826370.130625:0:198808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 64 off8256 00000100:00100000:1.0:1787826370.133568:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049418624:12345-0@lo:38:llog_process_th.0 Request processed in 5123us (7424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.133582:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:1.0:1787826370.134286:0:198813:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 5 synced_idx: 0 lgh_last_idx: 5 00000040:00080000:1.0:1787826370.134292:0:198813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1787826370.134497:0:198813:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 4, last_idx 5 00000040:00080000:1.0:1787826370.134517:0:198813:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x10:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1787826370.134664:0:198813:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1787826370.134667:0:198813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 5 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787826370.136259:0:198808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787826370.136272:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787826370.136316:0:198808:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787826370.136374:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x878a5eea00cee76a 00000100:00080000:2.0:1787826370.136385:0:198808:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826370.136391:0:198808:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8eb442c28000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826370.136427:0:198808:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481108380 x1874663049418752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826370.136444:0:198808:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787826370.136512:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826370.136517:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.136519:0:198808:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787826370.136522:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826370.136524:0:198808:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787826370.136526:0:198808:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826370.136527:0:198808:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826370.136529:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826370.136531:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.136533:0:198808:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826370.136535:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826370.136540:0:198808:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787826370.136544:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826370.136545:0:198808:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787826370.136548:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826370.136552:0:198808:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:2.0:1787826370.136577:0:198808:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787826370.136580:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826370.136591:0:198808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8eb4815f0000) 00000020:00000080:2.0:1787826370.136605:0:198808:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787826370.136610:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826370.138551:0:198808:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787826370.138562:0:198808:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787826370.138575:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x878a5eea00cee778 00010000:00080000:2.0:1787826370.138615:0:198808:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb46e35a000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1787826370.139103:0:198808:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787826370.139178:0:198808:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787826370.139193:0:198808:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787826370.140091:0:198808:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 3, last_idx 4 00000100:00100000:0.0:1787826370.140500:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826370.140512:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 82 00000100:00080000:0.0:1787826370.140520:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787826370.140526:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787826370.140529:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826370.140585:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049418624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826370.140618:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049418752:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787826370.140699:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787826370.141349:0:198808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826370.141375:0:198808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].5, 64 off8512 00000040:00080000:2.0:1787826370.141496:0:198808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].1, 64 off8256 00000100:00100000:3.0:1787826370.141579:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049418752 00000100:00100000:3.0:1787826370.141587:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049418752 00000100:00100000:3.0:1787826370.141621:0:12319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22635 00000100:00100000:3.0:1787826370.141629:0:12319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3616:x1874663049418752:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787826370.141655:0:12319:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8436 last 0 00000020:00000080:3.0:1787826370.141689:0:12319:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x878a5eea00cee77f 00002000:00100000:3.0:1787826370.141702:0:12319:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8eb47bfd2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787826370.141706:0:12319:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787826370.141709:0:12319:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787826370.141752:0:12319:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787826370.141773:0:12319:0:(import.c:65:import_set_state_nolock()) ffff8eb47bfd1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826370.141831:0:12319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049418752:12345-0@lo:8:llog_process_th.0 Request processed in 201us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.141848:0:12319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22635 00000100:00100000:3.0:1787826370.141891:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826370.141897:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:3.0:1787826370.141903:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787826370.141908:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787826370.141910:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb442c28000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787826370.141922:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787826370.141927:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049418752:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787826370.141975:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049418880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826370.142003:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826370.142035:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049418880 00000100:00100000:3.0:1787826370.142039:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049418880 00000100:00100000:3.0:1787826370.142070:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5902 00000100:00100000:3.0:1787826370.142076:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049418880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826370.142091:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826370.142121:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049418880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.142127:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5902 00000100:00080000:3.0:1787826370.142139:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826370.142160:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049418880:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1787826370.142175:0:198813:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787826370.142211:0:198813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8436968885364ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787826370.142216:0:198813:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000040:00080000:3.0:1787826370.145165:0:198815:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 5 synced_idx: 0 lgh_last_idx: 5 00000040:00080000:3.0:1787826370.145173:0:198815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 4 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1787826370.145396:0:198815:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 4, last_idx 5 00000040:00080000:3.0:1787826370.145419:0:198815:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x12:0x0] at index 4 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1787826370.145549:0:198815:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1787826370.145552:0:198815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x16:0x0] at index 5 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1787826370.146294:0:198805:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787826370.147308:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049419008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826370.147415:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.147540:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049419008 00000100:00100000:2.0:1787826370.147547:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049419008 00000100:00100000:2.0:1787826370.147599:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787826370.147609:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049419008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826370.147649:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:2.0:1787826370.147663:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c141c00 x1874663049419008/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 224/368 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1787826370.147991:0:198808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787826370.148004:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787826370.148046:0:198808:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787826370.148071:0:198808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x878a5eea00cee786 00000100:00080000:0.0:1787826370.148078:0:198808:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826370.148083:0:198808:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8eb46e35a000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826370.148104:0:198808:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69ea00 x1874663049419136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826370.148124:0:198808:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787826370.148205:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826370.148210:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826370.148212:0:198808:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787826370.148215:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826370.148218:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826370.148220:0:198808:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787826370.148223:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787826370.148224:0:198808:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787826370.148226:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826370.148239:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826370.148241:0:198808:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787826370.148244:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787826370.148246:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826370.148248:0:198808:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787826370.148251:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787826370.148283:0:198808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826370.148286:0:198808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826370.148288:0:198808:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787826370.148292:0:198808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 46 count 46 00000020:01000000:1.0:1787826370.148590:0:198804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787826370.148621:0:198804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787826370.148649:0:198804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee6fa expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.148661:0:198804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee6fa expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826370.148669:0:198804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb349795000 from 1 10000000:01000000:1.0:1787826370.148672:0:198804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787826370.148706:0:198804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.148715:0:198804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.148725:0:198804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826370.148740:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826370.148783:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.148826:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826370.148949:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049419264 00000100:00100000:0.0:1787826370.148955:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049419264 00000100:00100000:0.0:1787826370.148989:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787826370.148997:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:198804:x1874663049419264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826370.149008:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826370.149022:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee78d expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.149042:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee78d expref: 22 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.149054:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee78d expref: 22 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826370.149061:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34ab18400, rc 0) 00000100:00100000:0.0:1787826370.149107:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:198804:x1874663049419264:12345-0@lo:101:mount.lustre.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.149113:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787826370.149452:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826370.149468:0:198804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.149476:0:198804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826370.150089:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419392:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787826370.150152:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.150182:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826370.150401:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049419392 00000100:00100000:0.0:1787826370.150407:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049419392 00000100:00100000:0.0:1787826370.150444:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787826370.150452:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:198804:x1874663049419392:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787826370.150469:0:196428:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787826370.150486:0:196428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787826370.150489:0:196428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787826370.150492:0:196428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787826370.150494:0:196428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787826370.150497:0:196428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 339 00000100:00100000:0.0:1787826370.150572:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:198804:x1874663049419392:12345-0@lo:256:mount.lustre.0 Request processed in 121us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.150579:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787826370.150817:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419392:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787826370.151620:0:198804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826370.151653:0:198804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.151664:0:198804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826370.151672:0:198804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb349795000 from 1 10000000:01000000:1.0:1787826370.152051:0:198804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826370.152084:0:198804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.152092:0:198804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.152107:0:198804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826370.152125:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826370.152407:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049419136:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787826370.152466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.154989:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049419008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7378us (7569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.155006:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787826370.155048:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049419136 00000100:00100000:2.0:1787826370.155055:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049419136 00000100:00100000:2.0:1787826370.155088:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22636 00000100:00100000:2.0:1787826370.155094:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3616:x1874663049419136:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1787826370.155124:0:43903:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8436 last 0 00000020:00000080:2.0:1787826370.155164:0:43903:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x878a5eea00cee7a2 00002000:00100000:2.0:1787826370.155178:0:43903:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8eb46e35d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787826370.155182:0:43903:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787826370.155184:0:43903:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787826370.155264:0:43903:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787826370.155289:0:43903:0:(import.c:65:import_set_state_nolock()) ffff8eb47984f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826370.155358:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+6:3616:x1874663049419136:12345-0@lo:8:llog_process_th.0 Request processed in 262us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.155364:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22636 00000100:00100000:2.0:1787826370.155412:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826370.155420:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787826370.155427:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787826370.155432:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787826370.155433:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb46e35a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787826370.155448:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787826370.155453:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049419136:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1787826370.155481:0:198815:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787826370.155529:0:198815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8436982203870ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787826370.155535:0:198815:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787826370.155782:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.155812:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826370.155831:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049419520 00000100:00100000:1.0:1787826370.155972:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049419520 00000100:00100000:1.0:1787826370.156008:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787826370.156015:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:198804:x1874663049419520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826370.156025:0:196427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826370.156043:0:196427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb441356200/0x878a5eea00cee7a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee79b expref: -99 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.156067:0:196427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb441356200/0x878a5eea00cee7a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee79b expref: 23 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.156079:0:196427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb441356200/0x878a5eea00cee7a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee79b expref: 23 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.156087:0:196427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356200, rc 0) 00000100:00100000:1.0:1787826370.156121:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049419520:12345-0@lo:101:mount.lustre.0 Request processed in 107us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.156127:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787826370.156169:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826370.156184:0:198804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7a9 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.156195:0:198804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee7a9 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826370.156423:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 7 count 7 00000100:00100000:3.0:1787826370.157270:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049419008:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787826370.157830:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826370.158535:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049419648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826370.158596:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.158656:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049419648 00000100:00100000:0.0:1787826370.158662:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049419648 00000100:00100000:0.0:1787826370.158726:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5903 00000100:00100000:0.0:1787826370.158734:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049419648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826370.158761:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826370.158806:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049419648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.158813:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5903 00000100:00080000:3.0:1787826370.159025:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826370.159073:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049419648:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1787826370.159288:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:1.0:1787826370.159355:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 112 off8528 00000040:00080000:1.0:1787826370.159373:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 224 off8752 00000040:00080000:1.0:1787826370.159386:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8976 00000040:00080000:1.0:1787826370.159399:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 112 off9088 00000040:00080000:1.0:1787826370.159421:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 224 off9312 00000040:00080000:1.0:1787826370.159427:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 6 count 7 00000100:00100000:1.0:1787826370.159516:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826370.159553:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.159585:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.159683:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049419776 00000100:00100000:3.0:1787826370.159689:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049419776 00000100:00100000:3.0:1787826370.159728:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787826370.159736:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049419776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826370.159863:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049419776:12345-0@lo:501:mount.lustre.0 Request processed in 128us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.159870:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787826370.160402:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826370.160438:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826370.160485:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.160511:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34925ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826370.160572:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049419904 00000100:00100000:0.0:1787826370.160576:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049419904 00000100:00100000:0.0:1787826370.160608:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787826370.160615:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4771a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049419904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826370.160722:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4771a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049419904:12345-0@lo:503:mount.lustre.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.160728:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787826370.161217:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049419904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787826370.162002:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826370.162080:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826370.162155:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.162242:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458904300 going to sleep for 11 seconds 00000004:00080000:2.0:1787826370.164698:0:198805:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787826370.165076:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049420032 00000100:00100000:3.0:1787826370.165087:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049420032 00000100:00100000:3.0:1787826370.165171:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787826370.165182:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049420032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826370.165412:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049420032:12345-0@lo:502:mount.lustre.0 Request processed in 232us (3256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.165420:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787826370.165545:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826370.165809:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:1.0:1787826370.165861:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 112 off8528 00000040:00080000:1.0:1787826370.165880:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 224 off8752 00000040:00080000:1.0:1787826370.165895:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8976 00000040:00080000:1.0:1787826370.165910:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 112 off9088 00000100:00100000:1.0:1787826370.165940:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826370.165985:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.166905:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb458904300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826370.167096:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049420160 00000100:00100000:0.0:1787826370.167104:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049420160 00000100:00100000:0.0:1787826370.167313:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787826370.167375:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049420160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826370.167510:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049420160:12345-0@lo:502:mount.lustre.0 Request processed in 187us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.167517:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787826370.167626:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826370.167964:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 224 off9312 00000040:00080000:1.0:1787826370.167978:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1787826370.170592:0:198817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826370.170608:0:198817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826370.170610:0:198817:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787826370.170618:0:198817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb349795000 00000020:00000080:3.0:1787826370.170621:0:198817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787826370.170771:0:198817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826370.170776:0:198817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826370.170777:0:198817:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787826370.170780:0:198817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826370.170782:0:198817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826370.170784:0:198817:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787826370.170787:0:198817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb349795000 00000020:00000080:3.0:1787826370.170789:0:198817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787826370.171025:0:198817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826370.171030:0:198817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826370.171031:0:198817:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787826370.171036:0:198817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 7 count 7 00000020:01000000:1.0:1787826370.171314:0:198804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1787826370.171367:0:198804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826370.171395:0:198804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7a9 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.171407:0:198804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7a9 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826370.171459:0:198804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787826370.171463:0:198804:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8eb349795000 10000000:01000000:1.0:1787826370.171466:0:198804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8eb349795000 10000000:01000000:1.0:1787826370.171470:0:198804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787826370.171475:0:198804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb349795000 from 1 10000000:01000000:1.0:1787826370.171477:0:198804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787826370.171514:0:198804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.171523:0:198804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.171533:0:198804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826370.171557:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787826370.171621:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.172244:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049420288 00000100:00100000:1.0:1787826370.172255:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049420288 00000100:00100000:1.0:1787826370.172310:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787826370.172321:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:198804:x1874663049420288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826370.172357:0:196434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826370.172373:0:196434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb441356c00/0x878a5eea00cee7b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee7b0 expref: -99 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.172399:0:196434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb441356c00/0x878a5eea00cee7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee7b0 expref: 24 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.172409:0:196434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb441356c00/0x878a5eea00cee7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee7b0 expref: 24 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.172418:0:196434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356c00, rc 0) 00000100:00100000:1.0:1787826370.172458:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420288:12345-0@lo:101:mount.lustre.0 Request processed in 138us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.172464:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787826370.172511:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4589040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826370.172530:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826370.172543:0:198804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7b7 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.172553:0:198804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee7b7 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826370.173028:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 52 count 51 00000040:00080000:1.0:1787826370.174363:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826370.174578:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1787826370.174607:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 120 off8536 00000040:00080000:1.0:1787826370.174622:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 168 off8704 00000040:00080000:1.0:1787826370.174990:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8928 00000040:00080000:1.0:1787826370.175010:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9152 00000040:00080000:1.0:1787826370.175025:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 120 off9272 00000040:00080000:1.0:1787826370.175037:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 168 off9440 00000040:00080000:1.0:1787826370.175051:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9664 00000040:00080000:1.0:1787826370.175065:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:1.0:1787826370.176803:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 120 off10008 00000040:00080000:1.0:1787826370.176832:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 224 off10232 00000040:00080000:1.0:1787826370.178283:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 224 off10456 00000040:00080000:1.0:1787826370.178364:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].13, 88 off10544 00000040:00080000:1.0:1787826370.178384:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].14, 128 off10672 00000040:00080000:1.0:1787826370.178399:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].15, 144 off10816 00000040:00080000:1.0:1787826370.178415:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].16, 160 off10976 00000040:00080000:1.0:1787826370.178427:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].17, 224 off11200 00000040:00080000:1.0:1787826370.178439:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].18, 224 off11424 00000040:00080000:1.0:1787826370.178451:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].19, 80 off11504 00000040:00080000:1.0:1787826370.178466:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].20, 224 off11728 00000040:00080000:1.0:1787826370.178479:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].21, 224 off11952 00000040:00080000:1.0:1787826370.178493:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].22, 88 off12040 00000040:00080000:1.0:1787826370.178507:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].23, 128 off12168 00000040:00080000:1.0:1787826370.178523:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].24, 144 off12312 00000040:00080000:1.0:1787826370.178538:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].25, 160 off12472 00000040:00080000:1.0:1787826370.178553:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].26, 224 off12696 00000040:00080000:1.0:1787826370.178569:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].27, 224 off12920 00000040:00080000:1.0:1787826370.178585:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].28, 80 off13000 00000040:00080000:1.0:1787826370.178600:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].29, 224 off13224 00000040:00080000:1.0:1787826370.178615:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].30, 224 off13448 00000040:00080000:1.0:1787826370.178639:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].31, 88 off13536 00000040:00080000:1.0:1787826370.178658:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].32, 128 off13664 00000040:00080000:1.0:1787826370.180097:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].33, 144 off13808 00000040:00080000:1.0:1787826370.180161:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].34, 128 off13936 00000040:00080000:1.0:1787826370.180178:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].35, 224 off14160 00000040:00080000:1.0:1787826370.180191:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].36, 224 off14384 00000040:00080000:1.0:1787826370.180203:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].37, 80 off14464 00000040:00080000:1.0:1787826370.180217:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].38, 224 off14688 00000040:00080000:1.0:1787826370.180243:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].39, 224 off14912 00000040:00080000:1.0:1787826370.180258:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].40, 88 off15000 00000040:00080000:1.0:1787826370.180272:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].41, 128 off15128 00000040:00080000:1.0:1787826370.180289:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].42, 144 off15272 00000040:00080000:1.0:1787826370.180302:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].43, 128 off15400 00000040:00080000:1.0:1787826370.180314:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].44, 224 off15624 00000040:00080000:1.0:1787826370.180341:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].45, 224 off15848 00000040:00080000:1.0:1787826370.180355:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].46, 80 off15928 00000040:00080000:1.0:1787826370.180366:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].47, 224 off16152 00000040:00080000:1.0:1787826370.180379:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].48, 232 off16384 00000040:00080000:1.0:1787826370.180548:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].49, 224 off16608 00000040:00080000:1.0:1787826370.180569:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].50, 120 off16728 00000040:00080000:1.0:1787826370.180587:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].51, 224 off16952 00000040:00080000:1.0:1787826370.180592:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 51 count 51 00000100:00100000:1.0:1787826370.183093:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826370.183180:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.183268:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.186585:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049420416 00000100:00100000:3.0:1787826370.186601:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049420416 00000100:00100000:2.0:1787826370.188589:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787826370.188603:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826370.195614:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420416:12345-0@lo:501:mount.lustre.0 Request processed in 7004us (12424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.195639:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787826370.196847:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826370.197265:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826370.197404:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.197955:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.200027:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049420544 00000100:00100000:3.0:1787826370.200040:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049420544 00000100:00100000:1.0:1787826370.203960:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787826370.203974:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826370.204147:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420544:12345-0@lo:503:mount.lustre.0 Request processed in 175us (6742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.204154:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787826370.204259:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787826370.206266:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826370.206380:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787826370.206456:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.208832:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4589040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.209073:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049420672 00000100:00100000:3.0:1787826370.209083:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049420672 00000100:00100000:3.0:1787826370.209465:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787826370.209477:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826370.209666:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420672:12345-0@lo:502:mount.lustre.0 Request processed in 190us (3209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.209682:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787826370.210026:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826370.210286:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:1.0:1787826370.210320:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 120 off8536 00000040:00080000:1.0:1787826370.210359:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 168 off8704 00000040:00080000:1.0:1787826370.210372:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8928 00000040:00080000:1.0:1787826370.210385:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9152 00000040:00080000:1.0:1787826370.210397:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 120 off9272 00000040:00080000:1.0:1787826370.210409:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 168 off9440 00000040:00080000:1.0:1787826370.210421:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9664 00000040:00080000:1.0:1787826370.210432:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:1.0:1787826370.210447:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 120 off10008 00000040:00080000:1.0:1787826370.210459:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 224 off10232 00000040:00080000:1.0:1787826370.210471:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 224 off10456 00000040:00080000:1.0:1787826370.210484:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].13, 88 off10544 00000040:00080000:1.0:1787826370.210496:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].14, 128 off10672 00000040:00080000:1.0:1787826370.210508:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].15, 144 off10816 00000040:00080000:1.0:1787826370.210521:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].16, 160 off10976 00000040:00080000:1.0:1787826370.210533:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].17, 224 off11200 00000040:00080000:1.0:1787826370.210546:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].18, 224 off11424 00000040:00080000:1.0:1787826370.210559:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].19, 80 off11504 00000040:00080000:1.0:1787826370.210573:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].20, 224 off11728 00000040:00080000:1.0:1787826370.210586:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].21, 224 off11952 00000040:00080000:1.0:1787826370.210599:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].22, 88 off12040 00000040:00080000:1.0:1787826370.210611:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].23, 128 off12168 00000040:00080000:1.0:1787826370.210624:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].24, 144 off12312 00000040:00080000:1.0:1787826370.212250:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].25, 160 off12472 00000040:00080000:1.0:1787826370.212297:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].26, 224 off12696 00000040:00080000:1.0:1787826370.212311:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].27, 224 off12920 00000040:00080000:1.0:1787826370.212355:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].28, 80 off13000 00000040:00080000:1.0:1787826370.212375:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].29, 224 off13224 00000040:00080000:1.0:1787826370.212391:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].30, 224 off13448 00000040:00080000:1.0:1787826370.212409:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].31, 88 off13536 00000040:00080000:1.0:1787826370.213785:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].32, 128 off13664 00000040:00080000:1.0:1787826370.213844:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].33, 144 off13808 00000040:00080000:1.0:1787826370.214131:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].34, 128 off13936 00000040:00080000:1.0:1787826370.214149:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].35, 224 off14160 00000040:00080000:1.0:1787826370.214164:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].36, 224 off14384 00000040:00080000:1.0:1787826370.214178:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].37, 80 off14464 00000040:00080000:1.0:1787826370.214191:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].38, 224 off14688 00000040:00080000:1.0:1787826370.214204:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].39, 224 off14912 00000040:00080000:1.0:1787826370.214219:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].40, 88 off15000 00000040:00080000:1.0:1787826370.214245:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].41, 128 off15128 00000040:00080000:1.0:1787826370.214261:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].42, 144 off15272 00000040:00080000:1.0:1787826370.214275:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].43, 128 off15400 00000040:00080000:1.0:1787826370.214289:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].44, 224 off15624 00000040:00080000:1.0:1787826370.214304:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].45, 224 off15848 00000040:00080000:1.0:1787826370.214316:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].46, 80 off15928 00000040:00080000:1.0:1787826370.214484:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].47, 224 off16152 00000040:00080000:1.0:1787826370.214500:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].48, 232 off16384 00000100:00100000:1.0:1787826370.214558:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826370.214792:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.214887:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4589040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.220314:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049420800 00000100:00100000:2.0:1787826370.220472:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049420800 00000100:00100000:2.0:1787826370.220666:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787826370.220684:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787826370.221094:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420800:12345-0@lo:502:mount.lustre.0 Request processed in 418us (6302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.221104:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787826370.221383:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787826370.221603:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].49, 224 off16608 00000040:00080000:1.0:1787826370.221631:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].50, 120 off16728 00000100:00100000:1.0:1787826370.221665:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787826370.221722:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826370.225404:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049420928 00000100:00100000:3.0:1787826370.225423:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049420928 00000100:00100000:1.0:1787826370.225440:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481d20d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.225970:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787826370.225983:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787826370.226193:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049420928:12345-0@lo:502:mount.lustre.0 Request processed in 213us (4470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.226202:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787826370.226225:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049420928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787826370.226358:0:198804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].51, 224 off16952 00000040:00080000:2.0:1787826370.226373:0:198804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787826370.228223:0:198820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787826370.228253:0:198820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8eb344e64d28) 00000020:00000080:3.0:1787826370.228279:0:198820:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787826370.228401:0:198820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb349795000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787826370.228406:0:198820:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb349795000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787826370.228409:0:198820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb349795000 3 00010000:00080000:3.0:1787826370.228439:0:198820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb47f7e6800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1787826370.235027:0:198820:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:3.0:1787826370.235257:0:198820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787826370.235305:0:198820:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787826370.235319:0:198820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x878a5eea00cee7c5 00000100:00080000:3.0:1787826370.235352:0:198820:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826370.235358:0:198820:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb47f7e6800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826370.235393:0:198820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb479938000 x1874663049421056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826370.235418:0:198820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787826370.237901:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826370.237908:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826370.237912:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826370.237921:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8436 00000100:00080000:1.0:1787826370.237925:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826370.237931:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8eb3431bc800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826370.237953:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb469f74700 x1874663049421312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826370.237981:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826370.237985:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826370.237986:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826370.237989:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8436 00000100:00080000:1.0:1787826370.237991:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826370.237994:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8eb341a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826370.238005:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb469f74380 x1874663049421568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826370.238013:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826370.238016:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826370.238018:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826370.238021:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8436 00000100:00080000:1.0:1787826370.238024:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826370.238028:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826370.238038:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb469f75500 x1874663049421696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826370.238103:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049421440:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.238168:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.238204:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049422208:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.238243:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.238268:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787826370.238273:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049421824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.238300:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.238319:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049422336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.238367:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.238402:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049421440 00000100:00100000:1.0:1787826370.238409:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049421440 00000100:00100000:1.0:1787826370.238456:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1787826370.238465:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049421440:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826370.238486:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f76300 x1874663049421440/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:726/0 lens 224/224 e 0 to 0 dl 1787826381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826370.238525:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049421440:12345-0@lo:400:kworker.0 Request processed in 61us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.238533:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1787826370.238557:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049422208 00000100:00100000:1.0:1787826370.238561:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049422208 00000100:00100000:1.0:1787826370.238586:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787826370.238592:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049422208:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826370.238606:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f77100 x1874663049422208/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 224/224 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826370.238633:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049422208:12345-0@lo:400:kworker.0 Request processed in 42us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.238639:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787826370.238657:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049421824 00000100:00100000:1.0:1787826370.238661:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049421824 00000100:00100000:1.0:1787826370.238697:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049422336 00000100:00100000:1.0:1787826370.238700:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049422336 00000100:00100000:1.0:1787826370.238720:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7163 00000100:00100000:1.0:1787826370.238726:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049421824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.238754:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049421824:12345-0@lo:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.238760:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7163 00000100:00100000:1.0:1787826370.238770:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7164 00000100:00100000:1.0:1787826370.238775:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049422336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.238799:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049422336:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.238804:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7164 00000100:00100000:1.0:1787826370.238954:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049421952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.238981:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.238999:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049422464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239022:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.239044:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787826370.239050:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049421184:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239071:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.239086:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049422080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239106:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.239130:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049421952 00000100:00100000:1.0:1787826370.239133:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049421952 00000100:00100000:1.0:1787826370.239156:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049422464 00000100:00100000:1.0:1787826370.239159:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049422464 00000100:00100000:1.0:1787826370.239175:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7165 00000100:00100000:1.0:1787826370.239181:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049421952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239215:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049421952:12345-0@lo:400:kworker.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.239221:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7165 00000100:00100000:1.0:1787826370.239244:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7166 00000100:00100000:1.0:1787826370.239250:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049422464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239274:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049422464:12345-0@lo:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.239279:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7166 00000100:00100000:1.0:1787826370.239312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049421824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239342:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049422336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239355:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049421440:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239364:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049422208:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239398:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049421952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.239406:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049422464:0@lo:400:kworker.0 00000100:00100000:0.0:1787826370.239662:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049421056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826370.239708:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.239734:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049421312:0@lo:38:kworker.0 00000100:00100000:0.0:1787826370.239754:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.239767:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049421568:0@lo:38:kworker.0 00000100:00100000:0.0:1787826370.239785:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.239795:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049421696:0@lo:38:kworker.0 00000100:00100000:0.0:1787826370.239834:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.239876:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049421184 00000100:00100000:0.0:1787826370.239880:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049421184 00000100:00100000:0.0:1787826370.239902:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049422080 00000100:00100000:0.0:1787826370.239905:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049422080 00000100:00100000:0.0:1787826370.239916:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049421056 00000100:00100000:0.0:1787826370.239918:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049421056 00000100:00100000:0.0:1787826370.239925:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049421312 00000100:00100000:0.0:1787826370.239927:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049421312 00000100:00100000:0.0:1787826370.239934:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049421568 00000100:00100000:0.0:1787826370.239936:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049421568 00000100:00100000:0.0:1787826370.239944:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787826370.239949:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049421184:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826370.239964:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb45eb70700 x1874663049421184/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:726/0 lens 224/224 e 0 to 0 dl 1787826381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826370.239996:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049421184:12345-0@lo:400:kworker.0 Request processed in 47us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.240002:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787826370.240017:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1787826370.240024:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049422080:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826370.240036:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb45eb72300 x1874663049422080/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:726/0 lens 224/224 e 0 to 0 dl 1787826381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826370.240061:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049422080:12345-0@lo:400:kworker.0 Request processed in 38us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.240067:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1787826370.240079:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1787826370.240083:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049421056:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787826370.240104:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 8437 last 0 00000020:00000080:0.0:1787826370.240137:0:187906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x878a5eea00cee7cc 00000004:00100000:0.0:1787826370.240151:0:187906:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826370.240181:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb34df97800 : changing import state from RECOVER to FULL 00010000:00000080:0.0:1787826370.240196:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69d500 x1874663049421056/t0(0) o38->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787826390 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826370.240225:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874663049421056:12345-0@lo:38:llog_process_th.0 Request processed in 140us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826370.240242:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1787826370.240254:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1787826370.240258:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049421312:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787826370.240286:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049421312:12345-0@lo:38:kworker.0 Request processed in 27us (531us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787826370.240292:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1787826370.240308:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1787826370.240311:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049421568:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787826370.240361:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049421568:12345-0@lo:38:kworker.0 Request processed in 48us (575us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787826370.240370:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1787826370.240396:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826370.240403:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 82 00000100:00080000:0.0:1787826370.240409:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787826370.240414:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787826370.240416:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826370.240421:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049421056:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787826370.240429:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826370.240433:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826370.240435:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049421312:0@lo:38:kworker.0 00000100:00080000:0.0:1787826370.240442:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826370.240445:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826370.240448:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049421568:0@lo:38:kworker.0 00000040:00080000:3.0:1787826370.241078:0:198820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 52 count 51 00000020:01000000:2.0:1787826370.242566:0:198804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787826370.242623:0:198804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826370.242648:0:198804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7b7 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.242660:0:198804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7b7 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826370.242731:0:198804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787826370.242733:0:198804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787826370.242734:0:198804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826370.242735:0:198804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826370.242737:0:198804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826370.242739:0:198804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826370.242740:0:198804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826370.242742:0:198804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826370.242743:0:198804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826370.242747:0:198804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787826370.242749:0:198804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826370.242751:0:198804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787826370.242751:0:198804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826370.242753:0:198804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826370.242754:0:198804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826370.242755:0:198804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826370.242756:0:198804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826370.242757:0:198804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826370.242758:0:198804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826370.242786:0:198804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787826370.242804:0:198804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049422592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826370.242878:0:198804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.242913:0:198804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34dc47600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.244698:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049422592 00000100:00100000:2.0:1787826370.244710:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049422592 00000100:00100000:2.0:1787826370.244760:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787826370.244771:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:198804:x1874663049422592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826370.244801:0:196434:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787826370.244812:0:196434:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787826370.245076:0:196423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787826370.245096:0:196434:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826370.245105:0:196434:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787826370.245115:0:196432:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826370.245119:0:196432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826370.245137:0:196432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245153:0:196432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 24 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245164:0:196432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 9 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245170:0:196432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee78d expref: 24 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245177:0:196432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245208:0:196432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cee78d expref: 24 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245221:0:196432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00cee78d expref: 24 pid: 196427 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826370.245247:0:196432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196432:1874663049422720:0@lo:104: 00000100:00100000:2.0:1787826370.245303:0:196432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826370.245366:0:196432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 9 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245375:0:196432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 9 pid: 196434 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826370.245384:0:196432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196432:1874663049422848:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826370.245438:0:196432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 24 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245446:0:196432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 24 pid: 196428 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826370.245453:0:196432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196432:1874663049422976:0@lo:104: 00000100:00100000:2.0:1787826370.245471:0:196432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.245487:0:196432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34dc47a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.245504:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049422720 00000100:00100000:2.0:1787826370.245508:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049422720 00000100:00100000:2.0:1787826370.245536:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049422976 00000100:00100000:2.0:1787826370.245539:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049422976 00000100:00100000:2.0:1787826370.245551:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4777 00000100:00100000:2.0:1787826370.245557:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+4:196432:x1874663049422720:12345-0@lo:104: 00010000:00010000:2.0:1787826370.245568:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245616:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826370.245621:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+4:196432:x1874663049422720:12345-0@lo:104: Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.245628:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4777 00000100:00100000:2.0:1787826370.245644:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4778 00000100:00100000:2.0:1787826370.245649:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:196432:x1874663049422976:12345-0@lo:104: 00010000:00010000:2.0:1787826370.245658:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245690:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787826370.245695:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:196432:x1874663049422976:12345-0@lo:104: Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.245701:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4778 00010000:00010000:2.0:1787826370.245820:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826370.245826:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245834:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826370.245838:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245846:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826370.245853:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826370.245858:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826370.245889:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245895:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826370.245910:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245916:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb441357600/0x878a5eea00cee78d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cee794 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245928:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826370.245931:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245937:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1787826370.245940:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245951:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826370.245957:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826370.245962:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826370.245974:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.245979:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826370.245994:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.246001:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38400/0x878a5eea00cedb77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cedb7e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.246013:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826370.246015:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826370.246016:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826370.246022:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826370.246038:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049423104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826370.246065:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.246094:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049423232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826370.246117:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.246143:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049423104 00000100:00100000:2.0:1787826370.246147:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049423104 00010000:00010000:2.0:1787826370.246162:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cee78d expref: 25 pid: 196427 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826370.246179:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049423232 00000100:00100000:2.0:1787826370.246182:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049423232 00010000:00010000:2.0:1787826370.246190:0:9496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 26 pid: 196428 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826370.246204:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12233 00000100:00100000:2.0:1787826370.246209:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+26:3620:x1874663049423104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826370.246219:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826370.246223:0:9496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cee78d expref: 26 pid: 196427 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826370.246318:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049421696 00000100:00100000:1.0:1787826370.246346:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049421696 00000100:00100000:1.0:1787826370.246366:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826370.246371:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049421696:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787826370.246421:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049421696:12345-0@lo:38:kworker.0 Request processed in 49us (6586us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826370.246428:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787826370.246462:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049421184:0@lo:400:kworker.0 00000100:00100000:1.0:1787826370.246474:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049422080:0@lo:400:kworker.0 00000100:00080000:1.0:1787826370.246508:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826370.246512:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787826370.246516:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049421696:0@lo:38:kworker.0 00000100:00100000:1.0:1787826370.254667:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826370.254697:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043036672 00000100:00100000:1.0:1787826370.254705:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043036672 00010000:00010000:1.0:1787826370.254740:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 10 pid: 196434 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826370.254772:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12234 00000100:00100000:1.0:1787826370.254782:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+26:3617:x1874663049423232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826370.254796:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826370.254801:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 26 pid: 196428 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.254813:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 26 pid: 196428 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.254837:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826370.254898:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+26:3617:x1874663049423232:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (8779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.254906:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12234 00000100:00100000:1.0:1787826370.254924:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12235 00000100:00100000:1.0:1787826370.254931:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043036672:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826370.254940:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826370.254944:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 10 pid: 196434 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.254954:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 10 pid: 196434 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826370.254965:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826370.255011:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043036672:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.255019:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12235 00000100:00100000:3.0:1787826370.256455:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049423232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826370.257214:0:9496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00cee78d expref: 25 pid: 196427 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257416:0:9496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257426:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826370.257445:0:9496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012326912s 00010000:00010000:2.0:1787826370.257450:0:9496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257458:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257465:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257476:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257483:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826370.257487:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257495:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257504:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257514:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826370.257587:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+25:3620:x1874663049423104:12345-0@lo:103:ldlm_bl.0 Request processed in 11376us (11520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.257597:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12233 00010000:00010000:2.0:1787826370.257669:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34ab18400/0x878a5eea00cee794 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cee78d expref: 24 pid: 196427 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826370.257680:0:196432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46ea69180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196432:1874663049422720:0@lo:104: 00010000:00010000:2.0:1787826370.257695:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64a00/0x878a5eea00cedc50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f22e expref: 9 pid: 196434 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826370.257704:0:196432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196432:1874663049422848:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826370.257715:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cedb7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cedb77 expref: 23 pid: 196428 timeout: 8537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826370.257731:0:196432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196432:1874663049422976:0@lo:104: 00010000:00010000:2.0:1787826370.257751:0:196432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257761:0:196432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257767:0:196432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826370.257774:0:196432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481715c00/0x878a5eea00cee7d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826370.257994:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049423104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826370.262706:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:198804:x1874663049422592:12345-0@lo:253:mount.lustre.0 Request processed in 17929us (19820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.262721:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787826370.263130:0:198804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481108380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:198804:1874663049422592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787826370.263160:0:198804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787826370.263163:0:198804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787826370.263165:0:198804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787826370.263167:0:198804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826370.263168:0:198804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826370.263169:0:198804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787826370.263171:0:198804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826370.263172:0:198804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826370.263174:0:198804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826370.263176:0:198804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787826370.263197:0:198804:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1787826370.286710:0:198804:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 12884910965 00000040:01000000:2.0:1787826370.289288:0:198804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787826370.289777:0:198825:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 12884910965 00000020:00080000:1.0:1787826370.289782:0:198825:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910965 00000040:01000000:1.0:1787826370.294298:0:198826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787826370.294596:0:198804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787826370.295059:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049423360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787826370.295164:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.295207:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049423360 00000100:00100000:1.0:1787826370.295213:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049423360 00000100:00100000:1.0:1787826370.295263:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826370.295272:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049423360:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1787826370.295359:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f77b80 x1874663049423360/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 304/4320 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826370.295399:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049423360:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 128us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.295407:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826370.295433:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f633840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826370.295457:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049423360:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787826370.295485:0:198827:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787826370.295511:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049423488:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787826370.295541:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.295559:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049423488 00000100:00100000:1.0:1787826370.295562:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049423488 00000100:00100000:1.0:1787826370.295581:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826370.295587:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049423488:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787826370.296096:0:198804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787826370.296134:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787826370.296622:0:198804:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787826370.296641:0:198804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787826370.296684:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826370.297268:0:198826:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000400:0x1:0x0] first idx 3, last_idx 4 00000040:00080000:0.0:1787826370.297356:0:198826:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1787826370.297361:0:198826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240001f5a:0x1:0x0] at index 4 of catalog [0x240000400:0x1:0x0] 00000004:00080000:0.0:1787826370.297443:0:198826:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240001f5a:0x1:0x0].3 00000020:00080000:0.0:1787826370.297448:0:198826:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 12884910966 transno = 0 mdt_index 1 00000040:00080000:0.0:1787826370.297457:0:198826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x240001f5a:0x1:0x0] index 4 count 2 00000040:00080000:0.0:1787826370.297477:0:198826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 5 count 2 00000004:00080000:0.0:1787826370.297521:0:198826:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787826370.297668:0:198804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787826370.298172:0:198804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787826370.298202:0:198804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787826370.298299:0:198804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826370.298385:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be536c0 going to sleep for 11 seconds 00080000:10000000:2.0:1787826370.298783:0:198804:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x32:0x0] (8/32) registered 00010000:00000080:1.0:1787826370.299542:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f74380 x1874663049423488/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 336/4320 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826370.299606:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049423488:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4018us (4064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.299615:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787826370.299771:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049423488:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787826370.299867:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:198827:1874663049423616:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787826370.299906:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.299939:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826370.300096:0:187916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049423616 00000100:00100000:1.0:1787826370.300103:0:187916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049423616 00000100:00100000:1.0:1787826370.300147:0:187916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787826370.300157:0:187916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198827:x1874663049423616:12345-0@lo:900:lod0001_rec0000.0 00010000:00000080:1.0:1787826370.300178:0:187916:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e84ed80 x1874663049423616/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:726/0 lens 264/248 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826370.300235:0:187916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198827:x1874663049423616:12345-0@lo:900:lod0001_rec0000.0 Request processed in 72us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.300243:0:187916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787826370.300797:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:198827:1874663049423616:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787826370.300865:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049423744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787826370.300900:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.300927:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826370.301158:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049423744 00000100:00100000:1.0:1787826370.301163:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049423744 00000100:00100000:1.0:1787826370.301203:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787826370.301211:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049423744:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1787826370.301259:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb44f744380 x1874663049423744/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 304/4320 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826370.301306:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049423744:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.301313:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787826370.301945:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e80e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049423744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787826370.302033:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049423872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787826370.302090:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.302113:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a62ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826370.305275:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049423872 00000100:00100000:1.0:1787826370.305291:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049423872 00000100:00100000:1.0:1787826370.305381:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787826370.305392:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049423872:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:0.0:1787826370.306496:0:198804:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 17179870055 00010000:00080000:0.0:1787826370.308649:0:198828:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 198828 00010000:02000000:0.0:1787826370.308670:0:198828:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1787826370.308778:0:198804:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787826370.308813:0:198804:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787826370.308833:0:198804:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787826370.308850:0:198804:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787826370.309694:0:198804:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787826370.309921:0:198804:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00000080:2.0:1787826370.325571:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb44f747100 x1874663049423872/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 336/33016 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.325648:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049423872:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 20257us (23555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.325660:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826370.327816:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049423872:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787826370.328347:0:198827:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000100:00100000:0.0:1787826370.328498:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424000:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787826370.328595:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826370.328626:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4725d9cc0 going to sleep for 11 seconds 00010000:00080000:0.0:1787826370.328643:0:198828:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787826370.328647:0:198828:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1787826370.330700:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049424000 00000100:00100000:2.0:1787826370.330711:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049424000 00000100:00100000:2.0:1787826370.330788:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787826370.330798:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424000:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:2.0:1787826370.330994:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb44f745500 x1874663049424000/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 336/33016 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.335470:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424000:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4669us (6871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.335483:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787826370.336098:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424000:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787826370.336162:0:198827:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 8 synced_idx: 0 lgh_last_idx: 8 00000040:00080000:1.0:1787826370.336167:0:198827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027cd2:0x1:0x0] at index 7 of catalog [0x200000401:0x1:0x0] 00000100:00100000:1.0:1787826370.336256:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424128:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787826370.336303:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826370.336353:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34be539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.336468:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049424128 00000100:00100000:2.0:1787826370.336475:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049424128 00000100:00100000:2.0:1787826370.336515:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787826370.336524:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424128:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:2.0:1787826370.336571:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f75880 x1874663049424128/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 304/4320 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.336614:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424128:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.336622:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787826370.336670:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424128:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.336739:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.336796:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.336811:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34953c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.336823:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049424256 00000100:00100000:2.0:1787826370.336827:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049424256 00000100:00100000:2.0:1787826370.336847:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787826370.336853:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424256:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:2.0:1787826370.337137:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cd4000 x1874663049424256/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 336/33016 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.337175:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424256:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 322us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.337182:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787826370.337210:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.337291:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.337344:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.337358:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47a5d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.337369:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049424384 00000100:00100000:2.0:1787826370.337372:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049424384 00000100:00100000:2.0:1787826370.337391:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787826370.337397:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424384:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:2.0:1787826370.337485:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46ea69180 x1874663049424384/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 336/33016 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.337518:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46ea69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424384:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 121us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.337525:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787826370.337549:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.337592:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.339178:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.339223:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.339260:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049424512 00000100:00100000:2.0:1787826370.339267:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049424512 00000100:00100000:2.0:1787826370.339303:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787826370.339312:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424512:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:2.0:1787826370.339467:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cdad80 x1874663049424512/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 336/33016 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.339513:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 201us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.339521:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787826370.339560:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424512:0@lo:1000:lod0001_rec0000.0 00000004:00080000:2.0:1787826370.339610:0:198827:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200027cd2:0x1:0x0].3 00000020:00080000:2.0:1787826370.339616:0:198827:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 12884910966 transno = 17179870055 mdt_index 0 00000040:00080000:2.0:1787826370.339623:0:198827:0:(llog.c:862:llog_process_thread()) stop processing plain [0x200027cd2:0x1:0x0] index 4 count 2 00000100:00100000:2.0:1787826370.339900:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.339973:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.339989:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.340138:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049424640 00000100:00100000:2.0:1787826370.340142:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049424640 00000100:00100000:2.0:1787826370.340166:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826370.340171:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424640:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:2.0:1787826370.340270:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a66df80 x1874663049424640/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 336/33016 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.340308:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 136us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826370.340315:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826370.340529:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424640:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787826370.340571:0:198827:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1787826370.340575:0:198827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027cd2:0x2:0x0] at index 8 of catalog [0x200000401:0x1:0x0] 00000100:00100000:2.0:1787826370.342725:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.342818:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.342859:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826370.343549:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049424768 00000100:00100000:3.0:1787826370.343557:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049424768 00000100:00100000:3.0:1787826370.343614:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787826370.343626:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424768:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:3.0:1787826370.343693:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472617100 x1874663049424768/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 304/4320 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826370.343750:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 127us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826370.343759:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787826370.347672:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424768:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787826370.347742:0:198827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826370.347899:0:198827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472615f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787826370.347961:0:198827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.348000:0:198827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826370.348608:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049424896 00000100:00100000:1.0:1787826370.348615:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049424896 00000100:00100000:1.0:1787826370.348655:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787826370.348665:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424896:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1787826370.349205:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472614e00 x1874663049424896/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 304/4320 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826370.349276:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198827:x1874663049424896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 612us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826370.349284:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787826370.349788:0:198827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472615f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198827:1874663049424896:0@lo:1000:lod0001_rec0000.0 00000004:00080000:2.0:1787826370.349847:0:198827:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb47f984840 with version 1 00000004:00080000:2.0:1787826370.349861:0:198811:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb47a62e3c0 version 1 rpc_version 1 00000020:00100000:2.0:1787826370.349881:0:198811:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826370.349887:0:198811:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472615f80 x1874663049425152/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826370.349906:0:198811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472615f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049425152:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826370.349944:0:198811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.349967:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.349981:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049425152 00000100:00100000:2.0:1787826370.349985:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049425152 00000100:00100000:2.0:1787826370.350013:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787826370.350020:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:198811:x1874663049425152:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:2.0:1787826370.350213:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472616a00 x1874663049425152/t352187318293(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 416/4320 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.350268:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:198811:x1874663049425152:12345-0@lo:1000:osp_up0-1.0 Request processed in 247us (323us total) trans 352187318293 rc 0/0 00000100:00100000:2.0:1787826370.350275:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787826370.350311:0:198811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472615f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049425152:0@lo:1000:osp_up0-1.0 00000040:00080000:2.0:1787826370.350358:0:198827:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000004:00080000:2.0:1787826370.350372:0:198827:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb47f984240 with version 2 00000040:00080000:2.0:1787826370.350380:0:198827:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200027cd2:0x2:0x0] at index 8 of catalog [0x200000401:0x1:0x0] 00000040:00080000:2.0:1787826370.350400:0:198827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 9 count 2 00000004:00080000:2.0:1787826370.350467:0:198827:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787826370.350473:0:198827:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00080000:2.0:1787826370.350503:0:198811:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb47a62e3c0 version 2 rpc_version 2 00000020:00100000:2.0:1787826370.350517:0:198811:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826370.350523:0:198811:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb472615180 x1874663049425408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826370.350535:0:198811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472615180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049425408:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826370.350562:0:198811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826370.350578:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f9849c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826370.350589:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049425408 00000100:00100000:2.0:1787826370.350592:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049425408 00000100:00100000:2.0:1787826370.350612:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787826370.350618:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:198811:x1874663049425408:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:2.0:1787826370.350688:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472616d80 x1874663049425408/t352187318294(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:726/0 lens 744/4320 e 0 to 0 dl 1787826381 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826370.350722:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:198811:x1874663049425408:12345-0@lo:1000:osp_up0-1.0 Request processed in 104us (159us total) trans 352187318294 rc 0/0 00000100:00100000:2.0:1787826370.350729:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787826370.350764:0:198811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472615180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049425408:0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1787826370.354098:0:198828:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1787826370.393658:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826371.422468:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787826371.927547:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826371.927560:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb349795000 from 340 10000000:01000000:0.0:1787826371.927569:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826371.927635:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.927651:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.927667:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826371.927701:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049425536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826371.927800:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.927861:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4725d9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826371.930292:0:196428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049425536 00000100:00100000:3.0:1787826371.930313:0:196428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049425536 00000100:00100000:3.0:1787826371.930769:0:196428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787826371.930793:0:196428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:6488:x1874663049425536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826371.930819:0:196428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826371.930855:0:196428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb441510a00/0x878a5eea00cee7e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee7da expref: -99 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826371.930895:0:196428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb441510a00/0x878a5eea00cee7e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee7da expref: 23 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826371.930909:0:196428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb441510a00/0x878a5eea00cee7e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee7da expref: 23 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826371.930920:0:196428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510a00, rc 0) 00000100:00100000:3.0:1787826371.931030:0:196428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049425536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826371.931037:0:196428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787826371.931056:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049425536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826371.931081:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7e1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.931092:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee7e1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826371.931178:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049425664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826371.931241:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.931289:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4725d9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826371.931561:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049425664 00000100:00100000:3.0:1787826371.931568:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049425664 00000100:00100000:3.0:1787826371.931603:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787826371.932378:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4724e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049425664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826371.932407:0:196427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826371.932434:0:196427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826371.932438:0:196427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 340 00000100:00100000:1.0:1787826371.932583:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4724e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049425664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 899us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826371.932592:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787826371.933395:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049425664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787826371.933479:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826371.933491:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7e1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.933505:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7e1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826371.933524:0:6488:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787826371.933527:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb448c99000 from 340 10000000:01000000:0.0:1787826371.933530:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787826371.933570:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.933580:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.933590:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826371.933611:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049425792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826371.933663:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.933716:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4725d9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826371.933734:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049425792 00000100:00100000:3.0:1787826371.933743:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049425792 00000100:00100000:3.0:1787826371.933807:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787826371.933818:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:6488:x1874663049425792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826371.933832:0:196429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826371.933859:0:196429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb441510c00/0x878a5eea00cee7ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee7e8 expref: -99 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826371.933887:0:196429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb441510c00/0x878a5eea00cee7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee7e8 expref: 24 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826371.933899:0:196429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb441510c00/0x878a5eea00cee7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee7e8 expref: 24 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826371.933909:0:196429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510c00, rc 0) 00000100:00100000:3.0:1787826371.933947:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049425792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826371.933954:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787826371.934054:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049425792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826371.934067:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.934076:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826371.934120:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049425920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787826371.934153:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.934176:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4725d9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826371.934484:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049425920 00000100:00100000:2.0:1787826371.934491:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049425920 00000100:00100000:2.0:1787826371.934530:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787826371.934539:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049425920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787826371.934557:0:196427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787826371.934575:0:196427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787826371.934579:0:196427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 340 00000100:00100000:2.0:1787826371.934669:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:6488:x1874663049425920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826371.934677:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787826371.936574:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb44f747b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:205ad83e-e455-4070-92a2-f1e25b8f3f40:6488:1874663049425920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787826371.936655:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787826371.936668:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826371.936680:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826372.287635:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826372.287705:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043036800 00000100:00100000:3.0:1787826372.287714:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043036800 00000100:00100000:3.0:1787826372.287778:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 124 00000100:00100000:3.0:1787826372.287788:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+9:159735:x1874663043036800:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826372.287805:0:196429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826372.287824:0:196429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb441511400/0x878a5eea00cee7f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f38c expref: -99 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826372.287850:0:196429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb441511400/0x878a5eea00cee7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f38c expref: 10 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826372.287862:0:196429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb441511400/0x878a5eea00cee7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f38c expref: 10 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826372.287871:0:196429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511400, rc 0) 00000100:00100000:3.0:1787826372.287932:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663043036800:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 145us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826372.287941:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 124 00000100:00100000:3.0:1787826372.290083:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826372.290182:0:196434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043036928 00000100:00100000:0.0:1787826372.290197:0:196434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043036928 00000100:00100000:0.0:1787826372.290288:0:196434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 125 00000100:00100000:0.0:1787826372.290298:0:196434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663043036928:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787826372.290344:0:196434:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1787826372.290363:0:196434:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787826372.290367:0:196434:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 340 00000100:00100000:0.0:1787826372.293472:0:196434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:159735:x1874663043036928:12345-192.168.203.47@tcp:256:ll_cfg_requeue.0 Request processed in 3161us (3390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826372.293488:0:196434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 125 00000100:00100000:3.0:1787826372.299511:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826372.299641:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043037056 00000100:00100000:0.0:1787826372.299656:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043037056 00000100:00100000:0.0:1787826372.299760:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1199 00000100:00100000:0.0:1787826372.299772:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1874663043037056:12345-192.168.203.47@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1787826372.299819:0:187906:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'c0d7758a-4501-4a89-8ec1-407fef4f0c7f' at ffff8eb342751000, cookie 0x878a5eea00cee739 00010000:00080000:0.0:1787826372.299828:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp recovering/t17179870055 exp ffff8eb342751000 cur 8439 last 1787826370 00010000:02000400:0.0:1787826372.299849:0:187906:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1787826372.299861:0:187906:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 85 seconds 00000004:00100000:0.0:1787826372.299906:0:187906:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787826372.300153:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb479869800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826372.300274:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043037056:12345-192.168.203.47@tcp:38:ll_cfg_requeue.0 Request processed in 499us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826372.300285:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1199 00000100:00100000:0.0:1787826372.310676:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826372.310749:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043037184 00000100:00100000:0.0:1787826372.310763:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043037184 00000100:00100000:0.0:1787826372.311111:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 417 00000100:00100000:0.0:1787826372.311128:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb44f747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043037184:12345-192.168.203.47@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787826372.311168:0:187905:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb44f747b80 x1874663043037184/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:742/0 lens 224/0 e 0 to 0 dl 1787826397 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826372.311193:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb44f747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043037184:12345-192.168.203.47@tcp:400:ldlm_lock_repla.0 Request processed in 69us (533us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826372.311204:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 417 00010000:00080000:0.0:1787826372.311239:0:198828:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1787826372.437807:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826372.950976:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826372.950999:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049426048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826372.951068:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826372.951117:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049426048 00000100:00100000:2.0:1787826372.951124:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049426048 00000100:00100000:2.0:1787826372.951177:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:2.0:1787826372.951186:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049426048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826372.951223:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826372.951268:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049426048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826372.951275:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00000100:00080000:2.0:1787826372.951294:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826372.951355:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049426048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826372.955069:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826372.955090:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049426176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826372.955151:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826372.955238:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049426176 00000100:00100000:1.0:1787826372.955247:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049426176 00000100:00100000:1.0:1787826372.955312:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:1.0:1787826372.955347:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049426176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826372.955393:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826372.955440:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049426176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826372.955447:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00000100:00080000:3.0:1787826372.955579:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826372.955612:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049426176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787826373.465806:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826374.404727:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826374.405302:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826374.405381:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043037312 00000100:00100000:0.0:1787826374.405392:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043037312 00000100:00100000:0.0:1787826374.405439:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 126 00000100:00100000:0.0:1787826374.405450:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043037312:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826374.405520:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043037312:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826374.405528:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 126 00000100:00100000:2.0:1787826374.409588:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043037440 00000100:00100000:2.0:1787826374.409605:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043037440 00000100:00100000:2.0:1787826374.409696:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 418 00000100:00100000:2.0:1787826374.409710:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043037440:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:2.0:1787826374.409745:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e80e680 x1874663043037440/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:730/0 lens 224/224 e 0 to 0 dl 1787826385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826374.409832:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043037440:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 126us (5114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826374.409840:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 418 00000100:00080000:3.0:1787826374.411010:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826374.485766:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826375.508503:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826375.508510:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826375.508515:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826375.508527:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8eb3431bc800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826375.508549:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb469f75c00 x1874663049426560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826375.508574:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826375.508578:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826375.508579:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826375.508584:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8eb341a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826375.508597:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb469f74a80 x1874663049426816/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826375.508607:0:185677:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826375.508610:0:185677:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787826375.508612:0:185677:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826375.508616:0:185677:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb45ec36000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826375.508628:0:185677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb469f74700 x1874663049426944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826375.508719:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049427072:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.508786:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.508847:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049427584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.508872:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.508899:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826375.508904:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049426304:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.508933:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.508956:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049427200:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.508976:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509177:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049427712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.509212:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509248:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049426432:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.509278:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509297:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049427328:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.509320:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509372:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049427840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.509400:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509421:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787826375.509427:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049426688:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.509450:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509469:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049427456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.509491:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509519:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049426560:0@lo:38:kworker.0 00000100:00100000:1.0:1787826375.509543:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509561:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049426816:0@lo:38:kworker.0 00000100:00100000:1.0:1787826375.509583:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509594:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049426944:0@lo:38:kworker.0 00000100:00100000:1.0:1787826375.509614:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.509644:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049427072 00000100:00100000:1.0:1787826375.509651:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049427072 00000100:00100000:1.0:1787826375.509703:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049427584 00000100:00100000:1.0:1787826375.509707:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049427584 00000100:00100000:1.0:1787826375.509727:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049427200 00000100:00100000:1.0:1787826375.509730:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049427200 00000100:00100000:1.0:1787826375.509750:0:179225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049427712 00000100:00100000:1.0:1787826375.509753:0:179225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049427712 00000100:00100000:1.0:1787826375.509777:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7167 00000100:00100000:1.0:1787826375.509786:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049427072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.509929:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7168 00000100:00100000:2.0:1787826375.509940:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049427584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.510000:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049427584:12345-0@lo:400:kworker.0 Request processed in 62us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.510006:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7168 00000100:00100000:2.0:1787826375.510026:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7169 00000100:00100000:2.0:1787826375.510033:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049427200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.510065:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049427200:12345-0@lo:400:kworker.0 Request processed in 33us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.510071:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7169 00000100:00100000:2.0:1787826375.510085:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7170 00000100:00100000:2.0:1787826375.510092:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049427712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.510120:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049427712:12345-0@lo:400:kworker.0 Request processed in 29us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.510125:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7170 00000100:00100000:2.0:1787826375.510143:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049427456 00000100:00100000:2.0:1787826375.510147:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049427456 00000100:00100000:2.0:1787826375.510166:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049426944 00000100:00100000:2.0:1787826375.510170:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049426944 00000100:00100000:2.0:1787826375.510181:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787826375.510187:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3617:x1874663049427456:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826375.510218:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a226d80 x1874663049427456/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826375.510255:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3617:x1874663049427456:12345-0@lo:400:kworker.0 Request processed in 68us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.510261:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787826375.510276:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787826375.510280:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049426944:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787826375.510304:0:187910:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8eb342757800, cookie 0x878a5eea00cee732 00010000:00080000:2.0:1787826375.510310:0:187910:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8eb342757800 cur 8442 last 1787826370 00000004:00100000:2.0:1787826375.510348:0:187910:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787826375.510486:0:187910:0:(import.c:65:import_set_state_nolock()) ffff8eb472781800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826375.510537:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049426944:12345-0@lo:38:kworker.0 Request processed in 255us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.510544:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787826375.510573:0:198828:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1787826375.510578:0:198828:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 17179870056 00000020:00080000:2.0:1787826375.510582:0:198828:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 17179870055 00010000:00080000:2.0:1787826375.510585:0:198828:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 17179870056 00010000:00080000:2.0:1787826375.510588:0:198828:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (17179870056) 00000020:00080000:2.0:1787826375.510590:0:198828:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 17179870055 00000020:00080000:2.0:1787826375.510602:0:198828:0:(update_records.c:53:update_records_dump()) master transno = 17179870055 batchid = 12884910966 flags = 0 ops = 10 params = 16 00000020:00080000:2.0:1787826375.510606:0:198828:0:(update_records.c:72:update_records_dump()) update 0th [0x240001f59:0x16:0x0] create params_count = 2 00000020:00080000:2.0:1787826375.510609:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93922 0th off = 0 size = 208 00000020:00080000:2.0:1787826375.510611:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df939fa 1th off = 1 size = 16 00000020:00080000:2.0:1787826375.510614:0:198828:0:(update_records.c:72:update_records_dump()) update 1th [0x240001f59:0x16:0x0] ref_add params_count = 0 00000020:00080000:2.0:1787826375.510616:0:198828:0:(update_records.c:72:update_records_dump()) update 2th [0x240001f59:0x16:0x0] insert params_count = 3 00000020:00080000:2.0:1787826375.510619:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93a12 0th off = 2 size = 2 00000020:00080000:2.0:1787826375.510621:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93a22 1th off = 3 size = 16 00000020:00080000:2.0:1787826375.510622:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93a3a 2th off = 4 size = 4 00000020:00080000:2.0:1787826375.510624:0:198828:0:(update_records.c:72:update_records_dump()) update 3th [0x240001f59:0x16:0x0] insert params_count = 3 00000020:00080000:2.0:1787826375.510626:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93a4a 0th off = 5 size = 3 00000020:00080000:2.0:1787826375.510628:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df939fa 1th off = 1 size = 16 00000020:00080000:2.0:1787826375.510630:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93a3a 2th off = 4 size = 4 00000020:00080000:2.0:1787826375.510632:0:198828:0:(update_records.c:72:update_records_dump()) update 4th [0x240001f59:0x16:0x0] xattr_set params_count = 3 00000020:00080000:2.0:1787826375.510635:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93a5a 0th off = 6 size = 12 00000020:00080000:2.0:1787826375.510637:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93a72 1th off = 7 size = 48 00000020:00080000:2.0:1787826375.510639:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93aaa 2th off = 8 size = 4 00000020:00080000:2.0:1787826375.510640:0:198828:0:(update_records.c:72:update_records_dump()) update 5th [0x240001f59:0x16:0x0] xattr_set params_count = 3 00000020:00080000:2.0:1787826375.510642:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93aba 0th off = 9 size = 9 00000020:00080000:2.0:1787826375.510644:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93ad2 1th off = 10 size = 5 00000020:00080000:2.0:1787826375.510647:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93aaa 2th off = 8 size = 4 00000020:00080000:2.0:1787826375.510649:0:198828:0:(update_records.c:72:update_records_dump()) update 6th [0x200027cd1:0x4:0x0] insert params_count = 3 00000020:00080000:2.0:1787826375.510651:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93ae2 0th off = 11 size = 11 00000020:00080000:2.0:1787826375.510653:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93a22 1th off = 3 size = 16 00000020:00080000:2.0:1787826375.510655:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93afa 2th off = 12 size = 4 00000020:00080000:2.0:1787826375.510657:0:198828:0:(update_records.c:72:update_records_dump()) update 7th [0x200027cd1:0x4:0x0] ref_add params_count = 0 00000020:00080000:2.0:1787826375.510659:0:198828:0:(update_records.c:72:update_records_dump()) update 8th [0x240001f59:0x16:0x0] xattr_set params_count = 3 00000020:00080000:2.0:1787826375.510662:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93b0a 0th off = 13 size = 13 00000020:00080000:2.0:1787826375.510664:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93b22 1th off = 14 size = 52 00000020:00080000:2.0:1787826375.510666:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93aaa 2th off = 8 size = 4 00000020:00080000:2.0:1787826375.510667:0:198828:0:(update_records.c:72:update_records_dump()) update 9th [0x200027cd1:0x4:0x0] attr_set params_count = 1 00000020:00080000:2.0:1787826375.510670:0:198828:0:(update_records.c:87:update_records_dump()) param = ffff8eb34df93b62 0th off = 15 size = 208 00000100:00100000:2.0:1787826375.510858:0:198828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472617b80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:198828:1874663049427968:0@lo:1000:tgt_recover_1.0 00000100:00100000:2.0:1787826375.510891:0:198828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826375.510910:0:198828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984480 going to sleep for 11 seconds 00000100:00080000:2.0:1787826375.510945:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 5 00000100:00080000:2.0:1787826375.510954:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787826375.510959:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:2.0:1787826375.510962:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff8eb45ec36000 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:2.0:1787826375.510966:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1787826375.511356:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049427072:12345-0@lo:400:kworker.0 Request processed in 1568us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.511365:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7167 00000100:00100000:1.0:1787826375.511400:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049426304 00000100:00100000:1.0:1787826375.511405:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049426304 00000100:00100000:1.0:1787826375.511437:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787826375.511445:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049426304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826375.511481:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049426304:12345-0@lo:400:kworker.0 Request processed in 38us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.511488:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787826375.511519:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049426432 00000100:00100000:1.0:1787826375.511522:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049426432 00000100:00100000:1.0:1787826375.511542:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049427328 00000100:00100000:1.0:1787826375.511544:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049427328 00000100:00100000:1.0:1787826375.511554:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049427840 00000100:00100000:1.0:1787826375.511557:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049427840 00000100:00100000:1.0:1787826375.511566:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049426688 00000100:00100000:1.0:1787826375.511569:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049426688 00000100:00100000:1.0:1787826375.511581:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049426560 00000100:00100000:1.0:1787826375.511584:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049426560 00000100:00100000:1.0:1787826375.511592:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049426816 00000100:00100000:1.0:1787826375.511594:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049426816 00000100:00100000:1.0:1787826375.511604:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1787826375.511610:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049426432:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826375.511623:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a225f80 x1874663049426432/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1787826386 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826375.511653:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049426432:12345-0@lo:400:kworker.0 Request processed in 43us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.511660:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1787826375.511672:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1787826375.511677:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049427328:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826375.511687:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a224e00 x1874663049427328/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1787826386 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826375.511711:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049427328:12345-0@lo:400:kworker.0 Request processed in 34us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.511716:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1787826375.511727:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1787826375.511734:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049427840:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826375.511745:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a226a00 x1874663049427840/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1787826386 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826375.511770:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049427840:12345-0@lo:400:kworker.0 Request processed in 37us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.511776:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1787826375.511788:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1787826375.511794:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049426688:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826375.511804:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a225180 x1874663049426688/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1787826386 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826375.511910:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049426688:12345-0@lo:400:kworker.0 Request processed in 115us (2458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.511916:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1787826375.511930:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1787826375.511935:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049426560:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787826375.511955:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8442 last 0 00000020:00000080:1.0:1787826375.512066:0:187906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x878a5eea00cee7fd 00000004:00100000:1.0:1787826375.512079:0:187906:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826375.512107:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb47754d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826375.512153:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874663049426560:12345-0@lo:38:kworker.0 Request processed in 217us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.512160:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1787826375.512173:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1787826375.512177:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049426816:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787826375.512202:0:187906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8442 last 0 00000020:00000080:1.0:1787826375.512226:0:187906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x878a5eea00cee804 00000004:00100000:1.0:1787826375.512233:0:187906:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826375.512249:0:187906:0:(import.c:65:import_set_state_nolock()) ffff8eb47754f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826375.512279:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874663049426816:12345-0@lo:38:kworker.0 Request processed in 99us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.512285:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00080000:1.0:1787826375.512352:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826375.512358:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826375.512360:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826375.515221:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826375.515240:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049428096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826375.515308:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.515385:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049427968 00000100:00100000:1.0:1787826375.515393:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049427968 00000100:00100000:1.0:1787826375.515425:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049428096 00000100:00100000:1.0:1787826375.515428:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049428096 00000100:00100000:1.0:1787826375.515442:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787826375.515451:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:198828:x1874663049427968:12345-0@lo:1000:tgt_recover_1.0 00010000:00000080:1.0:1787826375.515503:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472617800 x1874663049427968/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:731/0 lens 304/4320 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/200/0 rc 0/0 job:'tgt_recover_1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826375.515551:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:198828:x1874663049427968:12345-0@lo:1000:tgt_recover_1.0 Request processed in 101us (4659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.515559:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787826375.515578:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826375.515585:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049428096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826375.515605:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:1.0:1787826375.515618:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a22bb80 x1874663049428096/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:731/0 lens 224/368 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826375.515650:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049428096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.515656:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787826375.515692:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049428096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826375.515720:0:198828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472617b80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:198828:1874663049427968:0@lo:1000:tgt_recover_1.0 00010000:00080000:1.0:1787826375.515784:0:198828:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 82 seconds 00000020:00080000:1.0:1787826375.515788:0:198828:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t17179870055 00000020:00080000:1.0:1787826375.515798:0:198828:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1787826375.515801:0:198828:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 17179870056 00000020:00080000:1.0:1787826375.515804:0:198828:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1787826375.515807:0:198828:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 17179870056 00000100:00100000:2.0:1787826375.516125:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049426688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516137:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049427456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516150:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049426432:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516161:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049427328:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516178:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049427840:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516347:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049426304:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516361:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049427200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516373:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049427712:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516384:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049427072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826375.516412:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049427584:0@lo:400:kworker.0 00000020:00080000:1.0:1787826375.516691:0:198825:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12884910965 00000100:00100000:2.0:1787826375.517938:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049426944:0@lo:38:kworker.0 00010000:00080000:2.0:1787826375.517978:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb469f75c00 x1874663049426560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826375.518065:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 5 00010000:00080000:3.0:1787826375.518942:0:199067:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:3.0:1787826375.518948:0:199067:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:3.0:1787826375.518952:0:199067:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00000100:00080000:3.0:1787826375.519388:0:199067:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1787826375.520128:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff8eb469f75c00 x1874663049426560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826400 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826375.520139:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787826375.520144:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb3431bc800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787826375.520148:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787826375.520154:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1874663049426560:0@lo:38:kworker.0 00010000:00080000:2.0:1787826375.520188:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb469f74a80 x1874663049426816/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826375.520214:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 5 00000100:00080000:2.0:1787826375.522774:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff8eb469f74a80 x1874663049426816/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826400 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826375.522788:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787826375.522794:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341a98800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787826375.522800:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787826375.522806:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1874663049426816:0@lo:38:kworker.0 00000100:00100000:2.0:1787826375.524481:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049428224:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1787826375.524550:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.527466:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049428224 00000100:00100000:1.0:1787826375.527482:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049428224 00000100:00100000:1.0:1787826375.527571:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787826375.527581:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049428224:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1787826375.527602:0:187909:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8eb472614380 x1874663049428224/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:731/0 lens 224/0 e 0 to 0 dl 1787826386 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826375.527627:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049428224:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 48us (3078us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826375.527633:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:3.0:1787826375.527666:0:198828:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:3.0:1787826375.527671:0:198828:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 17179870056 00010000:00080000:3.0:1787826375.527674:0:198828:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1787826375.527676:0:198828:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:3.0:1787826375.527682:0:198828:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787826375.527685:0:198828:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1787826375.527796:0:198828:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474836480 00000001:00100000:3.0:1787826375.530720:0:198805:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787826375.530732:0:198805:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00080000:0.0:1787826375.530880:0:198828:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1787826375.530935:0:198828:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:0.0:1787826375.530953:0:198828:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.47@tcp: req@ffff8eb44f747b80 x1874663043037184/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:742/0 lens 224/0 e 0 to 0 dl 1787826397 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826375.532015:0:198828:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8eb472614380 x1874663049428224/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:731/0 lens 224/0 e 0 to 0 dl 1787826386 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787826375.532099:0:198828:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1787826375.534450:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787826375.534469:0:3616:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8eb47a42aa00 x1874663049428224/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826391 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826375.534479:0:3616:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8eb47a42aa00 x1874663049428224/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826391 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826375.534487:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826375.534498:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1787826375.534505:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005bef9733): req@ffff8eb477df6d80 x1874663049410304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826363 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826375.534520:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049428224:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787826375.534587:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826375.534600:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049428352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826375.534663:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.534720:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.534749:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049428352 00000100:00100000:1.0:1787826375.534755:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049428352 00000100:00100000:1.0:1787826375.534787:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049410304 00000100:00100000:1.0:1787826375.534790:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049410304 00000100:00100000:1.0:1787826375.534803:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826375.536893:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049428352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826375.536944:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446006784 avail 1299767296 00000100:00100000:1.0:1787826375.537105:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1874663049428352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2291us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.537114:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826375.537145:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826375.537155:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049410304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826375.537167:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446006784 avail 1299767296 00000100:00100000:1.0:1787826375.537211:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049410304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.537217:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826375.537267:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049428352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826375.537299:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049410304:0@lo:41:osp-pre-1-0.0 00000004:00000080:0.0:1787826375.592576:0:198828:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb65b87f4be10 00100000:10000000:0.0:1787826375.592593:0:198828:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:2.0:1787826375.600109:0:198816:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x38b:0x0] 00000100:00100000:2.0:1787826375.600162:0:198816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472615500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198816:1874663049428480:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787826375.600242:0:198816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826375.600276:0:198816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826375.600305:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049428480 00000100:00100000:2.0:1787826375.600312:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049428480 00000100:00100000:2.0:1787826375.600384:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22637 00000100:00100000:2.0:1787826375.600395:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:198816:x1874663049428480:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787826375.600440:0:43896:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 929 -> diff = -22 00002000:02000040:2.0:1787826375.600445:0:43896:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:908 to 0x2c0000400:929) 00000001:02000400:1.0:1787826375.607271:0:199071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:3.0:1787826375.607410:0:198814:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x38b:0x0] 00000100:00100000:3.0:1787826375.607457:0:198814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a428a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198814:1874663049428608:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787826375.607526:0:198814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826375.607607:0:198814:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.611516:0:43899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049428608 00000100:00100000:0.0:1787826375.611530:0:43899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049428608 00000100:00100000:0.0:1787826375.611624:0:43899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22638 00000100:00100000:0.0:1787826375.611634:0:43899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:198814:x1874663049428608:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787826375.611665:0:43899:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 929 -> diff = -22 00002000:02000040:0.0:1787826375.611669:0:43899:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:908 to 0x280000400:929) 00002000:00010000:0.0:1787826375.611863:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.611872:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.611889:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a1:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.611893:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.611900:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.611916:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.611927:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.611934:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.611956:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.611968:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.611973:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.611981:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.611985:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.612198:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.612217:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.612225:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef0bd820/0x878a5eea00cee80b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.612246:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.612248:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.612250:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.617171:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.617186:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617213:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a1:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.617219:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.617225:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617247:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617258:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617266:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617287:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.617299:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.617304:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617312:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.617317:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617347:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617364:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617371:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef5dfe2/0x878a5eea00cee812 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617390:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.617392:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.617394:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826375.618670:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00010000:0.0:1787826375.630303:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.630315:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630413:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a0:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.630418:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.630423:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630437:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630447:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630456:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630482:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826375.630570:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x39f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.630576:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630588:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39f:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.630591:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.630594:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630603:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630610:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630617:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630634:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787826375.630643:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826375.630648:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630656:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.630660:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630668:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630688:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630696:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456440ad/0x878a5eea00cee819 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630711:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.630715:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630719:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.630723:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630730:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630740:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630746:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd4accf9/0x878a5eea00cee820 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630757:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.630759:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.630761:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.630804:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x39e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.630810:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630818:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39e:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.630821:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.630825:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630834:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630841:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630848:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630862:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.630869:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.630873:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630880:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.630884:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630895:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630905:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630912:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2a4bb8/0x878a5eea00cee827 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630924:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.630926:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.630927:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.630968:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x39d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.630974:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630981:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39d:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.630984:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.630988:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.630996:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631003:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631010:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631023:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.631030:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.631033:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631039:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.631042:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631048:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631058:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631065:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005fb1500/0x878a5eea00cee82e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631077:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631078:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631080:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.631121:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x39c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.631127:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631135:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39c:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.631138:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.631142:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631150:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631158:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631165:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631178:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.631184:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.631188:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631205:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab19e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.631208:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631216:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631227:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631235:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bda47fae/0x878a5eea00cee835 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631247:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631249:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631251:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.631293:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x39b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.631298:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631306:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39b:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.631309:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.631313:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631322:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631354:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631362:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631379:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.631386:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.631390:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631396:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.631399:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631406:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631416:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631423:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b692694c/0x878a5eea00cee83c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631434:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631436:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631438:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.631479:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x39a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.631484:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631492:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39a:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.631495:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x39a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.631499:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631508:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631516:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631523:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631535:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.631541:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.631544:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631551:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.631554:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631562:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631572:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631584:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fd0344/0x878a5eea00cee843 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631596:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631598:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631599:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.631638:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x399:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.631643:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631651:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x399:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.631654:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x399:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.631659:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631667:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631675:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631682:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631694:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.631700:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.631704:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631711:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.631714:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631722:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631733:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631741:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000258c21ba/0x878a5eea00cee84a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631753:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631755:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631757:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.631800:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x398:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.631805:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631813:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x398:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.631816:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x398:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.631820:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631833:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631841:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631848:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631861:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.631868:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.631871:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631878:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.631881:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631889:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631900:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631908:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005576b96/0x878a5eea00cee851 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631921:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631922:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.631924:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.631965:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x397:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.631970:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631977:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x397:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.631980:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x397:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.631984:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.631993:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632000:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632006:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632018:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.632024:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.632028:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632040:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.632043:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632050:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632061:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632068:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f84e7d9d/0x878a5eea00cee858 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632081:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632083:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632085:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.632124:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x396:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.632129:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632137:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x396:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.632140:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x396:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.632144:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632153:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632161:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632167:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632180:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.632185:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.632200:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632207:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.632210:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632218:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632228:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632235:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cee85f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632246:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632248:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632250:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.632284:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x395:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.632289:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632296:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x395:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.632299:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x395:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.632303:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632311:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632319:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632344:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632355:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.632360:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.632364:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632370:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.632373:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632387:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632396:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632402:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc46262/0x878a5eea00cee866 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632414:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632416:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632417:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.632449:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x394:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.632455:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632463:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x394:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.632466:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.632470:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632478:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632485:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632493:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632504:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.632508:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.632511:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632518:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.632521:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632529:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632537:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632544:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cee86d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632554:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632556:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632557:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.632586:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x393:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.632591:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632599:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x393:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.632601:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x393:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.632605:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632613:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632620:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632628:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632638:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.632643:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.632646:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632652:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.632655:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632662:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632673:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632680:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f593a41f/0x878a5eea00cee874 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632691:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632692:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632693:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.632724:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x392:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.632728:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632736:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x392:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.632738:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x392:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.632742:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632750:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632758:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632765:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632780:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.632786:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.632789:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632795:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.632798:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632805:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632816:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632823:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a428/0x878a5eea00cee87b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632835:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632836:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632838:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.632876:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x391:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.632881:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632889:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x391:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.632892:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.632896:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632905:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632913:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632920:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632931:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.632936:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.632939:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632945:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.632948:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632956:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632965:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632977:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cee882 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.632988:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632990:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.632991:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.633032:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x390:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.633038:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633046:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x390:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.633049:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x390:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.633053:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633061:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633068:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633075:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633087:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.633094:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.633097:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633104:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.633107:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633116:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633125:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633132:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cee889 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.633145:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.633146:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.633148:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.633183:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x38f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.633189:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.633257:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.640482:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38f:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.640487:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.640496:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640520:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640531:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640539:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640561:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826375.640678:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x38e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.640684:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640692:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38e:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.640695:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.640699:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640707:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640714:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640725:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640739:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787826375.640749:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826375.640754:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640762:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.640766:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640775:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640792:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640799:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939d5bc9/0x878a5eea00cee890 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640822:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.640825:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640835:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.640838:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640847:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640856:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640864:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0be8c2f/0x878a5eea00cee897 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640874:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.640876:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.640877:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.640920:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x38d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.640925:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640933:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38d:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.640936:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.640940:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640948:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640955:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640961:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640974:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.640981:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.640985:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.640991:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.640995:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641001:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641011:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641017:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098d41782/0x878a5eea00cee89e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641031:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.641033:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.641035:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826375.641078:0:43896:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x38c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826375.641083:0:43896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641091:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38c:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:0.0:1787826375.641094:0:43896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.641098:0:43896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641107:0:43896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641114:0:43896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641121:0:43896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.641142:0:43896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787826375.641171:0:43896:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:907 00000100:00100000:0.0:1787826375.641274:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:198816:x1874663049428480:12345-0@lo:5:osp-pre-1-1.0 Request processed in 40877us (41028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.641283:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22637 00000100:00100000:0.0:1787826375.641356:0:198816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472615500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198816:1874663049428480:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787826375.641370:0:198816:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x3a1:0x0] from OST, last_created [0x2c0000400:0x3a1:0x0]last_used is [0x2c0000400:0x38b:0x0] 00000100:00100000:0.0:1787826375.641438:0:198816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198816:1874663049428864:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787826375.641474:0:198816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826375.641497:0:198816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.641513:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049428736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826375.641537:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826375.641575:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049428864 00000100:00100000:0.0:1787826375.641583:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049428864 00000100:00100000:0.0:1787826375.641620:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22639 00000100:00100000:0.0:1787826375.641629:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:198816:x1874663049428864:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787826375.641662:0:43902:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 930 00010000:00010000:2.0:1787826375.642487:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826375.642496:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.642506:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ee00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.642510:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.642518:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.642540:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.642547:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bd32aeb/0x878a5eea00cee8a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.642566:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.642568:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.642570:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.642653:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826375.642727:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049428736 00000100:00100000:2.0:1787826375.642735:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049428736 00000100:00100000:2.0:1787826375.642783:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1787826375.642793:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049428736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826375.642812:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143040 pending 896 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826375.642876:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049428736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.642882:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000100:00100000:0.0:1787826375.646243:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049428736:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1787826375.647971:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787826375.648763:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+6:198816:x1874663049428864:12345-0@lo:5:osp-pre-1-1.0 Request processed in 7130us (7284us total) trans 4294975548 rc 0/0 00000100:00100000:0.0:1787826375.648775:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22639 00000100:00100000:0.0:1787826375.649126:0:198816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198816:1874663049428864:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787826375.649141:0:198816:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x3a1:0x0]-[0x2c0000400:0x3c1:0x0] 00000100:00100000:0.0:1787826375.649179:0:198816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:198816:1874663049428992:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787826375.649227:0:198816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826375.649252:0:198816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.649271:0:187915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049428992 00000100:00100000:0.0:1787826375.649276:0:187915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049428992 00000100:00100000:0.0:1787826375.649316:0:187915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787826375.649347:0:187915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:198816:x1874663049428992:12345-0@lo:900:osp-pre-1-1.0 00010000:00000080:0.0:1787826375.649370:0:187915:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472977100 x1874663049428992/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:731/0 lens 264/248 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826375.649406:0:187915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:198816:x1874663049428992:12345-0@lo:900:osp-pre-1-1.0 Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.649413:0:187915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787826375.649441:0:198816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:198816:1874663049428992:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1787826375.649640:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.649649:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.649665:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a0:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.649669:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.649675:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.649695:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.649706:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.649713:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.649737:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826375.650216:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.650222:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650232:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39f:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.650235:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.650239:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650248:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650256:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650268:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650281:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787826375.650559:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.650565:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650573:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39e:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.650576:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.650579:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650587:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650594:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650600:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650613:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787826375.650622:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826375.650627:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650635:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.650639:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650646:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650660:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650667:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c8e8dc3/0x878a5eea00cee8ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650683:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826375.650687:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650693:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.650696:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650702:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650711:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650719:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056cfd507/0x878a5eea00cee8b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650728:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826375.650731:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650736:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.650739:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650746:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650755:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650762:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021479cae/0x878a5eea00cee8ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.650773:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.650775:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.650777:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.651211:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.651217:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651228:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39d:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.651231:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.651235:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651244:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651252:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651260:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651277:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826375.651286:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826375.651290:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651296:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.651300:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651307:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.651478:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.651485:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.651559:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651569:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ba36fb/0x878a5eea00cee8c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.651582:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.651584:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.651586:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.653394:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.653405:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653421:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39c:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.653426:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.653431:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653444:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653453:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653461:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653484:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826375.653494:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826375.653499:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653506:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.653511:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653519:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653532:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653539:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee8c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.653553:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.653554:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.653556:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.654026:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.654032:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654042:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39b:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.654046:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.654051:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654060:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654068:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654075:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654102:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826375.654408:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.654414:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654423:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39a:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.654426:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.654431:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654440:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654448:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654456:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654478:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787826375.654754:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x399:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.654760:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654769:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x399:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.654772:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x399:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.654776:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654784:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654791:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654797:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654810:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787826375.654829:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826375.654834:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654843:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.654847:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654854:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654866:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654874:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee8cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654890:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826375.654893:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654898:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.654902:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654908:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654917:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654925:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee8d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654937:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826375.654940:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654946:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826375.654949:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654956:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654966:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654973:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee8dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.654986:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.654987:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.654989:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.655277:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.655380:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x398:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.655386:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.655396:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x398:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.655399:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x398:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.655404:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.655413:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.655421:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.655429:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.655447:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826375.656021:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826375.656029:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656039:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826375.656043:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656050:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656064:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656071:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020d7c71a/0x878a5eea00cee8e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656089:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.656091:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.656093:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.656183:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x397:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.656199:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656209:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x397:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.656213:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x397:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.656218:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656227:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656241:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656249:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656271:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826375.656559:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826375.656565:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656573:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826375.656576:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656584:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656596:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656602:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be48d9a3/0x878a5eea00cee8eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.656619:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.656620:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.656622:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.656698:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x396:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.656704:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656712:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x396:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.656715:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x396:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.656719:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656728:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656735:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656741:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.656793:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826375.658763:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x395:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826375.658774:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.658792:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x395:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:1.0:1787826375.658796:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x395:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.658801:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.658825:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.658834:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.658842:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658904:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826375.658912:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658920:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826375.658924:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658932:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658948:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658955:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c54dcb4e/0x878a5eea00cee8f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658972:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826375.658975:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658981:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826375.658984:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658991:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.658999:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.659007:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.659009:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.659011:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.662974:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826375.663542:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826375.663553:0:43899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cee8f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.665793:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.666384:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x394:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.666393:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666410:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x394:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.666415:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.666422:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666436:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666446:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666454:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666534:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787826375.666922:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x393:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.666929:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666939:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x393:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.666943:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x393:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.666948:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666957:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666963:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.666970:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.669934:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826375.669950:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.669964:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.669969:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.669980:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.670002:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.670009:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085af8a91/0x878a5eea00cee900 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.670125:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.670580:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.670587:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.670597:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.670601:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.670608:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.670621:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.670629:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001678d2c/0x878a5eea00cee907 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.670645:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.670647:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.670648:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.670756:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x392:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.670763:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.670775:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x392:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.670779:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x392:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.670785:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.670796:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.670805:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.671394:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.671524:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826375.671531:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.671539:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826375.671543:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.671558:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.671572:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.671580:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826375.671582:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826375.671601:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787826375.671606:0:43899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee90e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826375.674261:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826375.674275:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.674292:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x391:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:3.0:1787826375.674297:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.674303:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.674316:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.674361:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.674370:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.674427:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.674435:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.674443:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.674447:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.674457:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.674475:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.674486:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.674488:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.674490:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826375.675146:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.675506:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.675648:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787826375.675655:0:43899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0f3ea4c/0x878a5eea00cee915 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826375.676963:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826375.676972:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.676987:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x390:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:3.0:1787826375.676991:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x390:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.676997:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.677009:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.677018:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.677026:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.677046:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787826375.677348:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826375.677355:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.677364:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38f:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:3.0:1787826375.677368:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.677372:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.677381:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.677389:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.677400:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.680259:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787826375.681073:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826375.681084:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.681101:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38e:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:3.0:1787826375.681105:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.681112:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.681127:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.681136:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.681144:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.681940:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826375.681950:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.681961:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826375.681966:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.681974:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.681992:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682000:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ecb2eb/0x878a5eea00cee91c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682029:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826375.682033:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682039:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826375.682042:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682049:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682058:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682066:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ffa1aa5/0x878a5eea00cee923 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682079:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826375.682082:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682089:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826375.682092:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682103:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682112:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.682119:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826375.682120:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826375.682122:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.682217:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826375.683035:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787826375.683055:0:43899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032976461/0x878a5eea00cee92a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.683843:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.686888:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.686901:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686918:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38d:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.686922:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.686928:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686942:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686953:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686961:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.687000:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826375.687389:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826375.687397:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.687406:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826375.687411:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.687420:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.687437:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.687445:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000272307fd/0x878a5eea00cee931 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.687466:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.687468:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826375.687470:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787826375.687581:0:43899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.687587:0:43899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.687598:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38c:0x0].0x0 since=8442s v=(0 0) 00010000:00010000:2.0:1787826375.687601:0:43899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.687605:0:43899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.687613:0:43899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.687620:0:43899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.687627:0:43899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.687693:0:43899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787826375.687726:0:43899:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:907 00000100:00100000:2.0:1787826375.687881:0:43899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:198814:x1874663049428608:12345-0@lo:5:osp-pre-0-1.0 Request processed in 76244us (80350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.687891:0:43899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22638 00000100:00100000:0.0:1787826375.687979:0:198814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a428a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198814:1874663049428608:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787826375.687995:0:198814:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x3a1:0x0] from OST, last_created [0x280000400:0x3a1:0x0]last_used is [0x280000400:0x38b:0x0] 00000100:00100000:0.0:1787826375.688059:0:198814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198814:1874663049429248:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787826375.688093:0:198814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826375.688114:0:198814:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.688128:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049429248 00000100:00100000:0.0:1787826375.688134:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049429248 00000100:00100000:0.0:1787826375.688172:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22640 00000100:00100000:0.0:1787826375.688182:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:198814:x1874663049429248:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787826375.688225:0:151857:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 930 00000100:00100000:2.0:1787826375.688928:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049429120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826375.688969:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826375.691924:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787826375.692174:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+6:198814:x1874663049429248:12345-0@lo:5:osp-pre-0-1.0 Request processed in 3989us (4075us total) trans 38654705679 rc 0/0 00000100:00100000:0.0:1787826375.692185:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22640 00000100:00100000:0.0:1787826375.692261:0:198814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198814:1874663049429248:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787826375.692276:0:198814:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x3a1:0x0]-[0x280000400:0x3c1:0x0] 00010000:00010000:1.0:1787826375.692305:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.692315:0:198814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:198814:1874663049429376:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787826375.692318:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826375.692337:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.692349:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.692368:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.692372:0:198814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826375.692376:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f8c4f9/0x878a5eea00cee938 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.692393:0:198814:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4813bcb40 going to sleep for 11 seconds 00010000:00010000:1.0:1787826375.692395:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826375.692397:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826375.692398:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826375.692408:0:187915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049429376 00000100:00100000:1.0:1787826375.692413:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049429120 00000100:00100000:0.0:1787826375.692414:0:187915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049429376 00000100:00100000:1.0:1787826375.692417:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049429120 00000100:00100000:0.0:1787826375.692448:0:187915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787826375.692448:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5907 00000100:00100000:0.0:1787826375.692456:0:187915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:198814:x1874663049429376:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787826375.692456:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049429120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826375.692474:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00010000:00000080:0.0:1787826375.692477:0:187915:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481628e00 x1874663049429376/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:731/0 lens 264/248 e 0 to 0 dl 1787826386 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826375.692509:0:187915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:198814:x1874663049429376:12345-0@lo:900:osp-pre-0-1.0 Request processed in 53us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.692512:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049429120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (3543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.692516:0:187915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787826375.692517:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5907 00000100:00100000:0.0:1787826375.692542:0:198814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb48162a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:198814:1874663049429376:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787826375.692545:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049429120:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1787826376.029650:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318294 is committed 00010000:00010000:1.0:1787826376.532597:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787826376.675105:0:199124:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826376.676740:0:199124:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787826377.404019:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826377.404067:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826377.404113:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826377.404145:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043037824 00000100:00100000:0.0:1787826377.404155:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043037824 00000100:00100000:0.0:1787826377.404221:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043037696 00000100:00100000:0.0:1787826377.404224:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043037696 00000100:00100000:0.0:1787826377.404248:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 423 00000100:00100000:0.0:1787826377.404258:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043037824:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826377.404349:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043037824:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.404357:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 423 00000100:00100000:0.0:1787826377.404376:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 424 00000100:00100000:0.0:1787826377.404383:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2392:x1874663043037696:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826377.404396:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af5f80 x1874663043037696/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:747/0 lens 224/224 e 0 to 0 dl 1787826402 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826377.404420:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2392:x1874663043037696:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.404425:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 424 00000100:00080000:0.0:1787826377.404442:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826377.404446:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826377.408592:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043037568 00000100:00100000:3.0:1787826377.408609:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043037568 00000100:00100000:3.0:1787826377.408675:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 128 00000100:00100000:3.0:1787826377.408685:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043037568:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.408772:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043037568:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 87us (4763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.408780:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 128 00000020:00000004:0.0:1787826377.508685:0:199174:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826377.508924:0:199174:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787826377.563122:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826378.068635:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049429504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826378.068709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.068880:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049429504 00000100:00100000:1.0:1787826378.068888:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049429504 00000100:00100000:1.0:1787826378.068948:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5908 00000100:00100000:1.0:1787826378.068958:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049429504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826378.068986:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826378.068987:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049429632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826378.069016:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826378.069028:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049429504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826378.069035:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5908 00000100:00100000:0.0:1787826378.069046:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049429632 00000100:00100000:0.0:1787826378.069050:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049429632 00000100:00100000:0.0:1787826378.069073:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5909 00000100:00100000:0.0:1787826378.069080:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049429632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826378.069095:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00080000:2.0:1787826378.069118:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826378.069122:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826378.069160:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049429504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826378.070054:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049429632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 970us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826378.070063:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5909 00000100:00100000:1.0:1787826378.071678:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049429632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787826378.586660:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826379.494813:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826379.494999:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043037952 00000100:00100000:1.0:1787826379.495008:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043037952 00000100:00100000:1.0:1787826379.495084:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1202 00000100:00100000:1.0:1787826379.495094:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:162580:x1874663043037952:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1787826379.495114:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826379.495136:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee93f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f393 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826379.495220:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cee946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826379.495234:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cee946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826379.495247:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cee946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826379.495295:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787826379.495299:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1787826379.495316:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cee946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826379.495374:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357c00/0x878a5eea00cee93f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f393 expref: 9 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826379.495393:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cee946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f393 expref: 8 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826379.495401:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:1.0:1787826379.495404:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826379.495408:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357600, rc 0) 00010000:00000080:1.0:1787826379.495415:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af5180 x1874663043037952/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:749/0 lens 576/688 e 0 to 0 dl 1787826404 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787826379.495492:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162580:x1874663043037952:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 399us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826379.495499:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1202 00000100:00080000:2.0:1787826379.495577:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826379.504769:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826379.504907:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043038080 00000100:00100000:0.0:1787826379.504918:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043038080 00000100:00100000:0.0:1787826379.504980:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1203 00000100:00100000:0.0:1787826379.504991:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162580:x1874663043038080:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826379.505034:0:188682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:0.0:1787826379.505054:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a228380 x1874663043038080/t0(0) o41->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:735/0 lens 224/368 e 0 to 0 dl 1787826390 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826379.505119:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:162580:x1874663043038080:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826379.505126:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1203 00000100:00100000:3.0:1787826379.514292:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826379.514416:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043038208 00000100:00100000:1.0:1787826379.514426:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043038208 00000100:00100000:1.0:1787826379.514496:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1204 00000100:00100000:1.0:1787826379.514506:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162580:x1874663043038208:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:1.0:1787826379.514544:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446006784 avail 1299767296 00000100:00100000:1.0:1787826379.514629:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162580:x1874663043038208:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 124us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826379.514636:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1204 00000100:00080000:2.0:1787826379.514706:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826379.518763:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826379.518874:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043038336 00000100:00100000:2.0:1787826379.518884:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043038336 00000100:00100000:2.0:1787826379.518934:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22641 00000100:00100000:2.0:1787826379.518942:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1874663043038336:12345-192.168.203.47@tcp:8:lfs.0 00010000:00080000:2.0:1787826379.518972:0:8406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp t0 exp 0000000000000000 cur 8446 last 0 00000020:00000080:2.0:1787826379.519002:0:8406:0:(genops.c:1385:class_connect()) connect: client c0d7758a-4501-4a89-8ec1-407fef4f0c7f, cookie 0x878a5eea00cee94d 00002000:00100000:2.0:1787826379.519012:0:8406:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c0d7758a-4501-4a89-8ec1-407fef4f0c7f/ffff8eb472782800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787826379.519029:0:8406:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787826379.519101:0:8406:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787826379.519133:0:8406:0:(import.c:65:import_set_state_nolock()) ffff8eb472786800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826379.519223:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043038336:12345-192.168.203.47@tcp:8:lfs.0 Request processed in 280us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826379.519231:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22641 00000100:00100000:0.0:1787826379.528378:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826379.529393:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043038464 00000100:00100000:1.0:1787826379.529405:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043038464 00000100:00100000:1.0:1787826379.529499:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5910 00000100:00100000:1.0:1787826379.529512:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162580:x1874663043038464:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:1.0:1787826379.529539:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826379.529616:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162580:x1874663043038464:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 107us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826379.529625:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5910 00000100:00080000:2.0:1787826379.533369:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826379.533957:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826379.537370:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043038592 00000100:00100000:1.0:1787826379.537386:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043038592 00000100:00100000:1.0:1787826379.537453:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22642 00000100:00100000:1.0:1787826379.537463:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2388:x1874663043038592:12345-192.168.203.47@tcp:8:lfs.0 00010000:00080000:1.0:1787826379.537498:0:43901:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp t0 exp 0000000000000000 cur 8446 last 0 00000020:00000080:1.0:1787826379.537530:0:43901:0:(genops.c:1385:class_connect()) connect: client c0d7758a-4501-4a89-8ec1-407fef4f0c7f, cookie 0x878a5eea00cee954 00002000:00100000:1.0:1787826379.537542:0:43901:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c0d7758a-4501-4a89-8ec1-407fef4f0c7f/ffff8eb47754c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787826379.537558:0:43901:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787826379.537620:0:43901:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787826379.537649:0:43901:0:(import.c:65:import_set_state_nolock()) ffff8eb47754b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826379.537735:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043038592:12345-192.168.203.47@tcp:8:lfs.0 Request processed in 271us (3783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826379.537743:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22642 00000100:00100000:0.0:1787826379.546532:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826379.546634:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043038720 00000100:00100000:1.0:1787826379.546645:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043038720 00000100:00100000:1.0:1787826379.546712:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5911 00000100:00100000:1.0:1787826379.546723:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162580:x1874663043038720:12345-192.168.203.47@tcp:13:lfs.0 00000100:00080000:2.0:1787826379.546732:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787826379.546750:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826379.546816:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:162580:x1874663043038720:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 95us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826379.546824:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5911 00010000:00010000:2.0:1787826379.607199:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826380.628839:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049429760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826380.628935:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826380.630317:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049429760 00000100:00100000:1.0:1787826380.630367:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049429760 00000100:00100000:1.0:1787826380.630448:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787826380.630461:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049429760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826380.630509:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:1.0:1787826380.630531:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af7800 x1874663049429760/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:736/0 lens 224/368 e 0 to 0 dl 1787826391 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826380.630614:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049429760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826380.630625:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787826380.630671:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049429888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826380.630711:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826380.630765:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049429888 00000100:00100000:1.0:1787826380.630769:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049429888 00000100:00100000:1.0:1787826380.630788:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787826380.630796:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049429888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826380.630816:0:187910:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446006784 avail 1299767296 00000100:00100000:1.0:1787826380.630853:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049429888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826380.630859:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787826380.630907:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049429888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826380.631528:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049429760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826380.631701:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049430400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826380.631750:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826380.631774:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049430912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826380.631825:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826380.631848:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787826380.631854:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049430016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826380.631887:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826380.631912:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049430528:0@lo:400:kworker.0 00000100:00100000:0.0:1787826380.631934:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826380.631951:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049431040:0@lo:400:kworker.0 00000100:00100000:0.0:1787826380.631975:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826380.632009:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049430400 00000100:00100000:0.0:1787826380.632015:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049430400 00000100:00100000:0.0:1787826380.632066:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049430912 00000100:00100000:0.0:1787826380.632070:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049430912 00000100:00100000:0.0:1787826380.632088:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049430528 00000100:00100000:0.0:1787826380.632091:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049430528 00000100:00100000:0.0:1787826380.632107:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1787826380.632114:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049430400:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826380.632135:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af4e00 x1874663049430400/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:750/0 lens 224/224 e 0 to 0 dl 1787826405 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826380.632182:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049430400:12345-0@lo:400:kworker.0 Request processed in 67us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826380.632189:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1787826380.632205:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1787826380.632563:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049431040 00000100:00100000:1.0:1787826380.632568:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049431040 00000100:00100000:1.0:1787826380.632615:0:43900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7171 00000100:00100000:1.0:1787826380.632623:0:43900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049431040:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1787826380.632778:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826380.632872:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049430912:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826380.632886:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86bb80 x1874663049430912/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:750/0 lens 224/224 e 0 to 0 dl 1787826405 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826380.632924:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049430912:12345-0@lo:400:kworker.0 Request processed in 57us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826380.632931:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1787826380.632947:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1787826380.632953:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049430528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826380.632982:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049430528:12345-0@lo:400:kworker.0 Request processed in 29us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826380.632988:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00080000:0.0:1787826380.633007:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826380.633013:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826380.633015:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787826380.633049:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481af4a80 x1874663049430528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826380.633062:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049430528:0@lo:400:kworker.0 00000100:00100000:0.0:1787826380.633074:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049430400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826380.633084:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049430912:0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.633360:0:43900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049431040:12345-0@lo:400:kworker.0 Request processed in 737us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826380.633367:0:43900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7171 00000100:00100000:1.0:1787826380.633464:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049430016 00000100:00100000:1.0:1787826380.633470:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049430016 00000100:00100000:1.0:1787826380.633504:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787826380.633511:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049430016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.633545:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049430016:12345-0@lo:400:kworker.0 Request processed in 35us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826380.633556:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787826380.633594:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049430144:0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.633629:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826380.633733:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049430016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826380.633749:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049431040:0@lo:400:kworker.0 00000100:00100000:2.0:1787826380.633880:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049430272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.634356:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049430656:0@lo:400:kworker.0 00000100:00100000:2.0:1787826380.634471:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049430144 00000100:00100000:2.0:1787826380.634477:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049430144 00000100:00100000:2.0:1787826380.634529:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1787826380.634537:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049430144:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826380.634558:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a229500 x1874663049430144/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:750/0 lens 224/224 e 0 to 0 dl 1787826405 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826380.634603:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049430144:12345-0@lo:400:kworker.0 Request processed in 67us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826380.634610:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00080000:2.0:1787826380.634629:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826380.634715:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826380.634738:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049431168:0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.634762:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826380.634798:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049430144:0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.634824:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049430656 00000100:00100000:1.0:1787826380.634828:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049430656 00000100:00100000:1.0:1787826380.634858:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049431168 00000100:00100000:1.0:1787826380.634862:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049431168 00000100:00100000:1.0:1787826380.634887:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7172 00000100:00100000:1.0:1787826380.634894:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049430656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.634932:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049430656:12345-0@lo:400:kworker.0 Request processed in 39us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826380.634939:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7172 00000100:00100000:1.0:1787826380.634952:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7173 00000100:00100000:1.0:1787826380.634958:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049431168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.634985:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049431168:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826380.634991:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7173 00000100:00100000:1.0:1787826380.635029:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049430656:0@lo:400:kworker.0 00000100:00100000:1.0:1787826380.635039:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049431168:0@lo:400:kworker.0 00000100:00080000:2.0:1787826380.635289:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826380.635293:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826380.635536:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826380.635572:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049430784:0@lo:400:kworker.0 00000100:00100000:3.0:1787826380.635608:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826380.635627:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049431296:0@lo:400:kworker.0 00000100:00100000:3.0:1787826380.635666:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826380.635724:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049430272 00000100:00100000:3.0:1787826380.635729:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049430272 00000100:00100000:3.0:1787826380.635775:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049431296 00000100:00100000:3.0:1787826380.635779:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049431296 00000100:00100000:3.0:1787826380.635804:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1787826380.635811:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049430272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826380.635857:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049430272:12345-0@lo:400:kworker.0 Request processed in 46us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826380.635864:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1787826380.635883:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1787826380.635890:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049431296:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826380.635902:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4774f1f80 x1874663049431296/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:750/0 lens 224/224 e 0 to 0 dl 1787826405 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826380.635934:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4774f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1874663049431296:12345-0@lo:400:kworker.0 Request processed in 45us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826380.635939:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00080000:3.0:1787826380.635960:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787826380.635983:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb481af5500 x1874663049430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826380.635993:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049430272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826380.636003:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1874663049431296:0@lo:400:kworker.0 00000100:00100000:2.0:1787826380.636510:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049430784 00000100:00100000:2.0:1787826380.636516:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049430784 00000100:00100000:2.0:1787826380.636569:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7174 00000100:00100000:2.0:1787826380.636577:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049430784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826380.636624:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049430784:12345-0@lo:400:kworker.0 Request processed in 49us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826380.636630:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7174 00000100:00080000:3.0:1787826380.637504:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826380.637554:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049430784:0@lo:400:kworker.0 00000100:00100000:1.0:1787826381.148370:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049431424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826381.148437:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826381.148493:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049431424 00000100:00100000:1.0:1787826381.148500:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049431424 00000100:00100000:1.0:1787826381.148546:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:1.0:1787826381.148556:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049431424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826381.148581:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826381.148626:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049431424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826381.148633:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00000100:00100000:1.0:1787826381.148684:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049431424:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1787826381.150187:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00080000:1.0:1787826381.150200:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975548 is committed 00000100:00100000:2.0:1787826381.152001:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049431552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826381.152064:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826381.152120:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049431552 00000100:00100000:2.0:1787826381.152126:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049431552 00000100:00100000:2.0:1787826381.152417:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5913 00000100:00100000:2.0:1787826381.152429:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049431552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826381.152454:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826381.152499:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049431552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826381.152506:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5913 00000100:00100000:2.0:1787826381.152553:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049431552:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787826381.161013:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000001:00080000:0.0:1787826381.161028:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705679 is committed 00010000:00010000:3.0:1787826381.655456:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826382.591568:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826382.591608:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826382.591634:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826382.591652:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826382.591676:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826382.591708:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043039232 00000100:00100000:0.0:1787826382.591717:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043039232 00000100:00100000:0.0:1787826382.591788:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043039360 00000100:00100000:0.0:1787826382.591792:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043039360 00000100:00100000:0.0:1787826382.591818:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7175 00000100:00100000:0.0:1787826382.591829:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043039232:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826382.591895:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043039232:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.591903:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7175 00000100:00100000:0.0:1787826382.592084:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7176 00000100:00100000:0.0:1787826382.592092:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043039360:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826382.592122:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043039360:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.592129:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7176 00000100:00100000:0.0:1787826382.592164:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043038848 00000100:00100000:0.0:1787826382.592168:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043038848 00000100:00100000:0.0:1787826382.592192:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 130 00000100:00100000:0.0:1787826382.592211:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043038848:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826382.592237:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043038848:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.592244:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 130 00000100:00100000:0.0:1787826382.592284:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043038976 00000100:00100000:0.0:1787826382.592289:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043038976 00000100:00100000:0.0:1787826382.592345:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043039104 00000100:00100000:0.0:1787826382.592349:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043039104 00000100:00100000:0.0:1787826382.592379:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 431 00000100:00100000:0.0:1787826382.592387:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2390:x1874663043038976:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826382.592404:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e868380 x1874663043038976/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:738/0 lens 224/224 e 0 to 0 dl 1787826393 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826382.592429:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2390:x1874663043038976:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 44us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.592436:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 431 00000100:00100000:0.0:1787826382.592452:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 432 00000100:00100000:0.0:1787826382.592458:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663043039104:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826382.592484:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663043039104:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.592490:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 432 00000100:00080000:0.0:1787826382.592514:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826382.592518:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826382.592521:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826382.592523:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826382.683963:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826383.189312:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049431680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826383.189412:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826383.189568:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049431680 00000100:00100000:1.0:1787826383.189576:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049431680 00000100:00100000:1.0:1787826383.189637:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5914 00000100:00100000:1.0:1787826383.189647:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049431680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826383.189674:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826383.189720:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049431680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826383.189727:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5914 00000100:00100000:1.0:1787826383.189782:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049431680:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787826383.190234:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826383.190588:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049431808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826383.190629:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826383.190702:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049431808 00000100:00100000:2.0:1787826383.190707:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049431808 00000100:00100000:2.0:1787826383.190753:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:2.0:1787826383.190770:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049431808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826383.190790:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826383.190827:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049431808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826383.190833:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00100000:2.0:1787826383.190866:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049431808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787826383.191910:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787826383.700616:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826384.725044:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826385.749009:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049432064:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749080:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749138:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049432576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749162:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749185:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049433088:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749204:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749225:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787826385.749230:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049431936:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749256:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749275:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049432448:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749296:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749315:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049432960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749376:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049433472:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749396:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749420:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049432192:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749439:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749452:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049432704:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749470:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749737:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049433216:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749764:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749786:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826385.749792:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049432320:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749813:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749824:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049432832:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749842:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749859:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049433344:0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.749879:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826385.749913:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049432064 00000100:00100000:2.0:1787826385.749920:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049432064 00000100:00100000:2.0:1787826385.749966:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049432448 00000100:00100000:2.0:1787826385.749970:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049432448 00000100:00100000:2.0:1787826385.749984:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049432960 00000100:00100000:2.0:1787826385.749987:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049432960 00000100:00100000:2.0:1787826385.749995:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049433472 00000100:00100000:2.0:1787826385.749997:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049433472 00000100:00100000:2.0:1787826385.750008:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049432192 00000100:00100000:2.0:1787826385.750010:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049432192 00000100:00100000:2.0:1787826385.750020:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049432320 00000100:00100000:2.0:1787826385.750023:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049432320 00000100:00100000:2.0:1787826385.750036:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1787826385.750044:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049432064:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826385.750068:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a225500 x1874663049432064/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:741/0 lens 224/224 e 0 to 0 dl 1787826396 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826385.750110:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874663049432064:12345-0@lo:400:kworker.0 Request processed in 66us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.750117:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1787826385.750145:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1787826385.750151:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049432448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.750181:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049432448:12345-0@lo:400:kworker.0 Request processed in 30us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.750187:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1787826385.750209:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1787826385.750215:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049432960:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826385.750225:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f76d80 x1874663049432960/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:741/0 lens 224/224 e 0 to 0 dl 1787826396 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826385.750251:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049432960:12345-0@lo:400:kworker.0 Request processed in 37us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.750260:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1787826385.750272:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1787826385.750278:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049433472:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826385.750288:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f75180 x1874663049433472/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:741/0 lens 224/224 e 0 to 0 dl 1787826396 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826385.750313:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874663049433472:12345-0@lo:400:kworker.0 Request processed in 35us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.750319:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1787826385.750356:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1787826385.750361:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049432192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.750392:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049432192:12345-0@lo:400:kworker.0 Request processed in 30us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.750397:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1787826385.750407:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1787826385.750412:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049432320:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826385.750421:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f74700 x1874663049432320/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:741/0 lens 224/224 e 0 to 0 dl 1787826396 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826385.750441:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049432320:12345-0@lo:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.750446:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1787826385.750464:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049432576 00000100:00100000:2.0:1787826385.750469:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049432576 00000100:00100000:2.0:1787826385.750891:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049433088 00000100:00100000:2.0:1787826385.750897:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049433088 00000100:00100000:2.0:1787826385.750917:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826385.750924:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049432576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.750966:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049432576:12345-0@lo:400:kworker.0 Request processed in 42us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.750972:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787826385.750985:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826385.750991:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049433088:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826385.751003:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb469f74e00 x1874663049433088/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:741/0 lens 224/224 e 0 to 0 dl 1787826396 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826385.751026:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049433088:12345-0@lo:400:kworker.0 Request processed in 37us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.751031:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826385.751057:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049431936 00000100:00100000:2.0:1787826385.751061:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049431936 00000100:00100000:2.0:1787826385.751100:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787826385.751107:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049431936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.751147:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049431936:12345-0@lo:400:kworker.0 Request processed in 41us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.751153:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787826385.751197:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049432704 00000100:00100000:2.0:1787826385.751201:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049432704 00000100:00100000:2.0:1787826385.751233:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049433216 00000100:00100000:2.0:1787826385.751237:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049433216 00000100:00100000:2.0:1787826385.751255:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049432832 00000100:00100000:2.0:1787826385.751258:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049432832 00000100:00100000:2.0:1787826385.751273:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049433344 00000100:00100000:2.0:1787826385.751276:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049433344 00000100:00100000:2.0:1787826385.751293:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7177 00000100:00100000:2.0:1787826385.751299:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049432704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.751358:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049432704:12345-0@lo:400:kworker.0 Request processed in 58us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.751364:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7177 00000100:00100000:2.0:1787826385.751376:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7178 00000100:00100000:2.0:1787826385.751383:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049433216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.751411:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049433216:12345-0@lo:400:kworker.0 Request processed in 29us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.751417:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7178 00000100:00100000:2.0:1787826385.751428:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7179 00000100:00100000:2.0:1787826385.751435:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049432832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.751461:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049432832:12345-0@lo:400:kworker.0 Request processed in 28us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.751467:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7179 00000100:00100000:2.0:1787826385.751478:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7180 00000100:00100000:2.0:1787826385.753602:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049433344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826385.753688:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049433344:12345-0@lo:400:kworker.0 Request processed in 2203us (3806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.753697:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7180 00000100:00100000:0.0:1787826385.753866:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826385.753886:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049433600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826385.753926:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826385.754848:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826385.760942:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826385.760950:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826385.760954:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826385.760957:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826385.760988:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049433728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826385.761056:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826385.761161:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049432320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761176:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049432832:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761187:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975548 gen 2 00000100:00100000:0.0:1787826385.761201:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049433344:0@lo:400:kworker.0 00010000:00080000:0.0:1787826385.761215:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb472617480 x1874663049432192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826385.761226:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049432192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761239:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049432704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761248:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705679 gen 2 00000100:00100000:0.0:1787826385.761257:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049433216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761310:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049431936:0@lo:400:kworker.0 00010000:00080000:0.0:1787826385.761340:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8eb472617b80 x1874663049432448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787826401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826385.761350:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049432448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761364:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049432960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761376:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874663049433472:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761388:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1874663049432064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761397:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049432576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826385.761409:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049433088:0@lo:400:kworker.0 00000100:00100000:1.0:1787826385.765177:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049433600 00000100:00100000:1.0:1787826385.765192:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049433600 00000100:00100000:2.0:1787826385.765257:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049433728 00000100:00100000:2.0:1787826385.765262:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049433728 00000100:00100000:2.0:1787826385.765311:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826385.765321:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049433728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826385.765377:0:187910:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446006784 avail 1299767296 00000100:00100000:2.0:1787826385.765466:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049433728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (4410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.765477:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826385.765558:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049433728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826385.767442:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787826385.767455:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049433600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826385.767589:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:0.0:1787826385.767608:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e868a80 x1874663049433600/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:741/0 lens 224/368 e 0 to 0 dl 1787826396 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826385.767690:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049433600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 237us (13763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.767697:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787826385.767784:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049433600:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787826385.798367:0:199368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 00000100:00100000:1.0:1787826386.261075:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826386.261098:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049433856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826386.261188:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826386.261671:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049433856 00000100:00100000:2.0:1787826386.261681:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049433856 00000100:00100000:2.0:1787826386.261736:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:2.0:1787826386.261746:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049433856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826386.261773:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826386.261826:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049433856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826386.261832:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00000100:00100000:2.0:1787826386.261876:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049433856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826386.262318:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826386.262354:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049433984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826386.262395:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826386.263014:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049433984 00000100:00100000:0.0:1787826386.263021:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049433984 00000100:00100000:0.0:1787826386.263098:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:0.0:1787826386.263108:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049433984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826386.263141:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826386.263211:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049433984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826386.263218:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:1.0:1787826386.263288:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049433984:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826386.774085:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826387.712227:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826387.712723:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826387.712770:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826387.712791:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826387.712814:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826387.712841:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043040000 00000100:00100000:0.0:1787826387.712851:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043040000 00000100:00100000:0.0:1787826387.712911:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043039872 00000100:00100000:0.0:1787826387.712926:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043039872 00000100:00100000:0.0:1787826387.712954:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7181 00000100:00100000:0.0:1787826387.712965:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043040000:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826387.713034:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043040000:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.713043:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7181 00000100:00100000:0.0:1787826387.713059:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7182 00000100:00100000:0.0:1787826387.713065:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043039872:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826387.713090:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043039872:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.713095:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7182 00000100:00100000:0.0:1787826387.713135:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043039744 00000100:00100000:0.0:1787826387.713139:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043039744 00000100:00100000:0.0:1787826387.713167:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043039616 00000100:00100000:0.0:1787826387.713170:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043039616 00000100:00100000:0.0:1787826387.713188:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 439 00000100:00100000:0.0:1787826387.713194:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663043039744:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826387.713220:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2390:x1874663043039744:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.713225:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 439 00000100:00100000:0.0:1787826387.713238:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 440 00000100:00100000:0.0:1787826387.713243:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2390:x1874663043039616:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826387.713256:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86a300 x1874663043039616/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:743/0 lens 224/224 e 0 to 0 dl 1787826398 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826387.713278:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2390:x1874663043039616:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.713285:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 440 00000100:00080000:0.0:1787826387.713304:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826387.713308:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826387.713310:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826387.713312:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826387.722036:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043039488 00000100:00100000:1.0:1787826387.722051:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043039488 00000100:00100000:1.0:1787826387.722131:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00100000:1.0:1787826387.722143:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043039488:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826387.722226:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043039488:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 85us (10008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.722234:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 132 00000001:02000400:3.0:1787826387.742583:0:199417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1787826387.796858:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826388.308745:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826388.308768:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049434112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826388.308837:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826388.309734:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049434112 00000100:00100000:3.0:1787826388.309746:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049434112 00000100:00100000:3.0:1787826388.309824:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:3.0:1787826388.309839:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049434112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826388.309868:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826388.309933:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049434112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826388.309939:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000100:00100000:3.0:1787826388.309999:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049434112:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787826388.310511:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826388.310629:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826388.310642:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049434240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826388.310696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826388.310793:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049434240 00000100:00100000:3.0:1787826388.310798:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049434240 00000100:00100000:3.0:1787826388.310845:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:3.0:1787826388.310854:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049434240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826388.310874:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826388.310913:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049434240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826388.310920:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00100000:3.0:1787826388.310954:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34ddd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049434240:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787826388.311078:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826388.820499:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826389.776344:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826389.779401:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043040128 00000100:00100000:2.0:1787826389.779417:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043040128 00000100:00100000:2.0:1787826389.779517:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1205 00000100:00100000:2.0:1787826389.779529:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163048:x1874663043040128:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826389.779565:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445584896 avail 1299345408 00010000:00000080:2.0:1787826389.779584:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86aa00 x1874663043040128/t0(0) o41->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:745/0 lens 224/368 e 0 to 0 dl 1787826400 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826389.779658:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163048:x1874663043040128:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 131us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826389.779667:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1205 00000100:00080000:0.0:1787826389.782219:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826389.789244:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826389.789362:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043040256 00000100:00100000:0.0:1787826389.789372:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043040256 00000100:00100000:0.0:1787826389.789463:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1206 00000100:00100000:0.0:1787826389.789474:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:163048:x1874663043040256:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826389.789509:0:188682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446006784 avail 1299767296 00000100:00100000:0.0:1787826389.789580:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:163048:x1874663043040256:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.789588:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1206 00000100:00080000:2.0:1787826389.790412:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826389.794261:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826389.794502:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043040384 00000100:00100000:3.0:1787826389.794518:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043040384 00000100:00100000:3.0:1787826389.794738:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5920 00000100:00100000:3.0:1787826389.794773:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163048:x1874663043040384:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826389.794818:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00080000:2.0:1787826389.794873:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826389.794917:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163048:x1874663043040384:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 151us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826389.794926:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5920 00000100:00100000:3.0:1787826389.801839:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826389.802134:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043040512 00000100:00100000:0.0:1787826389.802156:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043040512 00000100:00100000:0.0:1787826389.802255:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5921 00000100:00100000:0.0:1787826389.802268:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34ddd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163048:x1874663043040512:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826389.802304:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00080000:2.0:1787826389.802403:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826389.802419:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34ddd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163048:x1874663043040512:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 153us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.802442:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5921 00010000:00010000:3.0:1787826389.844510:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826389.848518:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826389.848674:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043040768 00000100:00100000:3.0:1787826389.848689:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043040768 00000100:00100000:3.0:1787826389.848840:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1207 00000100:00100000:3.0:1787826389.848855:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163065:x1874663043040768:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826389.848884:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826389.848913:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee95b lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f39a expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.849012:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.849045:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.849058:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.849077:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.849084:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.849101:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826389.849262:0:188992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049434368:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787826389.849380:0:188992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826389.849452:0:188992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb46e38a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826389.851528:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049434368 00000100:00100000:0.0:1787826389.851549:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049434368 00000100:00100000:0.0:1787826389.851639:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787826389.851650:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:188992:x1874663049434368:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787826389.851817:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:188992:x1874663049434368:12345-0@lo:1000:mdt00_004.0 Request processed in 169us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.851826:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787826389.852360:0:188992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472584e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:188992:1874663049434368:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787826389.852451:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cee970 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852470:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cee970 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852485:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cee970 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852500:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852508:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852515:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852522:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441510200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826389.852527:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852536:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852554:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:3.0:1787826389.852557:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826389.852563:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852569:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510200/0x878a5eea00cee962 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852588:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852595:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852600:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852605:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826389.852608:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852614:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852621:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0xf7117594 (ffff8eb481697c00) 00010000:00010000:3.0:1787826389.852624:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826389.852627:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852632:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511200/0x878a5eea00cee969 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852693:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511e00/0x878a5eea00cee95b lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f39a expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.852709:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cee970 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f39a expref: 9 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.853304:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb481697600) 00010000:00010000:3.0:1787826389.853308:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826389.853311:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510400, rc 0) 00010000:00000080:3.0:1787826389.853322:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a228e00 x1874663043040768/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:745/0 lens 656/608 e 0 to 0 dl 1787826400 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826389.853526:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163065:x1874663043040768:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 4673us (5023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826389.853535:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1207 00000100:00100000:1.0:1787826389.857178:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826389.857538:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043041024 00000100:00100000:3.0:1787826389.857552:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043041024 00000100:00100000:3.0:1787826389.857635:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1208 00000100:00100000:3.0:1787826389.857648:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:163065:x1874663043041024:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826389.859481:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826389.859530:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cee977 lrc: 2/0,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3a1 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826389.868380:0:187904:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 8638us 00000004:00200000:2.0:1787826389.904593:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x16:0x0]: returning size 4096 00010000:00010000:2.0:1787826389.904728:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cee977 lrc: 1/0,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3a1 expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.904745:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb481697c00) 00010000:00010000:2.0:1787826389.904748:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826389.904753:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00cee977 lrc: 0/0,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3a1 expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.904788:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511e00, rc 0) 00000100:00100000:2.0:1787826389.906356:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163065:x1874663043041024:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 48701us (49184us total) trans 21474836481 rc 301/301 00000100:00100000:2.0:1787826389.906371:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1208 00000100:00100000:2.0:1787826389.912264:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826389.912565:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043041280 00000100:00100000:0.0:1787826389.912575:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043041280 00000100:00100000:0.0:1787826389.912630:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:0.0:1787826389.912641:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345736050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163065:x1874663043041280:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:0.0:1787826389.913050:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345736050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163065:x1874663043041280:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 253us (639us total) trans 21474836482 rc 0/0 00000100:00100000:0.0:1787826389.913059:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:3.0:1787826389.931250:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826389.932105:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043041536 00000100:00100000:1.0:1787826389.932117:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043041536 00000100:00100000:1.0:1787826389.932446:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1209 00000100:00100000:1.0:1787826389.932457:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163071:x1874663043041536:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826389.932477:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826389.932498:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cee985 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3a8 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826389.932595:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a229180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID:187905:1874663049434496:0@lo:900:mdt00_001.0 00000100:00100000:1.0:1787826389.932641:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826389.932671:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ede5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826389.932752:0:187916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049434496 00000100:00100000:0.0:1787826389.932758:0:187916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049434496 00000100:00100000:0.0:1787826389.932805:0:187916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826389.932820:0:187916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:187905:x1874663049434496:12345-0@lo:900:mdt00_001.0 00010000:00000080:0.0:1787826389.932839:0:187916:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a22a680 x1874663049434496/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:745/0 lens 264/248 e 0 to 0 dl 1787826400 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826389.932899:0:187916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:187905:x1874663049434496:12345-0@lo:900:mdt00_001.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.932907:0:187916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787826389.933130:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a229180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID:187905:1874663049434496:0@lo:900:mdt00_001.0 00000100:00100000:1.0:1787826389.933184:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a229180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049434624:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826389.933213:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826389.933236:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb45ede5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826389.933435:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049434624 00000100:00100000:0.0:1787826389.933441:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049434624 00000100:00100000:0.0:1787826389.933472:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787826389.933479:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:187905:x1874663049434624:12345-0@lo:1000:mdt00_001.0 00010000:00000080:0.0:1787826389.933532:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a229880 x1874663049434624/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:745/0 lens 304/4320 e 0 to 0 dl 1787826400 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826389.933633:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:187905:x1874663049434624:12345-0@lo:1000:mdt00_001.0 Request processed in 152us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.933641:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787826389.937162:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a229180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049434624:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787826389.937300:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714800/0x878a5eea00cee98c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.937310:0:187905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714800/0x878a5eea00cee98c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.937320:0:187905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714800/0x878a5eea00cee98c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826389.938605:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb469f77480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049434752:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1787826389.938669:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826389.938747:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34248e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826389.943622:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049434752 00000100:00100000:0.0:1787826389.943638:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049434752 00000100:00100000:0.0:1787826389.944925:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787826389.944946:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:187905:x1874663049434752:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787826389.944969:0:187910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826389.944993:0:187910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cee993 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cee98c expref: -99 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.945027:0:187910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cee993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cee98c expref: 6 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.945042:0:187910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cee993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cee98c expref: 6 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826389.945051:0:187910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826389.945055:0:187910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826389.945060:0:187910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3ee00, rc 0) 00010000:00000080:0.0:1787826389.945067:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cd6d80 x1874663049434752/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:745/0 lens 328/344 e 0 to 0 dl 1787826400 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826389.945161:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:187905:x1874663049434752:12345-0@lo:101:mdt00_001.0 Request processed in 224us (6491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826389.945168:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787826389.945267:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb469f77480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049434752:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787826389.945300:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714800/0x878a5eea00cee98c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee993 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.945314:0:187905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714800/0x878a5eea00cee98c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee993 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826389.945354:0:187905:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787826389.945362:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714800/0x878a5eea00cee98c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee993 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.945369:0:187905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb481714800/0x878a5eea00cee98c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee993 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.945456:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.945465:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.945477:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.945499:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.945512:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.945518:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826389.945641:0:187905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049434880:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826389.945684:0:187905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826389.952698:0:187905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34248e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826389.956550:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049434880 00000100:00100000:1.0:1787826389.956567:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049434880 00000100:00100000:1.0:1787826389.956628:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787826389.956639:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:187905:x1874663049434880:12345-0@lo:1000:mdt00_001.0 00010000:00000080:1.0:1787826389.956689:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cd4380 x1874663049434880/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:745/0 lens 328/4320 e 0 to 0 dl 1787826400 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826389.956781:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:187905:x1874663049434880:12345-0@lo:1000:mdt00_001.0 Request processed in 143us (11098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826389.956788:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787826389.956966:0:187905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:187905:1874663049434880:0@lo:1000:mdt00_001.0 00000004:00080000:2.0:1787826389.957293:0:187905:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x38c:0x0], count =22 00000004:00080000:2.0:1787826389.957302:0:187905:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x38c:0x0]+22 in llog 00000004:00080000:2.0:1787826389.957318:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3a2:0x0], index 1: 0 00010000:00010000:2.0:1787826389.958022:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee9a8 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958040:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee9a8 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958052:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee9a8 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958087:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958104:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958110:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958116:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958121:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826389.958125:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958132:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958142:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20500) 00010000:00010000:2.0:1787826389.958145:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826389.958149:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958155:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee99a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826389.958170:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046fc50ec reply state 000000008ea30bd6 transno 21474836483 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958181:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958187:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x679fc7b1 (ffff8eb34df4d900) 00010000:00010000:2.0:1787826389.958189:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826389.958192:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826389.958228:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00cee985 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3a8 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958254:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee9a8 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3a8 expref: 10 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.958262:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x17:0x0].0x0 (ffff8eb34df4d700) 00010000:00010000:2.0:1787826389.958264:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826389.958267:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714c00, rc 0) 00000100:00100000:2.0:1787826389.958374:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163071:x1874663043041536:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 25918us (27136us total) trans 21474836483 rc 0/0 00000100:00100000:2.0:1787826389.958383:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1209 00000100:00100000:1.0:1787826389.963274:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826389.963422:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043041792 00000100:00100000:0.0:1787826389.963440:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043041792 00000100:00100000:0.0:1787826389.963523:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 36 00000100:00100000:0.0:1787826389.963535:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163071:x1874663043041792:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826389.963855:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:163071:x1874663043041792:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 322us (596us total) trans 21474836484 rc 0/0 00000100:00100000:0.0:1787826389.963864:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 36 00000100:00100000:3.0:1787826389.980704:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826389.980880:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043042048 00000100:00100000:2.0:1787826389.980890:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043042048 00000100:00100000:2.0:1787826389.980955:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1210 00000100:00100000:2.0:1787826389.980966:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:163071:x1874663043042048:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826389.980989:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826389.981013:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee9b6 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3af expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.981364:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.981380:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.981391:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.981406:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.981414:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826389.981421:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826389.983061:0:188992:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x38c:0x0], count =22 00000004:00080000:3.0:1787826389.983075:0:188992:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x38c:0x0]+22 in llog 00000004:00080000:3.0:1787826389.983084:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3a2:0x0], index 0: 0 00010000:00010000:3.0:1787826389.983260:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cee9cb lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983275:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cee9cb lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983291:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cee9cb lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983371:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983379:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983386:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983392:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826389.983397:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983404:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983416:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb34df4d300) 00010000:00010000:3.0:1787826389.983419:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826389.983423:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983428:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9bd lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826389.983441:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddaa0b11 reply state 00000000cdf8eaf0 transno 21474836485 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983451:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983459:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x94c295fa (ffff8eb34df4d400) 00010000:00010000:3.0:1787826389.983461:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826389.983464:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826389.983511:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00cee9b6 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3af expref: 15 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983532:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cee9cb lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3af expref: 14 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826389.983540:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x18:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:3.0:1787826389.983543:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826389.983545:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441511200, rc 0) 00000100:00100000:3.0:1787826389.984626:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+15:163071:x1874663043042048:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 3655us (3926us total) trans 21474836485 rc 0/0 00000100:00100000:3.0:1787826389.984637:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1210 00000100:00100000:1.0:1787826389.991672:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826389.991751:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043042304 00000100:00100000:0.0:1787826389.991761:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043042304 00000100:00100000:0.0:1787826389.991987:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 37 00000100:00100000:0.0:1787826389.991999:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+15:163071:x1874663043042304:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826389.992290:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+16:163071:x1874663043042304:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 292us (626us total) trans 21474836486 rc 0/0 00000100:00100000:0.0:1787826389.992298:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 37 00000100:00100000:1.0:1787826389.997019:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826389.999942:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043042560 00000100:00100000:2.0:1787826389.999958:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043042560 00000100:00100000:2.0:1787826390.000083:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1211 00000100:00100000:2.0:1787826390.000107:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+16:163071:x1874663043042560:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826390.000131:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.000153:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9d9 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3b6 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.000249:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.000264:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.000274:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.000287:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.000294:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.000301:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826390.000985:0:187904:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3a3:0x0], index 1: 0 00010000:00010000:2.0:1787826390.001254:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee9ee lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001266:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee9ee lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001275:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee9ee lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001304:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001311:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001316:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001322:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.001346:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001353:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001364:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb34df4dd00) 00010000:00010000:2.0:1787826390.001367:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.001371:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001381:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00cee9e0 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.001393:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b256a02 reply state 00000000da71b787 transno 21474836487 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001404:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001410:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xc1e56442 (ffff8eb34df4d100) 00010000:00010000:2.0:1787826390.001412:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826390.001415:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826390.001447:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9d9 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3b6 expref: 19 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001467:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee9ee lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3b6 expref: 18 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.001475:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x19:0x0].0x0 (ffff8eb34df4db00) 00010000:00010000:2.0:1787826390.001477:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826390.001479:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481715a00, rc 0) 00000100:00100000:2.0:1787826390.001684:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+19:163071:x1874663043042560:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1579us (4674us total) trans 21474836487 rc 0/0 00000100:00100000:2.0:1787826390.001694:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1211 00000100:00100000:2.0:1787826390.010067:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.013377:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043042816 00000100:00100000:0.0:1787826390.013391:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043042816 00000100:00100000:0.0:1787826390.013508:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 38 00000100:00100000:0.0:1787826390.013518:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+19:163071:x1874663043042816:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826390.013802:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+20:163071:x1874663043042816:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 285us (3743us total) trans 21474836488 rc 0/0 00000100:00100000:0.0:1787826390.015624:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 38 00000100:00100000:1.0:1787826390.022721:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.022834:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043043072 00000100:00100000:2.0:1787826390.022845:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043043072 00000100:00100000:2.0:1787826390.022910:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1212 00000100:00100000:2.0:1787826390.022923:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+20:163071:x1874663043043072:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826390.022947:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.022972:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9fc lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3bd expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.023154:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.023168:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.023178:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.023190:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xef08328a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.023197:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.023203:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826390.024244:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3a3:0x0], index 0: 0 00010000:00010000:2.0:1787826390.024405:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceea11 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.024417:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceea11 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.024425:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceea11 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.024458:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.024466:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.024471:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.024478:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.024483:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.024487:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.025895:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.025920:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb34df4dd00) 00010000:00010000:2.0:1787826390.025924:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.025929:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.025937:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceea03 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.025954:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c94982c reply state 000000008b5df404 transno 21474836489 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.025965:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.025972:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xef08328a (ffff8eb34df4df00) 00010000:00010000:2.0:1787826390.025974:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826390.025977:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826390.026025:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00cee9fc lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3bd expref: 23 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.026048:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceea11 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3bd expref: 22 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.026057:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1a:0x0].0x0 (ffff8eb34df4d800) 00010000:00010000:2.0:1787826390.026059:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826390.026061:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714200, rc 0) 00000100:00100000:2.0:1787826390.026200:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+23:163071:x1874663043043072:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 3278us (3486us total) trans 21474836489 rc 0/0 00000100:00100000:2.0:1787826390.026209:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1212 00000100:00100000:1.0:1787826390.047716:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.047929:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043043328 00000100:00100000:3.0:1787826390.047940:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043043328 00000100:00100000:3.0:1787826390.047992:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:3.0:1787826390.048002:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+23:163071:x1874663043043328:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.048285:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+24:163071:x1874663043043328:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 284us (579us total) trans 21474836490 rc 0/0 00000100:00100000:3.0:1787826390.048293:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:3.0:1787826390.054857:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.054967:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043043584 00000100:00100000:0.0:1787826390.054977:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043043584 00000100:00100000:0.0:1787826390.055037:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1213 00000100:00100000:0.0:1787826390.055046:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+24:163071:x1874663043043584:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826390.055069:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.055103:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceea1f lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3c4 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.055208:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.055221:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.055232:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.055243:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.055250:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.055256:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.059476:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3a4:0x0], index 1: 0 00010000:00010000:1.0:1787826390.059754:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceea34 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059770:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceea34 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059783:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceea34 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059819:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059827:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059835:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059842:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.059846:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059854:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059867:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb453a77000) 00010000:00010000:1.0:1787826390.059870:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.059875:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059881:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceea26 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.059894:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099eafa3c reply state 00000000d6fb663f transno 21474836491 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059904:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059910:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x1c2b00d3 (ffff8eb453a77700) 00010000:00010000:1.0:1787826390.059912:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.059915:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.059952:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceea1f lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3c4 expref: 27 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059972:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceea34 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3c4 expref: 26 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.059980:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1b:0x0].0x0 (ffff8eb45ed20000) 00010000:00010000:1.0:1787826390.059982:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.059984:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357e00, rc 0) 00000100:00100000:1.0:1787826390.060113:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+27:163071:x1874663043043584:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 5066us (5265us total) trans 21474836491 rc 0/0 00000100:00100000:1.0:1787826390.060122:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1213 00000100:00100000:1.0:1787826390.073501:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.073597:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043043840 00000100:00100000:3.0:1787826390.073607:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043043840 00000100:00100000:3.0:1787826390.073666:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:3.0:1787826390.073677:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+27:163071:x1874663043043840:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.073978:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+28:163071:x1874663043043840:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 301us (486us total) trans 21474836492 rc 0/0 00000100:00100000:3.0:1787826390.073985:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:2.0:1787826390.085081:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.085274:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043044096 00000100:00100000:0.0:1787826390.085283:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043044096 00000100:00100000:0.0:1787826390.085377:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1214 00000100:00100000:0.0:1787826390.085387:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+28:163071:x1874663043044096:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826390.085413:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.085436:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceea42 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3cb expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.085529:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.085542:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.085553:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.085563:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.085570:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.085576:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.086533:0:187904:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3a4:0x0], index 0: 0 00010000:00010000:1.0:1787826390.086672:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceea57 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086684:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceea57 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086693:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceea57 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086734:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086741:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086748:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086755:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.086758:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086765:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086776:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb453a77d00) 00010000:00010000:1.0:1787826390.086944:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.086950:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086957:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceea49 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.086971:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006248b78 reply state 00000000bf75109f transno 21474836493 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086981:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.086988:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x494dcf1b (ffff8eb453a77200) 00010000:00010000:1.0:1787826390.086990:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.086993:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.087027:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceea42 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3cb expref: 31 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.087047:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceea57 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3cb expref: 30 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.087061:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1c:0x0].0x0 (ffff8eb45ed20f00) 00010000:00010000:1.0:1787826390.087063:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.087065:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356400, rc 0) 00000100:00100000:1.0:1787826390.087218:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+31:163071:x1874663043044096:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1831us (2145us total) trans 21474836493 rc 0/0 00000100:00100000:1.0:1787826390.087227:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1214 00000100:00100000:2.0:1787826390.102305:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.102456:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043044352 00000100:00100000:3.0:1787826390.102466:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043044352 00000100:00100000:3.0:1787826390.102516:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:3.0:1787826390.102528:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345735850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+31:163071:x1874663043044352:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.102826:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345735850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+32:163071:x1874663043044352:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 300us (529us total) trans 21474836494 rc 0/0 00000100:00100000:3.0:1787826390.102834:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:2.0:1787826390.117099:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.117219:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043044608 00000100:00100000:1.0:1787826390.117229:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043044608 00000100:00100000:1.0:1787826390.117288:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1215 00000100:00100000:1.0:1787826390.117298:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+32:163071:x1874663043044608:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826390.117322:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.117383:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceea65 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3d2 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.117549:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.117563:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.117576:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.117592:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.117600:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.117607:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.119432:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3a5:0x0], index 1: 0 00010000:00010000:0.0:1787826390.119625:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceea7a lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119641:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceea7a lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119654:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceea7a lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119690:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119698:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119704:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119712:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119718:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.119723:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119736:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119750:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20800) 00010000:00010000:0.0:1787826390.119753:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.119758:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119765:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceea6c lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.119778:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e5372da reply state 000000008b881f96 transno 21474836495 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119788:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119794:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x76709d63 (ffff8eb453a77500) 00010000:00010000:0.0:1787826390.119796:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.119799:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826390.119844:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceea65 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3d2 expref: 35 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119866:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceea7a lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3d2 expref: 34 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.119874:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1d:0x0].0x0 (ffff8eb453a77100) 00010000:00010000:0.0:1787826390.119876:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.119878:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f800, rc 0) 00000100:00100000:0.0:1787826390.119951:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+35:163071:x1874663043044608:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2654us (2872us total) trans 21474836495 rc 0/0 00000100:00100000:0.0:1787826390.119960:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1215 00000100:00100000:2.0:1787826390.143110:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.143243:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043044864 00000100:00100000:3.0:1787826390.143253:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043044864 00000100:00100000:3.0:1787826390.143318:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:3.0:1787826390.143368:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+35:163071:x1874663043044864:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.143640:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+36:163071:x1874663043044864:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 274us (548us total) trans 21474836496 rc 0/0 00000100:00100000:3.0:1787826390.143649:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:2.0:1787826390.147008:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.147976:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043045120 00000100:00100000:1.0:1787826390.147991:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043045120 00000100:00100000:1.0:1787826390.148061:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1216 00000100:00100000:1.0:1787826390.148072:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+36:163071:x1874663043045120:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826390.148109:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.148133:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceea88 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3d9 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.148249:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.148262:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.148274:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.148287:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.148293:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.148299:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.149288:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3a5:0x0], index 0: 0 00010000:00010000:1.0:1787826390.149461:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceea9d lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149474:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceea9d lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149483:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceea9d lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149518:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149525:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149533:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149539:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.149545:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149552:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149564:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20700) 00010000:00010000:1.0:1787826390.149568:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.149572:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149579:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceea8f lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.149592:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006249c71c reply state 00000000c9955ba3 transno 21474836497 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149604:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149610:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xa3936bac (ffff8eb45ed20400) 00010000:00010000:1.0:1787826390.149613:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.149616:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.149647:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceea88 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3d9 expref: 39 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149669:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceea9d lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3d9 expref: 38 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.149677:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1e:0x0].0x0 (ffff8eb45ed20900) 00010000:00010000:1.0:1787826390.149679:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.149682:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356000, rc 0) 00000100:00100000:1.0:1787826390.152431:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+39:163071:x1874663043045120:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 4350us (5421us total) trans 21474836497 rc 0/0 00000100:00100000:1.0:1787826390.152443:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1216 00000100:00100000:1.0:1787826390.157206:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.157979:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043045376 00000100:00100000:3.0:1787826390.157992:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043045376 00000100:00100000:3.0:1787826390.158057:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:3.0:1787826390.158068:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+39:163071:x1874663043045376:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.158390:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+40:163071:x1874663043045376:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 323us (1194us total) trans 21474836498 rc 0/0 00000100:00100000:3.0:1787826390.158402:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:3.0:1787826390.161209:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.161317:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043045632 00000100:00100000:1.0:1787826390.161363:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043045632 00000100:00100000:1.0:1787826390.161419:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1217 00000100:00100000:1.0:1787826390.161429:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+40:163071:x1874663043045632:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826390.161452:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.161476:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceeaab lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3e0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.161580:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.161595:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.161607:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.161620:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.161628:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.161635:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.162150:0:187904:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3a6:0x0], index 1: 0 00010000:00010000:1.0:1787826390.162288:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceeac0 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162299:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceeac0 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162306:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceeac0 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162584:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162593:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162601:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162607:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.162612:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162619:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162632:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20d00) 00010000:00010000:1.0:1787826390.162635:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.162640:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162651:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeab2 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.162666:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bdee8db reply state 00000000a1201185 transno 21474836499 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162677:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162683:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xd0b639f4 (ffff8eb45ed20e00) 00010000:00010000:1.0:1787826390.162686:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.162690:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.162724:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceeaab lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3e0 expref: 43 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162745:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceeac0 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3e0 expref: 42 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.162753:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1f:0x0].0x0 (ffff8eb45ed20200) 00010000:00010000:1.0:1787826390.162755:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.162757:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356800, rc 0) 00000100:00100000:1.0:1787826390.163287:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+43:163071:x1874663043045632:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1857us (2086us total) trans 21474836499 rc 0/0 00000100:00100000:1.0:1787826390.163297:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1217 00000100:00100000:1.0:1787826390.172797:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.172931:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043045888 00000100:00100000:3.0:1787826390.172942:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043045888 00000100:00100000:3.0:1787826390.173022:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:3.0:1787826390.173033:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+43:163071:x1874663043045888:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.173380:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+44:163071:x1874663043045888:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 347us (593us total) trans 21474836500 rc 0/0 00000100:00100000:3.0:1787826390.173388:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:2.0:1787826390.194308:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.194435:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043046144 00000100:00100000:0.0:1787826390.194445:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043046144 00000100:00100000:0.0:1787826390.194505:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1218 00000100:00100000:0.0:1787826390.194516:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+44:163071:x1874663043046144:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826390.194542:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.194568:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceeace lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3e7 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.194672:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.194686:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.194700:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.194724:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.194732:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.194739:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.195056:0:187905:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3a6:0x0], index 0: 0 00010000:00010000:0.0:1787826390.195196:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f600/0x878a5eea00ceeae3 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195206:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f600/0x878a5eea00ceeae3 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195214:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f600/0x878a5eea00ceeae3 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195245:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195252:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195258:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195264:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195270:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.195275:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195282:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195294:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb453a77900) 00010000:00010000:0.0:1787826390.195297:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.195301:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195312:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceead5 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.195368:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f427a9b0 reply state 0000000059b57d9c transno 21474836501 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195379:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195385:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xfdd9083c (ffff8eb453a77300) 00010000:00010000:0.0:1787826390.195388:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.195390:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826390.195415:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceeace lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3e7 expref: 47 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195433:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f600/0x878a5eea00ceeae3 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3e7 expref: 46 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.195441:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x20:0x0].0x0 (ffff8eb453a77800) 00010000:00010000:0.0:1787826390.195443:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.195445:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f600, rc 0) 00000100:00100000:0.0:1787826390.195498:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+47:163071:x1874663043046144:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 984us (1200us total) trans 21474836501 rc 0/0 00000100:00100000:0.0:1787826390.195506:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1218 00000100:00100000:2.0:1787826390.204498:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.204606:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043046400 00000100:00100000:3.0:1787826390.204617:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043046400 00000100:00100000:3.0:1787826390.204742:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00100000:3.0:1787826390.204754:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+47:163071:x1874663043046400:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.205126:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+48:163071:x1874663043046400:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 374us (638us total) trans 21474836502 rc 0/0 00000100:00100000:3.0:1787826390.205135:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00100000:2.0:1787826390.208377:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.208463:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043046656 00000100:00100000:1.0:1787826390.208473:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043046656 00000100:00100000:1.0:1787826390.208522:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1219 00000100:00100000:1.0:1787826390.208533:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+48:163071:x1874663043046656:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826390.208558:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.208581:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceeaf1 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3ee expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.208687:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.208701:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.208711:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209155:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209167:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209175:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.209522:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3a7:0x0], index 1: 0 00010000:00010000:1.0:1787826390.209656:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceeb06 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209665:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceeb06 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209673:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceeb06 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209720:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209728:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209734:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209740:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.209744:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.209751:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.211250:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20d00) 00010000:00010000:1.0:1787826390.211263:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.211276:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.211286:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeaf8 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.211310:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aba6f4d9 reply state 0000000046499d0c transno 21474836503 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.211356:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.211365:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x1b7026cc (ffff8eb45ed20700) 00010000:00010000:1.0:1787826390.211369:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.211373:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.211425:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceeaf1 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3ee expref: 51 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.211448:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceeb06 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3ee expref: 50 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.211456:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x21:0x0].0x0 (ffff8eb45ed20b00) 00010000:00010000:1.0:1787826390.211457:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.211459:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:1.0:1787826390.211599:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+51:163071:x1874663043046656:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 3066us (3230us total) trans 21474836503 rc 0/0 00000100:00100000:1.0:1787826390.211610:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1219 00000100:00100000:2.0:1787826390.228539:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.229362:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043046912 00000100:00100000:0.0:1787826390.229375:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043046912 00000100:00100000:0.0:1787826390.229435:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:0.0:1787826390.229446:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+51:163071:x1874663043046912:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826390.229782:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+52:163071:x1874663043046912:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 336us (1252us total) trans 21474836504 rc 0/0 00000100:00100000:0.0:1787826390.229791:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:3.0:1787826390.233738:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.233972:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043047168 00000100:00100000:1.0:1787826390.233983:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043047168 00000100:00100000:1.0:1787826390.234044:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1220 00000100:00100000:1.0:1787826390.234056:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+52:163071:x1874663043047168:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826390.234080:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.234114:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceeb14 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3f5 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.234221:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.234235:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.234245:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.234257:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.234263:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.234270:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.236196:0:187904:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3a7:0x0], index 0: 0 00010000:00010000:0.0:1787826390.236524:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceeb29 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236539:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceeb29 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236551:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceeb29 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236592:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236599:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236606:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236611:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.236615:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236621:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236633:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20d00) 00010000:00010000:0.0:1787826390.236637:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.236640:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236645:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb1b lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.236658:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c76fe49d reply state 00000000e9fed74c transno 21474836505 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236668:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236674:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x3e3e6f26 (ffff8eb45ed20c00) 00010000:00010000:0.0:1787826390.236676:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.236679:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826390.236714:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceeb14 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3f5 expref: 55 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236737:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceeb29 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3f5 expref: 54 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.236743:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x22:0x0].0x0 (ffff8eb453a77900) 00010000:00010000:0.0:1787826390.236745:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.236747:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3fc00, rc 0) 00000100:00100000:0.0:1787826390.237149:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+55:163071:x1874663043047168:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 3092us (3419us total) trans 21474836505 rc 0/0 00000100:00100000:0.0:1787826390.237158:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1220 00000100:00100000:2.0:1787826390.242311:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.242458:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043047424 00000100:00100000:0.0:1787826390.242468:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043047424 00000100:00100000:0.0:1787826390.242525:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:0.0:1787826390.242537:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345735050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+55:163071:x1874663043047424:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826390.242901:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345735050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+56:163071:x1874663043047424:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 365us (599us total) trans 21474836506 rc 0/0 00000100:00100000:0.0:1787826390.242909:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:2.0:1787826390.250190:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.250390:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043047680 00000100:00100000:3.0:1787826390.250399:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043047680 00000100:00100000:3.0:1787826390.250442:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1221 00000100:00100000:3.0:1787826390.250451:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+56:163071:x1874663043047680:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:3.0:1787826390.250681:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826390.250821:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00ceeb37 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f3fc expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.250936:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.250949:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.250961:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.250974:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.250981:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.250988:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.252127:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3a8:0x0], index 1: 0 00010000:00010000:0.0:1787826390.252310:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceeb4c lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252470:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceeb4c lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252485:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceeb4c lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252523:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252531:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252537:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252543:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252549:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441511e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.252554:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252565:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252579:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb481697900) 00010000:00010000:0.0:1787826390.252582:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.252587:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252593:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceeb3e lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.252609:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ae1f86b reply state 00000000e9740aa8 transno 21474836507 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252620:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252627:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x610cb780 (ffff8eb481697300) 00010000:00010000:0.0:1787826390.252629:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.252632:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826390.252669:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00ceeb37 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3fc expref: 59 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252690:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceeb4c lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3fc expref: 58 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.252698:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x23:0x0].0x0 (ffff8eb453a77400) 00010000:00010000:0.0:1787826390.252701:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.252703:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f200, rc 0) 00000100:00100000:0.0:1787826390.252907:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+59:163071:x1874663043047680:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2456us (2735us total) trans 21474836507 rc 0/0 00000100:00100000:0.0:1787826390.252929:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1221 00000100:00100000:2.0:1787826390.266204:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.266280:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043047936 00000100:00100000:0.0:1787826390.266290:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043047936 00000100:00100000:0.0:1787826390.266367:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:0.0:1787826390.266382:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+59:163071:x1874663043047936:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826390.266662:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+60:163071:x1874663043047936:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 284us (465us total) trans 21474836508 rc 0/0 00000100:00100000:0.0:1787826390.266670:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:2.0:1787826390.277572:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.277653:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043048192 00000100:00100000:1.0:1787826390.277664:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043048192 00000100:00100000:1.0:1787826390.277736:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1222 00000100:00100000:1.0:1787826390.277746:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+60:163071:x1874663043048192:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826390.277778:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.277804:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceeb5a lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f403 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.277930:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.277944:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.278266:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.278285:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.278292:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.278299:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.278621:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3a8:0x0], index 0: 0 00010000:00010000:1.0:1787826390.278752:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceeb6f lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.278775:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceeb6f lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.278783:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceeb6f lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279206:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279214:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279219:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279225:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.279230:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279237:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279250:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20a00) 00010000:00010000:1.0:1787826390.279253:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.279258:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279264:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357a00/0x878a5eea00ceeb61 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.279278:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b191ed10 reply state 000000009b1a200d transno 21474836509 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279288:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279293:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x83daffd9 (ffff8eb45ed20300) 00010000:00010000:1.0:1787826390.279295:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.279298:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.279380:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceeb5a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f403 expref: 63 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279399:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceeb6f lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f403 expref: 62 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.279406:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x24:0x0].0x0 (ffff8eb45ed20100) 00010000:00010000:1.0:1787826390.279408:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.279410:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8f800, rc 0) 00000100:00100000:1.0:1787826390.279480:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+63:163071:x1874663043048192:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1734us (1917us total) trans 21474836509 rc 0/0 00000100:00100000:1.0:1787826390.279488:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1222 00000100:00100000:2.0:1787826390.284202:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.284302:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043048448 00000100:00100000:0.0:1787826390.284313:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043048448 00000100:00100000:0.0:1787826390.284413:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:0.0:1787826390.284425:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+63:163071:x1874663043048448:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826390.284685:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+64:163071:x1874663043048448:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 263us (495us total) trans 21474836510 rc 0/0 00000100:00100000:0.0:1787826390.284701:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:0.0:1787826390.290277:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.290622:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043048704 00000100:00100000:2.0:1787826390.290632:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043048704 00000100:00100000:2.0:1787826390.290708:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1223 00000100:00100000:2.0:1787826390.290985:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+64:163071:x1874663043048704:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:2.0:1787826390.291009:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826390.291034:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceeb7d lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f40a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291156:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291169:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291180:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291192:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291199:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291204:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826390.291558:0:187904:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3a9:0x0], index 1: 0 00010000:00010000:2.0:1787826390.291688:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeb92 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291720:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeb92 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291728:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeb92 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291759:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291768:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291775:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291781:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.291786:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.291794:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.292597:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb34df4dd00) 00010000:00010000:2.0:1787826390.292604:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.292610:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.292617:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceeb84 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.292632:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000103d3d7 reply state 00000000c44725be transno 21474836511 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.292644:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.292651:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xa6a94833 (ffff8eb34df4d000) 00010000:00010000:2.0:1787826390.292653:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826390.292656:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826390.292703:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceeb7d lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f40a expref: 67 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.292965:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeb92 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f40a expref: 66 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.292973:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x25:0x0].0x0 (ffff8eb34df4de00) 00010000:00010000:2.0:1787826390.292975:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826390.292978:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb481714400, rc 0) 00000100:00100000:2.0:1787826390.293060:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+67:163071:x1874663043048704:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2078us (2793us total) trans 21474836511 rc 0/0 00000100:00100000:2.0:1787826390.296348:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1223 00000100:00100000:2.0:1787826390.299226:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.299549:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043048960 00000100:00100000:0.0:1787826390.299560:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043048960 00000100:00100000:0.0:1787826390.299618:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:0.0:1787826390.299628:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+67:163071:x1874663043048960:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826390.299938:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+68:163071:x1874663043048960:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 310us (719us total) trans 21474836512 rc 0/0 00000100:00100000:0.0:1787826390.299946:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:1.0:1787826390.302702:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.302870:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043049216 00000100:00100000:0.0:1787826390.302881:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043049216 00000100:00100000:0.0:1787826390.302944:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1224 00000100:00100000:0.0:1787826390.302955:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+68:163071:x1874663043049216:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826390.302979:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.303004:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceeba0 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f411 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.303119:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.303133:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.303144:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.303156:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xc977908d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.303163:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.303170:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.305205:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3a9:0x0], index 0: 0 00010000:00010000:1.0:1787826390.305394:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceebb5 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305413:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceebb5 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305425:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceebb5 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305467:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305476:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305482:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305489:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305495:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.305499:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305506:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305518:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb453a77c00) 00010000:00010000:1.0:1787826390.305521:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.305526:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305533:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceeba7 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.305548:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006826d285 reply state 00000000e7293a39 transno 21474836513 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305559:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305565:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xc977908d (ffff8eb453a77600) 00010000:00010000:1.0:1787826390.305567:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.305570:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.305603:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceeba0 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f411 expref: 71 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305620:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceebb5 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f411 expref: 70 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.305627:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x26:0x0].0x0 (ffff8eb45ed20a00) 00010000:00010000:1.0:1787826390.305630:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.305632:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8e000, rc 0) 00000100:00100000:1.0:1787826390.305705:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+71:163071:x1874663043049216:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2751us (3011us total) trans 21474836513 rc 0/0 00000100:00100000:1.0:1787826390.305713:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1224 00000100:00100000:2.0:1787826390.309174:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.309521:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043049472 00000100:00100000:3.0:1787826390.309533:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043049472 00000100:00100000:3.0:1787826390.309594:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:3.0:1787826390.309604:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+71:163071:x1874663043049472:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.309901:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+72:163071:x1874663043049472:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 298us (735us total) trans 21474836514 rc 0/0 00000100:00100000:3.0:1787826390.309909:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:2.0:1787826390.314534:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.314958:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043049728 00000100:00100000:1.0:1787826390.314970:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043049728 00000100:00100000:1.0:1787826390.315026:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1225 00000100:00100000:1.0:1787826390.315036:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+72:163071:x1874663043049728:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826390.315060:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.315082:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceebc3 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f418 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.315210:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.315226:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.315237:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.315250:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.315257:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.315264:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.317425:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3aa:0x0], index 1: 0 00010000:00010000:1.0:1787826390.318312:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00ceebd8 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318358:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00ceebd8 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318369:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00ceebd8 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318412:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318422:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318429:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318437:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.318441:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318450:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318539:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20600) 00010000:00010000:1.0:1787826390.318542:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.318547:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318553:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceebca lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.318567:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0c65d93 reply state 00000000a97895ad transno 21474836515 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318577:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318584:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xec45d8e7 (ffff8eb45ed20d00) 00010000:00010000:1.0:1787826390.318586:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.318589:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.318630:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceebc3 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f418 expref: 75 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.318995:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00ceebd8 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f418 expref: 74 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.319003:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x27:0x0].0x0 (ffff8eb45ed20800) 00010000:00010000:1.0:1787826390.319005:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.319008:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8fe00, rc 0) 00000100:00100000:1.0:1787826390.319104:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+75:163071:x1874663043049728:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 4069us (4580us total) trans 21474836515 rc 0/0 00000100:00100000:1.0:1787826390.319112:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1225 00000100:00100000:2.0:1787826390.334681:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.334846:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043049984 00000100:00100000:3.0:1787826390.334855:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043049984 00000100:00100000:3.0:1787826390.334902:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:3.0:1787826390.334912:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+75:163071:x1874663043049984:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.335200:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+76:163071:x1874663043049984:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 289us (536us total) trans 21474836516 rc 0/0 00000100:00100000:3.0:1787826390.335208:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:2.0:1787826390.344254:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.344374:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043050240 00000100:00100000:0.0:1787826390.344385:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043050240 00000100:00100000:0.0:1787826390.344448:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1226 00000100:00100000:0.0:1787826390.344459:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+76:163071:x1874663043050240:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826390.344485:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.344509:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceebe6 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f41f expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.344619:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.344634:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.344644:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.344657:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xf142140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.344664:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.344671:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.345049:0:187904:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3aa:0x0], index 0: 0 00010000:00010000:0.0:1787826390.345205:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceebfb lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345215:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceebfb lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345222:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceebfb lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345259:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345266:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345272:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345279:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.345284:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345291:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345303:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb453a77b00) 00010000:00010000:0.0:1787826390.345305:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.345310:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345315:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceebed lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.345385:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f9aad2f reply state 0000000001fafccf transno 21474836517 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345398:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345404:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xf142140 (ffff8eb453a77c00) 00010000:00010000:0.0:1787826390.345407:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.345411:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826390.345442:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceebe6 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f41f expref: 79 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345462:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceebfb lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f41f expref: 78 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.345470:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x28:0x0].0x0 (ffff8eb453a77d00) 00010000:00010000:0.0:1787826390.345472:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.345475:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f400, rc 0) 00000100:00100000:0.0:1787826390.345540:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+79:163071:x1874663043050240:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 1082us (1297us total) trans 21474836517 rc 0/0 00000100:00100000:0.0:1787826390.345549:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1226 00000100:00100000:2.0:1787826390.351997:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.352107:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043050496 00000100:00100000:3.0:1787826390.352119:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043050496 00000100:00100000:3.0:1787826390.352229:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:3.0:1787826390.352240:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345737450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+79:163071:x1874663043050496:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:3.0:1787826390.352560:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345737450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+80:163071:x1874663043050496:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 320us (572us total) trans 21474836518 rc 0/0 00000100:00100000:3.0:1787826390.352568:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:1.0:1787826390.360313:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.360678:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043050752 00000100:00100000:0.0:1787826390.360993:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043050752 00000100:00100000:0.0:1787826390.361061:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1227 00000100:00100000:0.0:1787826390.361072:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+80:163071:x1874663043050752:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:0.0:1787826390.361108:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.361132:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec09 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f426 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361637:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361652:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361662:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361674:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361681:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.361686:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.362193:0:188682:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3ab:0x0], index 1: 0 00010000:00010000:0.0:1787826390.362656:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceec1e lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362667:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceec1e lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362675:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceec1e lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362706:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362892:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362898:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362905:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362914:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3f000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.362919:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362975:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.362989:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb453a77b00) 00010000:00010000:0.0:1787826390.362992:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.362996:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.363002:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec10 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.363017:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b60e727 reply state 00000000be03d157 transno 21474836519 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.363027:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.363034:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x31e2699a (ffff8eb453a77000) 00010000:00010000:0.0:1787826390.363036:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.363039:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826390.363074:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec09 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f426 expref: 83 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.363109:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceec1e lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f426 expref: 82 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.363122:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x29:0x0].0x0 (ffff8eb453a77a00) 00010000:00010000:0.0:1787826390.363124:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.363127:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e200, rc 0) 00000100:00100000:0.0:1787826390.363367:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+83:163071:x1874663043050752:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 2295us (3138us total) trans 21474836519 rc 0/0 00000100:00100000:0.0:1787826390.363377:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1227 00000100:00100000:2.0:1787826390.373166:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.373276:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043051008 00000100:00100000:0.0:1787826390.373286:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043051008 00000100:00100000:0.0:1787826390.373388:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:0.0:1787826390.373400:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+83:163071:x1874663043051008:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826390.373696:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+84:163071:x1874663043051008:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 297us (538us total) trans 21474836520 rc 0/0 00000100:00100000:0.0:1787826390.373704:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:2.0:1787826390.378420:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.378717:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043051264 00000100:00100000:1.0:1787826390.378728:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043051264 00000100:00100000:1.0:1787826390.378796:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1228 00000100:00100000:1.0:1787826390.378808:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+84:163071:x1874663043051264:12345-192.168.203.47@tcp:101:createmany.0 00010000:00010000:1.0:1787826390.378833:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.378855:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceec2c lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f42d expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.378958:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.378973:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.378984:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.379002:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.379010:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.379017:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.379385:0:188992:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3ab:0x0], index 0: 0 00010000:00010000:1.0:1787826390.381228:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00ceec41 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381249:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00ceec41 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381262:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00ceec41 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381303:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381311:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381318:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381654:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.381660:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381672:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381684:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb45ed20600) 00010000:00010000:1.0:1787826390.381686:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.381691:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381697:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec33 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.381716:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008296c27b reply state 0000000063e8fbf6 transno 21474836521 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381726:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381733:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x54b0b1f4 (ffff8eb45ed20500) 00010000:00010000:1.0:1787826390.381735:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.381738:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826390.381777:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceec2c lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f42d expref: 87 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381810:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00ceec41 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f42d expref: 86 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.381818:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2a:0x0].0x0 (ffff8eb44972e800) 00010000:00010000:1.0:1787826390.381820:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826390.381823:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8fc00, rc 0) 00000100:00100000:1.0:1787826390.381898:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+87:163071:x1874663043051264:12345-192.168.203.47@tcp:101:createmany.0 Request processed in 3091us (3488us total) trans 21474836521 rc 0/0 00000100:00100000:1.0:1787826390.381907:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1228 00000100:00100000:1.0:1787826390.386251:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.386535:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043051520 00000100:00100000:0.0:1787826390.386545:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043051520 00000100:00100000:0.0:1787826390.386604:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:0.0:1787826390.386615:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+87:163071:x1874663043051520:12345-192.168.203.47@tcp:35:createmany.0 00000100:00100000:0.0:1787826390.386898:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+88:163071:x1874663043051520:12345-192.168.203.47@tcp:35:createmany.0 Request processed in 283us (656us total) trans 21474836522 rc 0/0 00000100:00100000:0.0:1787826390.386905:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:2.0:1787826390.428293:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.428583:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043051776 00000100:00100000:0.0:1787826390.428593:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043051776 00000100:00100000:0.0:1787826390.428687:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1229 00000100:00100000:0.0:1787826390.428709:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+88:163076:x1874663043051776:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826390.428735:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.428758:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec4f lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f434 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826390.428863:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x16:0x0]: returning size 4096 00010000:00010000:0.0:1787826390.428977:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec4f lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f434 expref: 90 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.428993:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb453a77b00) 00010000:00010000:0.0:1787826390.428996:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826390.429002:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec4f lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f434 expref: 90 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.429023:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e800, rc 0) 00000100:00100000:0.0:1787826390.429096:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+89:163076:x1874663043051776:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 381us (806us total) trans 21474836523 rc 301/301 00000100:00100000:0.0:1787826390.429104:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1229 00000100:00100000:2.0:1787826390.440535:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.440706:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043052032 00000100:00100000:0.0:1787826390.440728:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043052032 00000100:00100000:0.0:1787826390.440790:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1230 00000100:00100000:0.0:1787826390.441002:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+89:163076:x1874663043052032:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826390.441031:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.441055:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec5d lrc: 2/0,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f43b expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.441165:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec64 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.441192:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec64 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.441204:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec64 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826390.441214:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x18:0x0]: returning size 0 00010000:00010000:0.0:1787826390.441457:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec5d lrc: 0/0,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f43b expref: 92 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.441552:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec64 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f43b expref: 91 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.441560:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x18:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:0.0:1787826390.441563:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826390.441567:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f000, rc 0) 00000100:00100000:0.0:1787826390.441663:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+91:163076:x1874663043052032:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 863us (1137us total) trans 21474836524 rc 0/0 00000100:00100000:0.0:1787826390.441671:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1230 00000100:00100000:1.0:1787826390.449455:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.449594:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043052288 00000100:00100000:0.0:1787826390.449604:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043052288 00000100:00100000:0.0:1787826390.449663:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:0.0:1787826390.449674:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+91:163076:x1874663043052288:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:0.0:1787826390.449894:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+92:163076:x1874663043052288:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 221us (459us total) trans 21474836525 rc 0/0 00000100:00100000:0.0:1787826390.449901:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:2.0:1787826390.451850:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.451938:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043052416 00000100:00100000:1.0:1787826390.451946:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043052416 00000100:00100000:1.0:1787826390.452006:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4247 00000100:00100000:1.0:1787826390.452016:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+92:2391:x1874663043052416:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826390.452030:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826390.452054:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec64 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f43b expref: 92 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.452073:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x18:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:1.0:1787826390.452077:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826390.452141:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+91:2391:x1874663043052416:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 127us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.452148:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4247 00000100:00100000:2.0:1787826390.454542:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.454640:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043052672 00000100:00100000:0.0:1787826390.454649:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043052672 00000100:00100000:0.0:1787826390.454710:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:0.0:1787826390.454720:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+91:163076:x1874663043052672:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:0.0:1787826390.454934:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+92:163076:x1874663043052672:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 215us (400us total) trans 21474836526 rc 0/0 00000100:00100000:0.0:1787826390.454942:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:3.0:1787826390.470004:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.470128:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043052800 00000100:00100000:1.0:1787826390.470138:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043052800 00000100:00100000:1.0:1787826390.470559:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1231 00000100:00100000:1.0:1787826390.470572:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163077:x1874663043052800:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:1.0:1787826390.470592:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.470612:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f442 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.470680:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.470694:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.470707:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826390.470818:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1787826390.470821:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1787826390.470839:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.470866:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceec72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.470889:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.470899:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:1.0:1787826390.470902:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826390.470905:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb47fa8f000, rc 0) 00010000:00000080:1.0:1787826390.470912:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348ffca80 x1874663043052800/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:746/0 lens 576/688 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787826390.471028:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163077:x1874663043052800:12345-192.168.203.47@tcp:101:rm.0 Request processed in 459us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.471035:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1231 00000100:00100000:3.0:1787826390.475882:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.476000:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043053056 00000100:00100000:0.0:1787826390.476010:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043053056 00000100:00100000:0.0:1787826390.476111:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1232 00000100:00100000:0.0:1787826390.476121:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163077:x1874663043053056:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826390.476152:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.476172:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f449 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826390.476285:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1787826390.476446:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f449 expref: 12 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.476584:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826390.476588:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826390.476594:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f449 expref: 12 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.476611:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3e800, rc 0) 00010000:00000080:0.0:1787826390.476619:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a42aa00 x1874663043053056/t352187318295(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:746/0 lens 648/664 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/600/0 rc 301/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826390.476702:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163077:x1874663043053056:12345-192.168.203.47@tcp:101:rm.0 Request processed in 582us (829us total) trans 352187318295 rc 301/301 00000100:00100000:0.0:1787826390.476876:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1232 00000100:00100000:2.0:1787826390.484070:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.484171:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043053184 00000100:00100000:3.0:1787826390.484190:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043053184 00000100:00100000:3.0:1787826390.484247:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:3.0:1787826390.484259:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163077:x1874663043053184:12345-192.168.203.47@tcp:37:rm.0 00010000:00000080:3.0:1787826390.494572:0:187908:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af5880 x1874663043053184/t0(0) o37->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:746/0 lens 448/440 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826390.494786:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163077:x1874663043053184:12345-192.168.203.47@tcp:37:rm.0 Request processed in 10528us (10725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.494797:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:1.0:1787826390.501366:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.501459:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043053440 00000100:00100000:0.0:1787826390.501469:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043053440 00000100:00100000:0.0:1787826390.501527:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:0.0:1787826390.501538:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb345736850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163077:x1874663043053440:12345-192.168.203.47@tcp:35:rm.0 00010000:00000080:0.0:1787826390.501867:0:187907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb345736850 x1874663043053440/t352187318296(0) o35->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:746/0 lens 392/456 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826390.501937:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb345736850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:163077:x1874663043053440:12345-192.168.203.47@tcp:35:rm.0 Request processed in 401us (579us total) trans 352187318296 rc 0/0 00000100:00100000:0.0:1787826390.501945:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:2.0:1787826390.507706:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.507857:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043053696 00000100:00100000:0.0:1787826390.507867:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043053696 00000100:00100000:0.0:1787826390.507931:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1233 00000100:00100000:0.0:1787826390.507942:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:163077:x1874663043053696:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826390.507966:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.507987:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f450 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.508104:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec95 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.508119:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec95 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.508135:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec95 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826390.508146:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1787826390.509237:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3e800/0x878a5eea00ceec8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f450 expref: 15 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.509269:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec95 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f450 expref: 14 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.509277:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:1.0:1787826390.509280:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826390.509284:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb479b3f000, rc 0) 00010000:00000080:1.0:1787826390.509291:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af4700 x1874663043053696/t352187318297(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:746/0 lens 648/664 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787826390.509873:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+14:163077:x1874663043053696:12345-192.168.203.47@tcp:101:rm.0 Request processed in 1930us (2175us total) trans 352187318297 rc 0/0 00000100:00100000:1.0:1787826390.509883:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1233 00000100:00100000:2.0:1787826390.516828:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.516931:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043053824 00000100:00100000:0.0:1787826390.516941:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043053824 00000100:00100000:0.0:1787826390.517004:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1234 00000100:00100000:0.0:1787826390.517015:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+92:163077:x1874663043053824:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826390.517043:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.517068:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceeca3 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f457 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.517156:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00ceecaa lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.517169:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00ceecaa lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.517181:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00ceecaa lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826390.517227:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x16:0x0]: returning size 4096 00000004:00200000:0.0:1787826390.517230:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826390.517269:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00ceecaa lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.517299:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e800/0x878a5eea00ceeca3 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f457 expref: 94 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.517539:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00ceecaa lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f457 expref: 93 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.517549:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.517552:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826390.517556:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441510200, rc 0) 00000100:00100000:0.0:1787826390.517660:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+93:163077:x1874663043053824:12345-192.168.203.47@tcp:101:rm.0 Request processed in 646us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.517667:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1234 00000100:00100000:3.0:1787826390.523635:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.523796:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043054080 00000100:00100000:0.0:1787826390.523807:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043054080 00000100:00100000:0.0:1787826390.523915:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1235 00000100:00100000:0.0:1787826390.523927:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+93:163077:x1874663043054080:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826390.523947:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.523970:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceecb1 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f45e expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.524077:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00ceecb8 lrc: 3/1,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.524116:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00ceecb8 lrc: 3/1,0 mode: CR/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.524127:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00ceecb8 lrc: 3/1,0 mode: CR/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826390.524138:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x16:0x0]: returning size 4096 00010000:00010000:0.0:1787826390.524247:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511e00/0x878a5eea00ceecb1 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f45e expref: 96 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.524270:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00ceecb8 lrc: 3/0,0 mode: CR/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f45e expref: 95 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.524279:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.524283:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826390.524286:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569a00, rc 0) 00000100:00100000:0.0:1787826390.524381:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb3427e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+95:163077:x1874663043054080:12345-192.168.203.47@tcp:101:rm.0 Request processed in 448us (747us total) trans 21474836527 rc 0/0 00000100:00100000:0.0:1787826390.524389:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1235 00000100:00100000:2.0:1787826390.529662:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.530042:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043054208 00000100:00100000:3.0:1787826390.530053:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043054208 00000100:00100000:3.0:1787826390.530122:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:3.0:1787826390.530140:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+95:163077:x1874663043054208:12345-192.168.203.47@tcp:37:rm.0 00000100:00100000:3.0:1787826390.536697:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+95:163077:x1874663043054208:12345-192.168.203.47@tcp:37:rm.0 Request processed in 6556us (7035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.536871:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:1.0:1787826390.547878:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.548005:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043054464 00000100:00100000:2.0:1787826390.548015:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043054464 00000100:00100000:2.0:1787826390.548074:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1236 00000100:00100000:2.0:1787826390.548084:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+95:163077:x1874663043054464:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826390.548145:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787826390.548171:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceea57 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3cb expref: 95 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548598:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1c:0x0].0x0 (ffff8eb45ed20f00) 00010000:00010000:2.0:1787826390.548621:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441510200/0x878a5eea00ceecaa lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f457 expref: 94 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548632:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:2.0:1787826390.548636:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826390.548657:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548669:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548678:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548693:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548700:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548719:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548806:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548814:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.548822:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826390.549028:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].2, 64 off8320 00000004:00080000:2.0:1787826390.549038:0:188682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8457375712714ns, next at 8458375710234ns, rc = 0 00010000:00010000:2.0:1787826390.549082:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549104:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549113:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549121:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549132:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549139:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549280:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826390.549314:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549357:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549365:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549568:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.549573:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549581:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549591:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1c:0x0].0x0 (ffff8eb34df4dd00) 00010000:00010000:2.0:1787826390.549594:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826390.549598:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549604:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceecd4 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549625:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549632:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549638:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549643:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549648:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.549651:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549656:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549662:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:2.0:1787826390.549664:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.549667:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549673:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceecc6 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.549681:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018c429c1 reply state 00000000b12b784f transno 21474836528 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549692:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.549698:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x494dcf1b (ffff8eb453a77200) 00010000:00010000:2.0:1787826390.549700:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826390.549703:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826390.549794:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+95:163077:x1874663043054464:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1708us (1923us total) trans 21474836528 rc 0/0 00000100:00100000:2.0:1787826390.549804:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1236 00010000:00010000:0.0:1787826390.553932:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826390.553946:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.553957:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826390.553961:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.553971:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.553990:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1c:0x0].0x0 (ffff8eb34df4dd00) 00010000:00010000:0.0:1787826390.553993:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826390.553997:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.554003:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715600/0x878a5eea00ceecdb lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.554078:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.554081:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.554082:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826390.554270:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.554649:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043054720 00000100:00100000:0.0:1787826390.554659:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043054720 00000100:00100000:0.0:1787826390.554799:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1237 00000100:00100000:0.0:1787826390.554808:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+95:163077:x1874663043054720:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826390.554861:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.554877:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00cee9a8 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3a8 expref: 95 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.554891:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x17:0x0].0x0 (ffff8eb34df4d700) 00010000:00010000:0.0:1787826390.554899:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826390.554917:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.554930:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.554938:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.554947:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.554954:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.554960:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555032:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555039:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555045:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826390.555265:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].2, 64 off8320 00000004:00080000:0.0:1787826390.555276:0:187906:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8457381950588ns, next at 8458381947959ns, rc = 0 00010000:00010000:0.0:1787826390.555792:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555805:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555814:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555821:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555828:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555834:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555920:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826390.555939:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555946:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555952:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555957:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.555961:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555967:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555976:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x17:0x0].0x0 (ffff8eb452580f00) 00010000:00010000:0.0:1787826390.555978:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.555982:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.555987:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceecf0 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556005:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556011:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556017:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556022:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556026:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.556029:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556035:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556041:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.556043:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.556046:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556052:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceece2 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.556062:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005318cf59 reply state 00000000719978ea transno 21474836529 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556072:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.556077:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x679fc7b1 (ffff8eb34df4d900) 00010000:00010000:0.0:1787826390.556079:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.556082:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826390.556171:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+96:163077:x1874663043054720:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1361us (1902us total) trans 21474836529 rc 0/0 00000100:00100000:0.0:1787826390.556185:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1237 00000100:00100000:3.0:1787826390.559317:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.559805:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043054976 00000100:00100000:1.0:1787826390.559815:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043054976 00000100:00100000:1.0:1787826390.559878:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1238 00000100:00100000:1.0:1787826390.559888:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+96:163077:x1874663043054976:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:1.0:1787826390.559943:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826390.559967:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f800/0x878a5eea00ceea7a lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3d2 expref: 96 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.559985:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1d:0x0].0x0 (ffff8eb453a77100) 00010000:00010000:1.0:1787826390.559996:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826390.560017:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560029:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560038:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560048:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560054:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560060:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560164:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560180:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560187:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826390.560427:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].3, 64 off8384 00010000:00010000:1.0:1787826390.560689:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560700:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560723:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560730:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560736:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.560742:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561297:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826390.561313:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561321:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826390.561337:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561345:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561357:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x17:0x0].0x0 (ffff8eb452580f00) 00010000:00010000:2.0:1787826390.561360:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826390.561364:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561377:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceecf7 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561395:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826390.561398:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561406:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ee00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826390.561409:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561415:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 5/0,0 mode: PW/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561423:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1d:0x0].0x0 (ffff8eb44972e100) 00010000:00010000:2.0:1787826390.561425:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826390.561428:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 3/0,0 mode: --/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.561434:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826390.561436:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826390.561438:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.561797:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826390.561804:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed13 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561839:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561845:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561851:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561856:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.561860:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561866:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561879:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1d:0x0].0x0 (ffff8eb44972e100) 00010000:00010000:1.0:1787826390.561881:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826390.561884:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561891:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed0c lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561909:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561914:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561920:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561926:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561931:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.561934:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561939:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561945:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:1.0:1787826390.561947:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.561950:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561959:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceecfe lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.561968:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ec67a0b reply state 00000000fbdf7f78 transno 21474836530 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561977:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.561982:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x76709d63 (ffff8eb453a77500) 00010000:00010000:1.0:1787826390.561984:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.561987:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826390.562072:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+97:163077:x1874663043054976:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2182us (2772us total) trans 21474836530 rc 0/0 00000100:00100000:1.0:1787826390.562081:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1238 00010000:00010000:3.0:1787826390.565970:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826390.566073:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.566277:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043055232 00000100:00100000:2.0:1787826390.566287:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043055232 00000100:00100000:2.0:1787826390.566815:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1239 00000100:00100000:2.0:1787826390.566826:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+97:163077:x1874663043055232:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826390.566890:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826390.566917:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeb92 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f40a expref: 97 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.566936:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x25:0x0].0x0 (ffff8eb34df4de00) 00010000:00010000:2.0:1787826390.566948:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826390.566969:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.566982:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.566991:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567001:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567009:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567015:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567107:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567116:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567123:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826390.567642:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].4, 64 off8448 00010000:00010000:2.0:1787826390.567689:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567701:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567843:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567855:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567863:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567870:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567939:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826390.567958:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567966:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567972:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567978:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.567982:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567989:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.567999:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x25:0x0].0x0 (ffff8eb34df4d200) 00010000:00010000:2.0:1787826390.568002:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826390.568006:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568013:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed28 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568036:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568044:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568050:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568056:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568061:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.568064:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568071:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568079:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:2.0:1787826390.568081:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.568084:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568102:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceed1a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.568112:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000001e13eb reply state 000000008391086d transno 21474836531 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568123:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.568130:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xa6a94833 (ffff8eb34df4d000) 00010000:00010000:2.0:1787826390.568133:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826390.568135:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826390.568228:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+98:163077:x1874663043055232:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1402us (2158us total) trans 21474836531 rc 0/0 00000100:00100000:2.0:1787826390.568236:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1239 00010000:00010000:3.0:1787826390.573006:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826390.573022:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.573033:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826390.573038:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.573048:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.573066:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x25:0x0].0x0 (ffff8eb34df4d200) 00010000:00010000:3.0:1787826390.573069:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826390.573074:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.573080:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38a00/0x878a5eea00ceed2f lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.573113:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.573115:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.573117:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826390.573857:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.573956:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043055488 00000100:00100000:3.0:1787826390.573966:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043055488 00000100:00100000:3.0:1787826390.574027:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1240 00000100:00100000:3.0:1787826390.574037:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+98:163077:x1874663043055488:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826390.574105:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.574125:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceeac0 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3e0 expref: 98 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.574833:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1f:0x0].0x0 (ffff8eb45ed20200) 00010000:00010000:3.0:1787826390.574844:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826390.574867:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.574880:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.574890:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.574900:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.574907:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.574913:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.574993:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.575000:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.575012:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826390.575801:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].5, 64 off8512 00010000:00010000:3.0:1787826390.575862:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.575876:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.575884:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.575892:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.575899:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.575906:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.575974:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826390.575999:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576005:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576011:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576021:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826390.576025:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576033:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576045:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1f:0x0].0x0 (ffff8eb481697700) 00010000:00010000:3.0:1787826390.576048:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826390.576051:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576057:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceed44 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576075:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576081:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576097:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576102:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826390.576105:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576110:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576121:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:3.0:1787826390.576123:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.576126:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576132:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceed36 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826390.576148:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085a861c5 reply state 000000003eef9918 transno 21474836532 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576159:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.576165:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xd0b639f4 (ffff8eb45ed20e00) 00010000:00010000:3.0:1787826390.576167:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826390.576169:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826390.576273:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+99:163077:x1874663043055488:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2234us (2417us total) trans 21474836532 rc 0/0 00000100:00100000:3.0:1787826390.576283:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1240 00010000:00010000:1.0:1787826390.579181:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826390.579194:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.579204:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826390.579208:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.579217:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.579233:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1f:0x0].0x0 (ffff8eb481697700) 00010000:00010000:1.0:1787826390.579237:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826390.579241:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.579247:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceed4b lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.579269:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.579271:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.579272:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826390.582974:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.583289:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043055744 00000100:00100000:1.0:1787826390.583310:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043055744 00000100:00100000:1.0:1787826390.583409:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1241 00000100:00100000:1.0:1787826390.583420:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+99:163077:x1874663043055744:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:1.0:1787826390.583489:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826390.583515:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceea34 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3c4 expref: 99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583533:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1b:0x0].0x0 (ffff8eb45ed20000) 00010000:00010000:1.0:1787826390.583543:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826390.583564:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583577:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583586:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583598:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583611:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583618:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583697:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583706:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583727:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826390.583916:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].6, 64 off8576 00010000:00010000:1.0:1787826390.583962:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583972:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583979:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583986:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583993:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.583999:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584022:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826390.584038:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584046:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584052:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584059:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.584063:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584072:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584081:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1b:0x0].0x0 (ffff8eb44972e100) 00010000:00010000:1.0:1787826390.584084:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826390.584098:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584105:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceed60 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584124:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584131:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584142:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584148:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584154:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.584156:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584162:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584170:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:1.0:1787826390.584172:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.584176:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584182:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceed52 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.584191:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce2cc62e reply state 000000003c53899d transno 21474836533 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584201:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.584208:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x1c2b00d3 (ffff8eb453a77700) 00010000:00010000:1.0:1787826390.584210:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.584213:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826390.584278:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+100:163077:x1874663043055744:12345-192.168.203.47@tcp:36:rm.0 Request processed in 859us (1312us total) trans 21474836533 rc 0/0 00000100:00100000:1.0:1787826390.584286:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1241 00010000:00010000:2.0:1787826390.584475:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826390.584482:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.584490:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826390.584494:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.584501:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.584510:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1b:0x0].0x0 (ffff8eb44972e100) 00010000:00010000:2.0:1787826390.584513:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826390.584516:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.584523:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceed67 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.584536:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826390.584538:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826390.584539:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826390.590159:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.590932:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043056000 00000100:00100000:2.0:1787826390.590943:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043056000 00000100:00100000:2.0:1787826390.591045:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1242 00000100:00100000:2.0:1787826390.591056:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+100:163077:x1874663043056000:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826390.591127:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826390.591166:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceeb6f lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f403 expref: 100 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591194:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x24:0x0].0x0 (ffff8eb45ed20100) 00010000:00010000:2.0:1787826390.591205:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826390.591229:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591242:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591253:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591263:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591271:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591278:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591545:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591555:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.591567:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826390.591979:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].3, 64 off8384 00010000:00010000:2.0:1787826390.592029:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592038:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592046:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592053:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592060:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592066:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592096:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826390.592115:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592122:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592130:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592141:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.592146:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592153:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592165:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x24:0x0].0x0 (ffff8eb34df4de00) 00010000:00010000:2.0:1787826390.592168:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826390.592352:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826390.592359:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.592366:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826390.592381:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.592389:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.592399:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x24:0x0].0x0 (ffff8eb34df4de00) 00010000:00010000:3.0:1787826390.592402:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826390.592404:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.592410:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39c00/0x878a5eea00ceed83 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.592421:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.592423:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.592424:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826390.592704:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592791:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceed7c lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592816:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592823:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592830:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592837:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592843:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.592847:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592858:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592868:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:2.0:1787826390.592870:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.592874:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592880:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38400/0x878a5eea00ceed6e lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.592890:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009849455e reply state 00000000d4cefde5 transno 21474836534 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592902:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.592909:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x83daffd9 (ffff8eb45ed20300) 00010000:00010000:2.0:1787826390.592911:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826390.592914:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826390.593001:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+101:163077:x1874663043056000:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1944us (2859us total) trans 21474836534 rc 0/0 00000100:00100000:2.0:1787826390.593011:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1242 00000100:00100000:3.0:1787826390.596740:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.597986:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043056256 00000100:00100000:0.0:1787826390.598000:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043056256 00000100:00100000:0.0:1787826390.598103:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1243 00000100:00100000:0.0:1787826390.598116:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+101:163077:x1874663043056256:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826390.598214:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.598241:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceebb5 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f411 expref: 101 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598266:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x26:0x0].0x0 (ffff8eb45ed20a00) 00010000:00010000:0.0:1787826390.598277:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826390.598298:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598339:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598351:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598363:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xc977908d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598384:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598392:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598837:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598848:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.598862:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826390.599068:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].4, 64 off8448 00010000:00010000:0.0:1787826390.599131:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599252:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599263:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599271:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599279:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599286:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599528:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826390.599549:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599557:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599564:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599576:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.599580:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599589:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599601:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x26:0x0].0x0 (ffff8eb452580d00) 00010000:00010000:0.0:1787826390.599604:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.599608:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599615:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceed98 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599634:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599641:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599648:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599653:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599659:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.599662:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599673:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599681:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.599684:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.599687:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599694:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceed8a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.599706:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cb9bf42 reply state 000000000bf6b9b6 transno 21474836535 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599835:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.599843:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xc977908d (ffff8eb453a77600) 00010000:00010000:0.0:1787826390.599845:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.599848:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826390.599928:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+102:163077:x1874663043056256:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1811us (3207us total) trans 21474836535 rc 0/0 00000100:00100000:0.0:1787826390.599938:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1243 00010000:00010000:0.0:1787826390.600108:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826390.600115:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.600122:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826390.600126:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.600133:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.600279:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x26:0x0].0x0 (ffff8eb452580d00) 00010000:00010000:0.0:1787826390.600282:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826390.600286:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.600293:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceed9f lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.600644:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.600647:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.600649:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826390.604805:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.604895:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043056512 00000100:00100000:3.0:1787826390.604905:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043056512 00000100:00100000:3.0:1787826390.604995:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1244 00000100:00100000:3.0:1787826390.605006:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+102:163077:x1874663043056512:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826390.605060:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.605084:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fc00/0x878a5eea00ceeb29 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3f5 expref: 102 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.605113:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x22:0x0].0x0 (ffff8eb453a77900) 00010000:00010000:3.0:1787826390.605124:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826390.605156:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.605168:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.605187:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.605199:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.605207:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.605214:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.605295:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.606071:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.606081:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826390.606944:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].5, 64 off8512 00010000:00010000:0.0:1787826390.607001:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607013:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607023:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607031:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607038:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607050:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607128:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826390.607157:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607164:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607170:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607184:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.607188:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607196:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607207:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x22:0x0].0x0 (ffff8eb481697d00) 00010000:00010000:0.0:1787826390.607210:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.607214:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607220:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceedb4 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607238:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607248:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607253:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607258:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.607261:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607266:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607272:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.607275:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.607278:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607283:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeda6 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.607293:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce6387b5 reply state 000000009d3758ea transno 21474836536 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607314:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.607320:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x3e3e6f26 (ffff8eb45ed20c00) 00010000:00010000:0.0:1787826390.607322:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.607350:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826390.607441:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+103:163077:x1874663043056512:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2434us (2642us total) trans 21474836536 rc 0/0 00000100:00100000:0.0:1787826390.607450:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1244 00000100:00100000:0.0:1787826390.611762:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.611920:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043056768 00000100:00100000:3.0:1787826390.611932:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043056768 00000100:00100000:3.0:1787826390.611995:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1245 00000100:00100000:3.0:1787826390.612006:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+103:163077:x1874663043056768:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826390.612064:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.612104:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f600/0x878a5eea00ceeae3 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3e7 expref: 103 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612123:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x20:0x0].0x0 (ffff8eb453a77800) 00010000:00010000:3.0:1787826390.612134:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826390.612169:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612193:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612202:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612214:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612222:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612228:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612320:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612356:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612363:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826390.612929:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].6, 64 off8576 00010000:00010000:3.0:1787826390.612977:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612988:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.612996:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.613003:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.613009:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.613015:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613891:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826390.613901:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613910:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826390.613914:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613922:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613935:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x22:0x0].0x0 (ffff8eb481697d00) 00010000:00010000:1.0:1787826390.613938:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826390.613941:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613947:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceedbb lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613967:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826390.613971:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613976:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826390.613979:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613985:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 5/0,0 mode: PW/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.613996:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x20:0x0].0x0 (ffff8eb481697b00) 00010000:00010000:1.0:1787826390.613998:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826390.614001:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 3/0,0 mode: --/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.614007:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.614009:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.614011:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.614156:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787826390.614163:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceedd7 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614249:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614257:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614263:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614268:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eca00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.614272:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614279:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614288:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x20:0x0].0x0 (ffff8eb481697b00) 00010000:00010000:0.0:1787826390.614290:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.614293:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614298:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eca00/0x878a5eea00ceedd0 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614380:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614386:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614393:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614399:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614404:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ede00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.614407:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614414:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614422:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.614424:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.614427:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614433:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ede00/0x878a5eea00ceedc2 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.614442:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075c774ad reply state 000000004a37ee23 transno 21474836537 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614453:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.614469:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xfdd9083c (ffff8eb453a77300) 00010000:00010000:0.0:1787826390.614471:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.614474:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826390.614562:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+104:163077:x1874663043056768:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2554us (2804us total) trans 21474836537 rc 0/0 00000100:00100000:0.0:1787826390.614572:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1245 00010000:00010000:2.0:1787826390.621207:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826390.622102:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.622296:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043057024 00000100:00100000:1.0:1787826390.622316:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043057024 00000100:00100000:1.0:1787826390.622412:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1246 00000100:00100000:1.0:1787826390.622424:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+104:163077:x1874663043057024:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:1.0:1787826390.622721:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826390.622749:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceea11 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3bd expref: 104 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622766:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1a:0x0].0x0 (ffff8eb34df4d800) 00010000:00010000:1.0:1787826390.622777:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826390.622798:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622810:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622820:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622829:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xef08328a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622841:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622846:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622921:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622928:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.622934:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826390.623281:0:187904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].7, 64 off8640 00010000:00010000:1.0:1787826390.623728:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623740:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623751:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623759:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623767:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623774:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623843:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826390.623861:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623869:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623876:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623882:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ec00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.623886:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623893:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623903:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1a:0x0].0x0 (ffff8eb44972e600) 00010000:00010000:1.0:1787826390.623907:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826390.623912:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623918:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ec00/0x878a5eea00ceedec lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623941:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623948:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623959:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623964:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.623967:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623973:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623981:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:1.0:1787826390.623983:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.623986:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.623991:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fa00/0x878a5eea00ceedde lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.624001:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bdd93cb reply state 00000000e5cb9733 transno 21474836538 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.624012:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.624017:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xef08328a (ffff8eb34df4df00) 00010000:00010000:1.0:1787826390.624019:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.624022:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826390.624109:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+105:163077:x1874663043057024:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1684us (2020us total) trans 21474836538 rc 0/0 00000100:00100000:1.0:1787826390.624118:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1246 00000100:00100000:3.0:1787826390.628932:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.629061:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043057280 00000100:00100000:1.0:1787826390.629074:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043057280 00000100:00100000:1.0:1787826390.629158:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1247 00000100:00100000:1.0:1787826390.629170:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+105:163077:x1874663043057280:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:1.0:1787826390.629240:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826390.629266:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fc00/0x878a5eea00ceec41 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f42d expref: 105 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629287:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2a:0x0].0x0 (ffff8eb44972e800) 00010000:00010000:1.0:1787826390.629297:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826390.629318:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629365:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629385:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629398:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629404:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629411:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629486:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629499:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629506:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826390.629690:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].8, 64 off8704 00010000:00010000:1.0:1787826390.629809:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629819:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629828:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629835:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629842:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.629848:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630015:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826390.630023:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630032:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826390.630036:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630045:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630057:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1a:0x0].0x0 (ffff8eb44972e600) 00010000:00010000:0.0:1787826390.630060:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826390.630064:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630071:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f400/0x878a5eea00ceedf3 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630751:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826390.630758:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630765:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826390.630769:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630777:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 5/0,0 mode: PW/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630792:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2a:0x0].0x0 (ffff8eb44972e200) 00010000:00010000:0.0:1787826390.630795:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826390.630798:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 3/0,0 mode: --/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.630806:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.630808:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.630810:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.631127:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826390.631135:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee0f lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631182:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631195:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631202:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631207:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.631211:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631217:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631227:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2a:0x0].0x0 (ffff8eb44972e200) 00010000:00010000:1.0:1787826390.631230:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826390.631233:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631239:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f200/0x878a5eea00ceee08 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631259:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631267:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631273:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631278:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.631282:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631288:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631296:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:1.0:1787826390.631298:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.631313:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631320:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e000/0x878a5eea00ceedfa lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.631351:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9dbc210 reply state 000000002e722b37 transno 21474836539 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631363:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.631583:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x54b0b1f4 (ffff8eb45ed20500) 00010000:00010000:1.0:1787826390.631587:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.631590:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826390.631677:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+106:163077:x1874663043057280:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2506us (2752us total) trans 21474836539 rc 0/0 00000100:00100000:1.0:1787826390.631691:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1247 00000100:00100000:2.0:1787826390.635604:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826390.637295:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043057536 00000100:00100000:3.0:1787826390.637320:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043057536 00000100:00100000:3.0:1787826390.637430:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1248 00000100:00100000:3.0:1787826390.637441:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+106:163077:x1874663043057536:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826390.637500:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.637525:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e200/0x878a5eea00ceec1e lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f426 expref: 106 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637545:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x29:0x0].0x0 (ffff8eb453a77a00) 00010000:00010000:3.0:1787826390.637556:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826390.637578:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637592:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637603:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637613:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637621:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637629:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637951:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637963:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.637971:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826390.638171:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].7, 64 off8640 00010000:00010000:3.0:1787826390.639475:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.639490:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.639500:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.639508:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.639516:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.639522:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.640202:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826390.640212:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.640221:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ece00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826390.640226:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.640234:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 5/0,0 mode: PW/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.640249:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x29:0x0].0x0 (ffff8eb481697800) 00010000:00010000:0.0:1787826390.640251:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826390.640256:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 3/0,0 mode: --/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.640265:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.640267:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.640269:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.640758:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787826390.640768:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ece00/0x878a5eea00ceee2b lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640803:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640811:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640816:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640820:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826390.640825:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640831:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640839:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x29:0x0].0x0 (ffff8eb481697800) 00010000:00010000:3.0:1787826390.640842:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826390.640845:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640855:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed000/0x878a5eea00ceee24 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640878:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640884:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640890:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640896:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640901:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826390.640903:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640909:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640917:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:3.0:1787826390.640919:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826390.640922:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640929:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ec400/0x878a5eea00ceee16 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826390.640937:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007706b1c8 reply state 000000006d68a98a transno 21474836540 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640950:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.640958:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x31e2699a (ffff8eb453a77000) 00010000:00010000:3.0:1787826390.640961:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826390.640963:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826390.642008:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+107:163077:x1874663043057536:12345-192.168.203.47@tcp:36:rm.0 Request processed in 4561us (6407us total) trans 21474836540 rc 0/0 00000100:00100000:3.0:1787826390.642020:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1248 00000100:00100000:3.0:1787826390.645658:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.645749:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043057792 00000100:00100000:0.0:1787826390.645759:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043057792 00000100:00100000:0.0:1787826390.645830:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1249 00000100:00100000:0.0:1787826390.645841:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+107:163077:x1874663043057792:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826390.645898:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.645926:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00cee9ee lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3b6 expref: 107 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.645944:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x19:0x0].0x0 (ffff8eb34df4db00) 00010000:00010000:0.0:1787826390.645954:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826390.645974:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.645986:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.645996:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.646008:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.646016:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.646023:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.646117:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.646127:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.646135:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826390.646862:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].8, 64 off8704 00010000:00010000:2.0:1787826390.646915:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.646926:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.646936:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.646944:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.646952:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.646959:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.648100:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826390.648110:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.648122:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826390.648127:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 4/0,0 mode: PW/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.648146:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 5/0,0 mode: PW/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.648163:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x19:0x0].0x0 (ffff8eb452580d00) 00010000:00010000:1.0:1787826390.648166:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826390.648170:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 3/0,0 mode: --/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.648190:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.648192:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.648194:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.648920:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826390.648956:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787826390.648968:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee47 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649013:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649054:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649062:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649068:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.649072:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649081:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649107:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x19:0x0].0x0 (ffff8eb452580d00) 00010000:00010000:2.0:1787826390.649110:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826390.649114:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649120:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee40 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649656:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649666:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649674:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649681:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649687:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.649690:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649697:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649718:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:2.0:1787826390.649721:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.649725:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649736:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee32 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.649748:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e4c86a9 reply state 00000000313e7c20 transno 21474836541 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649760:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.649767:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xc1e56442 (ffff8eb34df4d100) 00010000:00010000:2.0:1787826390.649770:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826390.649773:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826390.649866:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+108:163077:x1874663043057792:12345-192.168.203.47@tcp:36:rm.0 Request processed in 4023us (4214us total) trans 21474836541 rc 0/0 00000100:00100000:2.0:1787826390.649876:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1249 00000100:00100000:0.0:1787826390.653149:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.653387:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043058048 00000100:00100000:1.0:1787826390.653398:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043058048 00000100:00100000:1.0:1787826390.653453:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1250 00000100:00100000:1.0:1787826390.653463:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+108:163077:x1874663043058048:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:1.0:1787826390.653524:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826390.653550:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441511200/0x878a5eea00cee9cb lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3af expref: 108 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653569:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x18:0x0].0x0 (ffff8eb481697a00) 00010000:00010000:1.0:1787826390.653579:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826390.653600:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653613:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653628:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653639:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653647:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653654:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653746:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653754:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.653760:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826390.653955:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].9, 64 off8768 00010000:00010000:1.0:1787826390.653998:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654007:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654014:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654021:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654028:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654034:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654054:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826390.654070:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654076:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654081:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654101:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.654105:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654112:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654120:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x18:0x0].0x0 (ffff8eb44972e200) 00010000:00010000:1.0:1787826390.654122:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787826390.654126:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654131:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356400/0x878a5eea00ceee5c lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.654598:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826390.654606:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.654614:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826390.654617:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.654624:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.654634:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x18:0x0].0x0 (ffff8eb44972e200) 00010000:00010000:0.0:1787826390.654636:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826390.654639:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.654644:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357400/0x878a5eea00ceee63 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.654657:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.654658:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.654660:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.654923:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654930:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654937:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654943:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.654946:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654953:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654962:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:1.0:1787826390.654965:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.654968:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654974:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceee4e lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826390.654984:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d7339ef reply state 0000000010ed2eef transno 21474836542 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.654995:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.655002:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x94c295fa (ffff8eb34df4d400) 00010000:00010000:1.0:1787826390.655006:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826390.655009:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826390.655107:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+109:163077:x1874663043058048:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1642us (1974us total) trans 21474836542 rc 0/0 00000100:00100000:1.0:1787826390.655117:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1250 00000100:00100000:0.0:1787826390.660799:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.660892:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043058304 00000100:00100000:2.0:1787826390.660901:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043058304 00000100:00100000:2.0:1787826390.660981:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1251 00000100:00100000:2.0:1787826390.660992:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+109:163077:x1874663043058304:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826390.661046:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826390.661072:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8fe00/0x878a5eea00ceebd8 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f418 expref: 109 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661102:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x27:0x0].0x0 (ffff8eb45ed20800) 00010000:00010000:2.0:1787826390.661112:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826390.661134:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661161:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661172:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661191:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661199:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661206:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661291:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661312:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661574:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826390.661864:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].9, 64 off8768 00010000:00010000:2.0:1787826390.661909:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661919:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661927:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661935:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661943:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.661950:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662025:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826390.662043:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662051:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662057:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662064:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.662068:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662076:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662096:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x27:0x0].0x0 (ffff8eb34df4de00) 00010000:00010000:2.0:1787826390.662099:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787826390.662104:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662115:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceee78 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662134:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662141:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662148:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662155:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662160:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:2.0:1787826390.662163:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662170:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662189:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:2.0:1787826390.662191:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826390.662195:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662201:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceee6a lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.662211:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000838fd338 reply state 0000000055365811 transno 21474836543 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662222:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.662229:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xec45d8e7 (ffff8eb45ed20d00) 00010000:00010000:2.0:1787826390.662232:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826390.662235:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826390.662320:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+110:163077:x1874663043058304:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1328us (1528us total) trans 21474836543 rc 0/0 00000100:00100000:2.0:1787826390.662353:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1251 00010000:00010000:3.0:1787826390.666562:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826390.666576:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.666586:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826390.666591:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.666600:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.666617:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x27:0x0].0x0 (ffff8eb34df4de00) 00010000:00010000:3.0:1787826390.666620:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826390.666623:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.666630:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39e00/0x878a5eea00ceee7f lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.666650:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.666652:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.666654:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826390.673288:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.673435:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043058560 00000100:00100000:0.0:1787826390.673446:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043058560 00000100:00100000:0.0:1787826390.673506:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1252 00000100:00100000:0.0:1787826390.673517:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+110:163077:x1874663043058560:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826390.673573:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.673599:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356000/0x878a5eea00ceea9d lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3d9 expref: 110 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673617:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1e:0x0].0x0 (ffff8eb45ed20900) 00010000:00010000:0.0:1787826390.673627:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826390.673648:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673661:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673672:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673682:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673690:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673697:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673786:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673795:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.673804:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826390.673994:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].10, 64 off8832 00010000:00010000:0.0:1787826390.674042:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674052:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674061:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674069:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674075:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674082:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674164:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826390.674386:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674394:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674400:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674406:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.674410:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674417:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674427:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1e:0x0].0x0 (ffff8eb452580000) 00010000:00010000:0.0:1787826390.674430:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.674433:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674439:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569200/0x878a5eea00ceee94 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674457:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674462:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674468:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674473:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674478:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.674481:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674487:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674493:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.674495:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.674498:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674508:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568000/0x878a5eea00ceee86 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.674518:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acd17ac8 reply state 00000000271012be transno 21474836544 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674529:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.674534:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xa3936bac (ffff8eb45ed20400) 00010000:00010000:0.0:1787826390.674536:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.674539:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826390.674609:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+111:163077:x1874663043058560:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1092us (1330us total) trans 21474836544 rc 0/0 00000100:00100000:0.0:1787826390.674617:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1252 00010000:00010000:1.0:1787826390.674848:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826390.674855:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.674862:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826390.674865:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.674871:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.674881:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x1e:0x0].0x0 (ffff8eb452580000) 00010000:00010000:1.0:1787826390.674883:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826390.674886:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.674892:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569000/0x878a5eea00ceee9b lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.674905:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.674907:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.674908:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826390.683072:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.683157:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043058816 00000100:00100000:0.0:1787826390.683168:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043058816 00000100:00100000:0.0:1787826390.683239:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1253 00000100:00100000:0.0:1787826390.683249:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+111:163077:x1874663043058816:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826390.683320:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.683397:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f200/0x878a5eea00ceeb4c lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3fc expref: 111 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683416:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x23:0x0].0x0 (ffff8eb453a77400) 00010000:00010000:0.0:1787826390.683430:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826390.683450:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683468:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683479:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683489:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683498:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683504:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683582:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683591:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683597:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826390.683808:0:188992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].10, 64 off8832 00010000:00010000:0.0:1787826390.683855:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683865:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683873:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683880:0:188992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683887:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683893:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683911:0:188992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826390.683925:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683932:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683938:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683944:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.683948:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683955:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683964:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x23:0x0].0x0 (ffff8eb452580700) 00010000:00010000:0.0:1787826390.683967:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.683970:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683980:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceeeb0 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.683997:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.684003:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 2/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.684008:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.684013:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.684016:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.684021:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.684028:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.684031:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.684033:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 2/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.684038:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568200/0x878a5eea00ceeea2 lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.684048:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007631b0a6 reply state 00000000d3b195d2 transno 21474836545 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.684057:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.684064:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x610cb780 (ffff8eb481697300) 00010000:00010000:0.0:1787826390.684067:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.684070:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826390.684159:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+112:163077:x1874663043058816:12345-192.168.203.47@tcp:36:rm.0 Request processed in 910us (1097us total) trans 21474836545 rc 0/0 00000100:00100000:0.0:1787826390.684167:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1253 00010000:00010000:1.0:1787826390.684640:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826390.684648:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.684660:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826390.684664:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.684672:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.684684:0:66923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x23:0x0].0x0 (ffff8eb452580700) 00010000:00010000:1.0:1787826390.684686:0:66923:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826390.684689:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.684696:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64600/0x878a5eea00ceeeb7 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.684716:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.684719:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.684720:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826390.687662:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.687927:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043059072 00000100:00100000:0.0:1787826390.687937:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043059072 00000100:00100000:0.0:1787826390.688048:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1254 00000100:00100000:0.0:1787826390.688060:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+112:163077:x1874663043059072:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826390.688133:0:188682:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.688160:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceeb06 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f3ee expref: 112 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688178:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x21:0x0].0x0 (ffff8eb45ed20b00) 00010000:00010000:0.0:1787826390.688187:0:188682:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826390.688221:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688233:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688241:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688254:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688267:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688273:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688384:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688393:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688399:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826390.688590:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].11, 64 off8896 00010000:00010000:0.0:1787826390.688635:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688645:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688653:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688660:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688667:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688674:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688713:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826390.688731:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688738:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688745:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688751:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.688756:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688765:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688774:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x21:0x0].0x0 (ffff8eb452580a00) 00010000:00010000:0.0:1787826390.688777:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.688781:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688787:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714200/0x878a5eea00ceeecc lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688805:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688812:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688821:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688827:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688832:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.688835:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688842:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688850:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.688852:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.688855:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688862:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65000/0x878a5eea00ceeebe lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.688871:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005616d2f4 reply state 00000000379a6af0 transno 21474836546 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688882:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.688889:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x1b7026cc (ffff8eb45ed20700) 00010000:00010000:0.0:1787826390.688892:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.688894:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826390.688960:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+113:163077:x1874663043059072:12345-192.168.203.47@tcp:36:rm.0 Request processed in 901us (1305us total) trans 21474836546 rc 0/0 00000100:00100000:0.0:1787826390.688968:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1254 00010000:00010000:1.0:1787826390.689029:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826390.689036:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.689043:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826390.689047:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.689054:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.689063:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x21:0x0].0x0 (ffff8eb452580a00) 00010000:00010000:1.0:1787826390.689067:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826390.689070:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.689075:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715200/0x878a5eea00ceeed3 lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.689101:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.689103:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.689105:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826390.694004:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.694080:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043059328 00000100:00100000:0.0:1787826390.694102:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043059328 00000100:00100000:0.0:1787826390.694161:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1255 00000100:00100000:0.0:1787826390.694173:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+113:163077:x1874663043059328:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826390.694232:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.694258:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3f400/0x878a5eea00ceebfb lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f41f expref: 113 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694277:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x28:0x0].0x0 (ffff8eb453a77d00) 00010000:00010000:0.0:1787826390.694287:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826390.694307:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 3/0,1 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694320:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694379:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 3/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694392:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x16:0x0].0xf142140 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694400:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694406:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694488:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694497:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694503:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826390.694693:0:187905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].11, 64 off8896 00010000:00010000:0.0:1787826390.694738:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694747:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694756:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694763:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694769:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 4/0,1 mode: PW/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694776:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694797:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826390.694813:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694825:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694832:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694837:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.694842:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694849:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694859:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x28:0x0].0x0 (ffff8eb452580400) 00010000:00010000:0.0:1787826390.694862:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.694865:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694872:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714e00/0x878a5eea00ceeee8 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694888:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694894:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 4/0,1 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694899:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 3/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694905:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694911:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.694914:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 4/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694919:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 5/0,0 mode: CW/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694926:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:0.0:1787826390.694929:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.694931:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 3/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694937:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714400/0x878a5eea00ceeeda lrc: 0/0,0 mode: --/CW res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.694946:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae144550 reply state 000000008654c384 transno 21474836547 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694955:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.694961:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xf142140 (ffff8eb453a77c00) 00010000:00010000:0.0:1787826390.694963:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.694966:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826390.695011:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826390.695017:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.695022:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826390.695026:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 2/0,0 mode: PW/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.695032:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 3/0,0 mode: PW/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.695038:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+114:163077:x1874663043059328:12345-192.168.203.47@tcp:36:rm.0 Request processed in 867us (1043us total) trans 21474836547 rc 0/0 00010000:00010000:3.0:1787826390.695041:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x28:0x0].0x0 (ffff8eb452580400) 00010000:00010000:3.0:1787826390.695043:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826390.695046:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 1/0,0 mode: --/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.695047:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1255 00010000:00010000:3.0:1787826390.695051:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715c00/0x878a5eea00ceeeef lrc: 0/0,0 mode: --/PW res: [0x240001f59:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.695064:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.695065:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826390.695067:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826390.699982:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.700059:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043059456 00000100:00100000:0.0:1787826390.700070:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043059456 00000100:00100000:0.0:1787826390.700138:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1256 00000100:00100000:0.0:1787826390.700150:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+14:163077:x1874663043059456:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1787826390.700174:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.700195:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00ceeef6 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f465 expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700273:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700287:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700298:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700312:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700319:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700363:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700419:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef0b lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700427:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef0b lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700434:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef0b lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.700457:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef0b lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700470:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700477:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 2/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700484:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700491:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.700496:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700503:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700515:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:0.0:1787826390.700518:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.700522:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700528:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715600/0x878a5eea00ceeefd lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700541:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700547:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700553:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700558:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.700561:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700566:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700573:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0xf7117594 (ffff8eb452580200) 00010000:00010000:0.0:1787826390.700575:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.700578:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700583:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481715200/0x878a5eea00ceef04 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700611:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb481714200/0x878a5eea00ceeef6 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f465 expref: 16 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700626:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef0b lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f465 expref: 15 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.700633:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb481697600) 00010000:00010000:0.0:1787826390.700636:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826390.700638:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568200, rc 0) 00010000:00000080:0.0:1787826390.700646:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472616300 x1874663043059456/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:746/0 lens 584/584 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826390.700716:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+15:163077:x1874663043059456:12345-192.168.203.47@tcp:101:rm.0 Request processed in 567us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.700723:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1256 00000100:00100000:1.0:1787826390.708789:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.708890:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043059584 00000100:00100000:2.0:1787826390.708900:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043059584 00000100:00100000:2.0:1787826390.709001:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4248 00000100:00100000:2.0:1787826390.709011:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+15:2392:x1874663043059584:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826390.709027:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826390.709051:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef0b lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f465 expref: 15 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.709070:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb481697600) 00010000:00010000:2.0:1787826390.709074:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826390.709142:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+14:2392:x1874663043059584:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 132us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826390.709150:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4248 00000100:00100000:3.0:1787826390.710313:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.711136:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043059712 00000100:00100000:1.0:1787826390.711147:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043059712 00000100:00100000:1.0:1787826390.711209:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1257 00000100:00100000:1.0:1787826390.711219:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+114:163077:x1874663043059712:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:1.0:1787826390.711241:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.711262:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceef12 lrc: 2/0,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f46c expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.711340:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceef19 lrc: 3/1,0 mode: --/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.711353:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceef19 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.711364:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceef19 lrc: 3/1,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826390.711409:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x16:0x0]: returning size 4096 00000004:00200000:1.0:1787826390.711412:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787826390.711447:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357e00/0x878a5eea00ceef12 lrc: 0/0,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f46c expref: 116 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.711465:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceef19 lrc: 3/0,0 mode: PR/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f46c expref: 115 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.711474:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:1.0:1787826390.711477:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826390.711480:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357000, rc 0) 00000100:00100000:1.0:1787826390.711634:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+115:163077:x1874663043059712:12345-192.168.203.47@tcp:101:rm.0 Request processed in 416us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.711642:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1257 00000100:00100000:1.0:1787826390.719229:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826390.719295:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.719409:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043060096 00000100:00100000:0.0:1787826390.719420:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043060096 00000100:00100000:0.0:1787826390.719478:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:0.0:1787826390.719490:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+115:163077:x1874663043060096:12345-192.168.203.47@tcp:35:rm.0 00000100:00100000:0.0:1787826390.720019:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+116:163077:x1874663043060096:12345-192.168.203.47@tcp:35:rm.0 Request processed in 528us (721us total) trans 21474836548 rc 0/0 00000100:00100000:0.0:1787826390.720028:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:2.0:1787826390.720380:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043059840 00000100:00100000:2.0:1787826390.720387:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043059840 00000100:00100000:2.0:1787826390.720434:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4249 00000100:00100000:2.0:1787826390.720442:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eda1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+14:2390:x1874663043059840:12345-192.168.203.47@tcp:103:rm.0 00010000:00010000:2.0:1787826390.720454:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826390.720477:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441510400/0x878a5eea00cee970 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f39a expref: 14 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.720496:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb481697600) 00010000:00010000:2.0:1787826390.720507:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826390.720544:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eda1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:2390:x1874663043059840:12345-192.168.203.47@tcp:103:rm.0 Request processed in 103us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826390.720551:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4249 00000100:00100000:1.0:1787826390.724950:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.725029:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043060352 00000100:00100000:2.0:1787826390.725039:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043060352 00000100:00100000:2.0:1787826390.725109:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1258 00000100:00100000:2.0:1787826390.725120:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+116:163077:x1874663043060352:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:2.0:1787826390.725195:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787826390.725223:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357000/0x878a5eea00ceef19 lrc: 0/0,0 mode: --/PR res: [0x240001f59:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f46c expref: 116 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.725247:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569a00/0x878a5eea00ceecb8 lrc: 0/0,0 mode: --/CR res: [0x240001f59:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f45e expref: 115 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.725259:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580c00) 00010000:00010000:2.0:1787826390.725270:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826390.725317:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.725366:0:187906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.725375:0:187906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826390.725396:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435008:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1787826390.725441:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826390.725473:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34248ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826390.725525:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049435008 00000100:00100000:1.0:1787826390.725529:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049435008 00000100:00100000:1.0:1787826390.725555:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787826390.725562:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:187906:x1874663049435008:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787826390.725572:0:187909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826390.725585:0:187909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceef20 expref: -99 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.725606:0:187909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 12 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.725616:0:187909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 4/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceef20 expref: 7 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.725644:0:187909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 12 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.725657:0:187909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 12 pid: 188992 timeout: 8557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.725668:0:187909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:187909:1874663049435136:192.168.203.47@tcp:104: 00000100:00100000:1.0:1787826390.725732:0:187909:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344537cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826390.729265:0:187909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:187909:1874663049435136:192.168.203.47@tcp:104: 00010000:00010000:1.0:1787826390.729304:0:187909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceef20 expref: 7 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.729317:0:187909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:1.0:1787826390.729320:0:187909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.729358:0:187909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceef20 expref: 7 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.729377:0:187909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441356000, rc 0) 00010000:00000080:1.0:1787826390.729386:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472615880 x1874663049435008/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 328/344 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826390.729446:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:187906:x1874663049435008:12345-0@lo:101:mdt00_002.0 Request processed in 3884us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.729454:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787826390.729902:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435008:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787826390.729920:0:187906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.729930:0:187906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826390.732408:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826390.732628:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043060480 00000100:00100000:2.0:1787826390.732638:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043060480 00010000:00010000:2.0:1787826390.732680:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 13 pid: 188992 timeout: 8557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826390.732729:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12236 00000100:00100000:2.0:1787826390.732740:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+13:2391:x1874663043060480:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826390.732754:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826390.732762:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 13 pid: 188992 timeout: 8557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.732781:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 13 pid: 188992 timeout: 8557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.732803:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb47fa8f000/0x878a5eea00ceec79 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f442 expref: 13 pid: 188992 timeout: 8557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.732818:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:2.0:1787826390.732824:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceef20 expref: 6 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.732834:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceef20 expref: 6 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.732842:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00ceef20 expref: 6 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.732875:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceef20 expref: 6 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826390.732888:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472617480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6477:1874663049435264:0@lo:105: 00000100:00100000:2.0:1787826390.732936:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826390.732975:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34248ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826390.733978:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049435264 00000100:00100000:3.0:1787826390.733987:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049435264 00000100:00100000:3.0:1787826390.734072:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4779 00000100:00100000:3.0:1787826390.734082:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472615500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6477:x1874663049435264:12345-0@lo:105: 00010000:00010000:3.0:1787826390.734108:0:6473:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.734119:0:6473:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.734128:0:6473:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.734147:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 5/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.734156:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.734169:0:6473:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.734200:0:6473:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb34bf39e00) 00000100:00100000:3.0:1787826390.734299:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472615500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6477:x1874663049435264:12345-0@lo:105: Request processed in 218us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.734306:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4779 00010000:00010000:0.0:1787826390.734536:0:187906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.734546:0:187906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.734571:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x4:0x0] 00010000:00010000:0.0:1787826390.734612:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.734620:0:187906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.734630:0:187906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.734647:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435392:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787826390.734686:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.734725:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826390.735094:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049435392 00000100:00100000:2.0:1787826390.735101:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049435392 00000100:00100000:0.0:1787826390.735228:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826390.735239:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:187906:x1874663049435392:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787826390.735255:0:187909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.735274:0:187909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00ceef35 lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceef2e expref: -99 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.735297:0:187909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00ceef35 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceef2e expref: 8 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.735309:0:187909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00ceef35 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceef2e expref: 8 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.735316:0:187909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0xf7117594 (ffff8eb452580b00) 00010000:00010000:0.0:1787826390.735319:0:187909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.735345:0:187909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568000, rc 0) 00010000:00000080:0.0:1787826390.735351:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a424380 x1874663049435392/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 328/344 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826390.735407:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049435392:12345-0@lo:101:mdt00_002.0 Request processed in 170us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.735414:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787826390.735459:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435392:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787826390.735475:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceef35 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.735487:0:187906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef35 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826390.735506:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x4:0x0] 00000100:00100000:0.0:1787826390.735540:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435520:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787826390.735570:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.735586:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.735600:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049435520 00000100:00100000:0.0:1787826390.735603:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049435520 00000100:00100000:0.0:1787826390.735622:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826390.735628:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049435520:12345-0@lo:1000:mdt00_002.0 00010000:00000080:0.0:1787826390.735663:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a224a80 x1874663049435520/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 304/4320 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826390.735697:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049435520:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.735703:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787826390.735744:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435520:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787826390.735786:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435648:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787826390.735811:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.735825:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.735836:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049435648 00000100:00100000:0.0:1787826390.735839:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049435648 00000100:00100000:0.0:1787826390.735855:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787826390.735860:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049435648:12345-0@lo:1000:mdt00_002.0 00010000:00000080:0.0:1787826390.735897:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a226680 x1874663049435648/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 328/4320 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826390.735928:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049435648:12345-0@lo:1000:mdt00_002.0 Request processed in 67us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.735934:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787826390.735957:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435648:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787826390.735990:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435776:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787826390.736014:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.736028:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.736039:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049435776 00000100:00100000:0.0:1787826390.736043:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049435776 00000100:00100000:0.0:1787826390.736059:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826390.736065:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049435776:12345-0@lo:1000:mdt00_002.0 00010000:00000080:0.0:1787826390.736123:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a225c00 x1874663049435776/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 328/4320 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 1/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826390.736311:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049435776:12345-0@lo:1000:mdt00_002.0 Request processed in 246us (295us total) trans 0 rc 1/1 00000100:00100000:0.0:1787826390.736319:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787826390.736372:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435776:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787826390.736418:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736425:0:187906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736434:0:187906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.736444:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435904:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787826390.736468:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.736483:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826390.736494:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049435904 00000100:00100000:0.0:1787826390.736497:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049435904 00000100:00100000:0.0:1787826390.736514:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826390.736519:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:187906:x1874663049435904:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787826390.736526:0:187909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826390.736540:0:187909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef43 lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00ceef3c expref: -99 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736558:0:187909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef43 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00ceef3c expref: 9 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736569:0:187909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef43 lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00ceef3c expref: 9 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736576:0:187909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580300) 00010000:00010000:0.0:1787826390.736578:0:187909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826390.736581:0:187909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569a00, rc 0) 00010000:00000080:0.0:1787826390.736585:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a224000 x1874663049435904/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 328/344 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826390.736615:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:187906:x1874663049435904:12345-0@lo:101:mdt00_002.0 Request processed in 95us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.736620:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787826390.736641:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049435904:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787826390.736652:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 4/0,1 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736661:0:187906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 4/0,1 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736682:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 3/0,1 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736691:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.736699:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.736999:0:187906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049436032:0@lo:700:mdt00_002.0 00000100:00100000:0.0:1787826390.737027:0:187906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.737055:0:187906:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826390.737308:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472617480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6477:1874663049435264:0@lo:105: 00010000:00010000:1.0:1787826390.737321:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826390.737493:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:2391:x1874663043060480:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 4753us (5092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.737501:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12236 00000100:00100000:0.0:1787826390.738252:0:187913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049436032 00000100:00100000:0.0:1787826390.738260:0:187913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049436032 00000100:00100000:0.0:1787826390.738301:0:187913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787826390.738310:0:187913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+9:187906:x1874663049436032:12345-0@lo:700:mdt00_002.0 00010000:00000080:0.0:1787826390.738478:0:187913:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a226300 x1874663049436032/t0(0) o700->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 264/248 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826390.738687:0:187913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+9:187906:x1874663049436032:12345-0@lo:700:mdt00_002.0 Request processed in 377us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.738695:0:187913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787826390.738851:0:187906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187906:1874663049436032:0@lo:700:mdt00_002.0 00000040:00080000:2.0:1787826390.738978:0:187906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826390.738996:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].9, 64 off33344 00000004:00080000:2.0:1787826390.739003:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb34248e000 with version 3 00000040:00080000:2.0:1787826390.739115:0:187906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826390.739125:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].10, 64 off33408 00000004:00080000:2.0:1787826390.739130:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb34248ec00 with version 4 00000004:00080000:0.0:1787826390.739219:0:198811:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb47a62e3c0 version 3 rpc_version 3 00000020:00100000:0.0:1787826390.739245:0:198811:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826390.739252:0:198811:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34a224380 x1874663049436288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826390.739271:0:198811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a224380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049436288:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787826390.739313:0:198811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.739408:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9d80 going to sleep for 11 seconds 00000040:00080000:2.0:1787826390.739923:0:187906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826390.739958:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].5, 64 off33088 00000100:00100000:1.0:1787826390.742838:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049436288 00000100:00100000:1.0:1787826390.742852:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049436288 00000100:00100000:1.0:1787826390.742986:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787826390.742996:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:198811:x1874663049436288:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:2.0:1787826390.743965:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].1, 664 off33432 00000040:00080000:2.0:1787826390.744095:0:187906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000284a1:0x1:0x0].1, 744 off33512 00000004:00080000:2.0:1787826390.744104:0:187906:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb3425c9600 with version 5 00000001:00080000:2.0:1787826390.745066:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318298 is committed 00000001:00080000:2.0:1787826390.745076:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318297 is committed 00010000:00000080:1.0:1787826390.745853:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34a227100 x1874663049436288/t352187318298(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 1312/4320 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826390.745989:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:198811:x1874663049436288:12345-0@lo:1000:osp_up0-1.0 Request processed in 2994us (6674us total) trans 352187318298 rc 0/0 00000100:00100000:1.0:1787826390.746000:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787826390.746177:0:198811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a224380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049436288:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787826390.746191:0:198811:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb47a62e3c0 version 4 rpc_version 4 00000020:00100000:0.0:1787826390.746217:0:198811:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826390.746223:0:198811:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34a225880 x1874663049436544/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826390.746243:0:198811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049436544:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787826390.746282:0:198811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.746365:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826390.746486:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049436544 00000100:00100000:1.0:1787826390.746493:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049436544 00000100:00100000:1.0:1787826390.746523:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787826390.746531:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:198811:x1874663049436544:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787826390.747472:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318299 is committed 00010000:00000080:1.0:1787826390.747588:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69fb80 x1874663049436544/t352187318299(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 1312/4320 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826390.747687:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:198811:x1874663049436544:12345-0@lo:1000:osp_up0-1.0 Request processed in 1156us (1405us total) trans 352187318299 rc 0/0 00000100:00100000:1.0:1787826390.747696:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787826390.747834:0:198811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34a225880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049436544:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787826390.747845:0:198811:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb47a62e3c0 version 5 rpc_version 5 00000020:00100000:0.0:1787826390.747872:0:198811:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826390.747878:0:198811:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb46e84e300 x1874663049436800/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826390.747894:0:198811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049436800:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787826390.747948:0:198811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826390.748014:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3425c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826390.748047:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049436800 00000100:00100000:3.0:1787826390.748053:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049436800 00000100:00100000:3.0:1787826390.748134:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787826390.748154:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198811:x1874663049436800:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:3.0:1787826390.749505:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e84d180 x1874663049436800/t352187318300(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 264/4320 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826390.749610:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:198811:x1874663049436800:12345-0@lo:1000:osp_up0-1.0 Request processed in 1458us (1661us total) trans 352187318300 rc 0/0 00000100:00100000:3.0:1787826390.749621:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787826390.749921:0:198811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049436800:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1787826390.749990:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x16:0x0]: returning size 4096 00010000:00010000:1.0:1787826390.750010:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 3/0,1 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750020:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750028:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750034:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826390.750039:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750047:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 4/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750062:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580e00) 00010000:00010000:1.0:1787826390.750066:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826390.750071:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750077:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef4a lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750107:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 4/0,1 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750115:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 4/0,1 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750123:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750270:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826390.750285:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x4:0x0] 00010000:00010000:1.0:1787826390.750293:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750301:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826390.750308:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.750497:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826390.750504:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 2/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826390.750512:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:2.0:1787826390.750517:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826390.750524:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 3/0,0 mode: EX/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.750606:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 2/0,0 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.750613:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826390.750639:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 1/0,0 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.750652:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569200/0x878a5eea00ceef3c lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceef43 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.750667:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826390.750670:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 4/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.750676:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39e00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:0.0:1787826390.750680:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 5/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.750687:0:6479:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 5/0,0 mode: CW/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.750704:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 4/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826390.750798:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049436928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826390.750848:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826390.750943:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826390.750986:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787826390.751400:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.751425:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049436928 00000100:00100000:0.0:1787826390.751431:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049436928 00000100:00100000:0.0:1787826390.751488:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4250 00000100:00100000:0.0:1787826390.751498:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4725e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3620:x1874663049436928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826390.751513:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826390.751533:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef43 lrc: 0/0,0 mode: --/EX res: [0x240001f59:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceef3c expref: 10 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.751548:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x0 (ffff8eb452580300) 00010000:00010000:0.0:1787826390.751558:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826390.751602:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4725e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3620:x1874663049436928:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826390.751610:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4250 00000100:00100000:0.0:1787826390.751647:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049436928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826390.751667:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.751669:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.751671:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826390.751823:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049437056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826390.751861:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826390.751975:0:187906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826390.751983:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39e00/0x878a5eea00ceef20 lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceef27 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826390.752007:0:187906:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x4:0x0] 00010000:00010000:2.0:1787826390.752057:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826390.752101:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceef35 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.752111:0:187906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceef35 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826390.752196:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+115:163077:x1874663043060352:12345-192.168.203.47@tcp:36:rm.0 Request processed in 27075us (27253us total) trans 21474836549 rc 0/0 00000100:00100000:0.0:1787826390.752204:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1258 00000100:00100000:3.0:1787826390.752935:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049437056 00000100:00100000:3.0:1787826390.752945:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049437056 00000100:00100000:3.0:1787826390.753028:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4251 00000100:00100000:3.0:1787826390.753037:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472617480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3618:x1874663049437056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826390.753050:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826390.753070:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00ceef27 lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceef20 expref: 9 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826390.753222:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:3.0:1787826390.753227:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826390.753279:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472617480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3618:x1874663049437056:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.753287:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4251 00000100:00100000:2.0:1787826390.753510:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049437056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826390.756180:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.756250:0:187907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043060736 00000100:00100000:0.0:1787826390.756261:0:187907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043060736 00000100:00100000:0.0:1787826390.756316:0:187907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:0.0:1787826390.756353:0:187907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163077:x1874663043060736:12345-192.168.203.47@tcp:35:rm.0 00010000:00000080:0.0:1787826390.756538:0:187907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479bf4380 x1874663043060736/t352187318301(0) o35->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:746/0 lens 392/456 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826390.756597:0:187907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163077:x1874663043060736:12345-192.168.203.47@tcp:35:rm.0 Request processed in 272us (426us total) trans 352187318301 rc 0/0 00000100:00100000:0.0:1787826390.756605:0:187907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:2.0:1787826390.761143:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826390.761522:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043060992 00000100:00100000:0.0:1787826390.761533:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043060992 00000100:00100000:0.0:1787826390.761634:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1259 00000100:00100000:0.0:1787826390.761646:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163077:x1874663043060992:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826390.761742:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787826390.761769:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3f000/0x878a5eea00ceec95 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f450 expref: 10 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.761791:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441511c00/0x878a5eea00cee572 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f346 expref: 9 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.761803:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb480de3200) 00010000:00010000:0.0:1787826390.761820:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cee946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f393 expref: 8 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.761969:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826390.761973:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826390.761996:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762010:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762020:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762034:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762043:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762050:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762163:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762172:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762179:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826390.762931:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1787826390.762948:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762956:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762963:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762970:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.762975:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762983:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.762999:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0x0 (ffff8eb452580900) 00010000:00010000:0.0:1787826390.763002:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826390.763006:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763013:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef5f lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763037:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763044:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763051:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763057:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826390.763060:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763066:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763074:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826390.763076:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826390.763079:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763095:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef51 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826390.763109:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079e23118 reply state 0000000025ee5fb7 transno 352187318302 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763120:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826390.763127:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8eb452580800) 00010000:00010000:0.0:1787826390.763130:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826390.763133:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1787826390.763154:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472617b80 x1874663043060992/t352187318302(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:746/0 lens 512/456 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826390.768708:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163077:x1874663043060992:12345-192.168.203.47@tcp:36:rm.0 Request processed in 7052us (8026us total) trans 352187318302 rc 0/0 00000100:00100000:0.0:1787826390.768723:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1259 00010000:00010000:1.0:1787826390.868644:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826390.876529:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049437568:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.876597:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.876632:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049438080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.876660:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.876685:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049438592:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.876708:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.876732:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826390.876738:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049437184:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.876766:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.876794:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049437696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.876817:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.876835:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049438208:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.876856:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.876885:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049437184 00000100:00100000:3.0:1787826390.876893:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049437184 00000100:00100000:3.0:1787826390.876944:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787826390.876954:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049437184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877005:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3617:x1874663049437184:12345-0@lo:400:kworker.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.877013:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787826390.877048:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049437312:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877074:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.877106:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049437824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877129:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.877147:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049438336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877169:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.877189:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787826390.877194:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049437440:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877217:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.877228:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049437952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877250:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.877264:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049438464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877283:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826390.877307:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049438080 00000100:00100000:3.0:1787826390.877311:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049438080 00000100:00100000:3.0:1787826390.877367:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049438336 00000100:00100000:3.0:1787826390.877371:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049438336 00000100:00100000:3.0:1787826390.877389:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049437952 00000100:00100000:3.0:1787826390.877392:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049437952 00000100:00100000:3.0:1787826390.877409:0:179224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049438464 00000100:00100000:3.0:1787826390.877412:0:179224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049438464 00000100:00100000:3.0:1787826390.877434:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7183 00000100:00100000:3.0:1787826390.877440:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049438080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877477:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049438080:12345-0@lo:400:kworker.0 Request processed in 37us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.877484:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7183 00000100:00100000:3.0:1787826390.877497:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7184 00000100:00100000:3.0:1787826390.877503:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049438336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877536:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049438336:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.877541:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7184 00000100:00100000:3.0:1787826390.877553:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7185 00000100:00100000:3.0:1787826390.877560:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049437952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877588:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049437952:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.877593:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7185 00000100:00100000:3.0:1787826390.877605:0:179224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7186 00000100:00100000:3.0:1787826390.877611:0:179224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049438464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877638:0:179224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049438464:12345-0@lo:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.877643:0:179224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7186 00000100:00080000:3.0:1787826390.877659:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826390.877664:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826390.877698:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049437952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877708:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049438464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877717:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049438336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877746:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:205ad83e-e455-4070-92a2-f1e25b8f3f40:3617:1874663049437184:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877758:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049438080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.877793:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049437568 00000100:00100000:3.0:1787826390.877796:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049437568 00000100:00080000:3.0:1787826390.877812:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826390.877834:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049438592 00000100:00100000:3.0:1787826390.877837:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049438592 00000100:00100000:3.0:1787826390.877852:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049437696 00000100:00100000:3.0:1787826390.877856:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049437696 00000100:00080000:3.0:1787826390.877867:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826390.877881:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049438208 00000100:00100000:3.0:1787826390.877883:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049438208 00000100:00100000:3.0:1787826390.877898:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049437312 00000100:00100000:3.0:1787826390.877901:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049437312 00000100:00080000:3.0:1787826390.877913:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826390.877928:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049437440 00000100:00100000:3.0:1787826390.877932:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049437440 00000100:00080000:3.0:1787826390.877943:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826390.877959:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1787826390.877966:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049437568:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826390.877981:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86c380 x1874663049437568/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:746/0 lens 224/224 e 0 to 0 dl 1787826401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826390.878017:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049437568:12345-0@lo:400:kworker.0 Request processed in 51us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.878024:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1787826390.878052:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049437568:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.878076:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1787826390.878083:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049438592:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826390.878108:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86f480 x1874663049438592/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:746/0 lens 224/224 e 0 to 0 dl 1787826401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826390.878144:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049438592:12345-0@lo:400:kworker.0 Request processed in 63us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.878149:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1787826390.878175:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049438592:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.878193:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1787826390.878200:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049437696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.878234:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049437696:12345-0@lo:400:kworker.0 Request processed in 36us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.878240:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1787826390.878265:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049437696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.878284:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1787826390.878291:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049438208:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826390.878301:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86c000 x1874663049438208/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:746/0 lens 224/224 e 0 to 0 dl 1787826401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826390.878350:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874663049438208:12345-0@lo:400:kworker.0 Request processed in 60us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.878357:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1787826390.878384:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874663049438208:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.878403:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1787826390.878409:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049437312:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826390.878420:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86e680 x1874663049437312/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:746/0 lens 224/224 e 0 to 0 dl 1787826401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826390.878450:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049437312:12345-0@lo:400:kworker.0 Request processed in 42us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.878456:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1787826390.878482:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049437312:0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.878505:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1787826390.878512:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049437440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826390.878543:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049437440:12345-0@lo:400:kworker.0 Request processed in 32us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826390.878549:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1787826390.878570:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049437440:0@lo:400:kworker.0 00000100:00100000:2.0:1787826390.878856:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049438720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826390.878893:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826390.879053:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826390.879062:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049438848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826390.879101:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826390.879132:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049437824 00000100:00100000:1.0:1787826390.879136:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049437824 00000100:00100000:1.0:1787826390.879156:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049438720 00000100:00100000:1.0:1787826390.879158:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049438720 00000100:00100000:1.0:1787826390.879167:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049438848 00000100:00100000:1.0:1787826390.879169:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049438848 00000100:00100000:1.0:1787826390.879181:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787826390.879186:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049437824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826390.879225:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049437824:12345-0@lo:400:kworker.0 Request processed in 38us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.879233:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787826390.879248:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826390.879254:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb469f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049438720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826390.879276:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00000100:00100000:1.0:1787826390.879311:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb469f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049438720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.879317:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826390.879354:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787826390.879361:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3620:x1874663049438848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826390.879391:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445552128 avail 1299312640 00010000:00000080:1.0:1787826390.879401:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47758e300 x1874663049438848/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:746/0 lens 224/368 e 0 to 0 dl 1787826401 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826390.879434:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3620:x1874663049438848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826390.879440:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787826390.879472:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049438848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826390.879495:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049438720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826390.879513:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049437824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826391.380692:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826391.380727:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049438976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826391.380801:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826391.380958:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049438976 00000100:00100000:2.0:1787826391.380966:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049438976 00000100:00100000:2.0:1787826391.381020:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5922 00000100:00100000:2.0:1787826391.381029:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049438976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826391.381057:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826391.381130:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049438976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826391.381138:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5922 00000100:00100000:0.0:1787826391.381236:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049438976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826391.382898:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049439104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826391.382952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826391.383828:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049439104 00000100:00100000:1.0:1787826391.383838:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049439104 00000100:00100000:1.0:1787826391.383897:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:1.0:1787826391.383907:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049439104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826391.383936:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826391.394623:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049439104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10708us (11661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826391.394638:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00000100:00100000:3.0:1787826391.399603:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049439104:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787826391.899160:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826392.840497:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826392.840534:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826392.840563:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826392.840610:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043061248 00000100:00100000:0.0:1787826392.840620:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043061248 00000100:00100000:1.0:1787826392.840786:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043061120 00000100:00100000:1.0:1787826392.840791:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043061120 00000100:00100000:1.0:1787826392.840821:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 134 00000100:00100000:1.0:1787826392.840832:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043061120:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826392.840900:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2390:x1874663043061120:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 70us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.840907:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 134 00000100:00100000:1.0:1787826392.840938:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043061376 00000100:00100000:1.0:1787826392.840942:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043061376 00000100:00100000:1.0:1787826392.840967:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 447 00000100:00100000:1.0:1787826392.840974:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:2389:x1874663043061248:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:1.0:1787826392.840993:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e84c380 x1874663043061248/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:748/0 lens 224/224 e 0 to 0 dl 1787826403 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826392.841016:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:2389:x1874663043061248:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.841022:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 447 00000100:00100000:1.0:1787826392.841035:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 448 00000100:00100000:1.0:1787826392.841041:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+115:2390:x1874663043061376:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826392.841065:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+115:2390:x1874663043061376:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.841084:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 448 00000100:00080000:0.0:1787826392.841468:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826392.841473:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826392.845506:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826392.845545:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826392.845573:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043061504 00000100:00100000:1.0:1787826392.845581:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043061504 00000100:00100000:1.0:1787826392.845632:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043061632 00000100:00100000:1.0:1787826392.845635:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043061632 00000100:00100000:1.0:1787826392.845657:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7187 00000100:00100000:1.0:1787826392.845666:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043061504:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826392.845769:0:179225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7188 00000100:00100000:0.0:1787826392.845778:0:179225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043061632:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826392.845838:0:179225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2390:x1874663043061632:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 62us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.845849:0:179225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7188 00000100:00100000:1.0:1787826392.846005:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043061504:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 339us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.846012:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7187 00000100:00080000:1.0:1787826392.846035:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826392.846039:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826392.918240:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826393.429100:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049439232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826393.429188:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.429408:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826393.429419:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049439360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826393.429450:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.429482:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049439232 00000100:00100000:0.0:1787826393.429490:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049439232 00000100:00100000:0.0:1787826393.429548:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049439360 00000100:00100000:0.0:1787826393.429552:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049439360 00000100:00100000:0.0:1787826393.429572:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:0.0:1787826393.429581:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049439232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826393.429609:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826393.429649:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049439232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.429657:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00000100:00100000:0.0:1787826393.429673:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5925 00000100:00100000:0.0:1787826393.429679:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049439360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826393.429705:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826393.429736:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049439360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.429742:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5925 00000100:00100000:0.0:1787826393.429784:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049439360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826393.430001:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049439232:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787826393.430387:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826393.430392:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826393.940722:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826394.965085:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826395.988517:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049439488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826395.988605:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826395.988699:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049439488 00000100:00100000:1.0:1787826395.988707:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049439488 00000100:00100000:1.0:1787826395.988750:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787826395.988758:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049439488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826395.988790:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445961728 avail 1299722240 00000100:00100000:1.0:1787826395.988833:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049439488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.988839:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787826395.988885:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049439488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826395.989134:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826395.989145:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049439616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826395.989180:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826395.989833:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049439744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.989869:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826395.989895:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049440256:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.989921:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826395.989937:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049440768:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.989960:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826395.989982:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826395.989990:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049440128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.990011:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826395.990025:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049440640:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.990262:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1787826395.990365:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318302 is committed 00000001:00080000:3.0:1787826395.990375:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318300 is committed 00000100:00100000:3.0:1787826395.990391:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049439744 00000100:00100000:3.0:1787826395.990395:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049439744 00000100:00100000:3.0:1787826395.990433:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787826395.990440:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049439744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.990487:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049439744:12345-0@lo:400:kworker.0 Request processed in 46us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826395.990494:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787826395.990522:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049440768 00000100:00100000:3.0:1787826395.990526:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049440768 00000100:00100000:3.0:1787826395.990560:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7189 00000100:00100000:3.0:1787826395.990567:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049440768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.990597:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049440768:12345-0@lo:400:kworker.0 Request processed in 31us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826395.990605:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7189 00010000:00010000:3.0:1787826395.990626:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.990637:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.990645:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.990651:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826395.991122:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.991132:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.991148:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff8eb452580800) 00010000:00010000:3.0:1787826395.991151:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826395.991156:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.991162:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568200/0x878a5eea00ceef58 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826395.991214:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049439744:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.991229:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049440768:0@lo:400:kworker.0 00010000:00010000:1.0:1787826395.991350:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826395.991364:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049440256 00000100:00100000:1.0:1787826395.991368:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049440256 00000100:00100000:1.0:1787826395.991404:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049440128 00000100:00100000:1.0:1787826395.991408:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049440128 00000100:00100000:1.0:1787826395.991429:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049440640 00000100:00100000:1.0:1787826395.991431:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049440640 00000100:00100000:1.0:1787826395.991443:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1787826395.991450:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049440256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.991502:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049440256:12345-0@lo:400:kworker.0 Request processed in 52us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.991508:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1787826395.991522:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1787826395.991528:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049440128:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826395.991539:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af9500 x1874663049440128/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:751/0 lens 224/224 e 0 to 0 dl 1787826406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826395.991566:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049440128:12345-0@lo:400:kworker.0 Request processed in 39us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.991571:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1787826395.991581:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1787826395.991586:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049440640:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826395.991595:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afb480 x1874663049440640/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:751/0 lens 224/224 e 0 to 0 dl 1787826406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826395.991617:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049440640:12345-0@lo:400:kworker.0 Request processed in 31us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.991622:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00080000:1.0:1787826395.991643:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826395.991647:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826395.991649:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826395.992191:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049440128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992203:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049440640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992213:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049440256:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992253:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049439872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992291:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826395.992349:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049440384:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992375:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826395.992398:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049440896:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992419:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826395.992443:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826395.992449:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049440000:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992470:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826395.992485:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049440512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992503:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826395.992521:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049441024:0@lo:400:kworker.0 00000100:00100000:1.0:1787826395.992541:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826395.992566:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049440384 00000100:00100000:1.0:1787826395.992571:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049440384 00000100:00100000:3.0:1787826395.992644:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049439872 00000100:00100000:3.0:1787826395.992648:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049439872 00000100:00100000:3.0:1787826395.992815:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049440000 00000100:00100000:3.0:1787826395.992820:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049440000 00000100:00100000:3.0:1787826395.992838:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049441024 00000100:00100000:3.0:1787826395.992841:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049441024 00000100:00100000:3.0:1787826395.992854:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1787826395.992862:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049439872:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826395.992879:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a210e00 x1874663049439872/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:751/0 lens 224/224 e 0 to 0 dl 1787826406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826395.992919:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049439872:12345-0@lo:400:kworker.0 Request processed in 58us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826395.992925:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1787826395.992939:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1787826395.992945:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049440000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.992972:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049440000:12345-0@lo:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826395.992979:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1787826395.992989:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1787826395.992995:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049441024:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826395.993005:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a210700 x1874663049441024/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:751/0 lens 224/224 e 0 to 0 dl 1787826406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826395.993028:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049441024:12345-0@lo:400:kworker.0 Request processed in 34us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826395.993175:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1787826395.993214:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049440000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.993225:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049441024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.993237:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049439872:0@lo:400:kworker.0 00000100:00100000:2.0:1787826395.996917:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049439616 00000100:00100000:2.0:1787826395.996930:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049439616 00000100:00100000:2.0:1787826395.996990:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787826395.997000:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049439616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826395.997056:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445556224 avail 1299316736 00010000:00000080:2.0:1787826395.997074:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86c700 x1874663049439616/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:751/0 lens 224/368 e 0 to 0 dl 1787826406 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826395.997155:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3618:x1874663049439616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (7975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.997162:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787826395.997516:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049439616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826395.997545:0:12319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049440896 00000100:00100000:1.0:1787826395.997549:0:12319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049440896 00000100:00100000:0.0:1787826395.997648:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049440512 00000100:00100000:0.0:1787826395.997653:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049440512 00000100:00100000:3.0:1787826395.997798:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7190 00000100:00100000:3.0:1787826395.997810:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049440384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.997864:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049440384:12345-0@lo:400:kworker.0 Request processed in 57us (5487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826395.997871:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7190 00000100:00100000:3.0:1787826395.997888:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7191 00000100:00100000:3.0:1787826395.997894:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049440896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.997926:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049440896:12345-0@lo:400:kworker.0 Request processed in 32us (5505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826395.997932:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7191 00000100:00080000:3.0:1787826395.997953:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826395.997958:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826395.997961:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826395.997964:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826395.997988:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049440384:0@lo:400:kworker.0 00000100:00100000:3.0:1787826395.998000:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049440896:0@lo:400:kworker.0 00000100:00100000:0.0:1787826395.998143:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7192 00000100:00100000:0.0:1787826395.998151:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049440512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826395.998192:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049440512:12345-0@lo:400:kworker.0 Request processed in 42us (5687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826395.998198:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7192 00000100:00080000:3.0:1787826395.998818:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826395.998848:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049440512:0@lo:400:kworker.0 00010000:00010000:0.0:1787826396.004798:0:198805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceef35 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826396.004818:0:198805:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceef35 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826396.004860:0:198805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceef35 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826396.004867:0:198805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826396.004888:0:198805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34a569000/0x878a5eea00ceef2e lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceef35 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826396.004909:0:198805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836549 is committed 00000004:00080000:0.0:1787826396.004957:0:198805:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000004:00080000:0.0:1787826396.004970:0:198805:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00010000:00010000:3.0:1787826396.005226:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005236:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005243:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005250:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005254:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005261:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005273:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x679fc7b1 (ffff8eb34df4d900) 00010000:00010000:3.0:1787826396.005277:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005281:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005287:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715e00/0x878a5eea00cee9a1 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005304:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005310:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005316:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005321:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005349:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005355:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005367:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x94c295fa (ffff8eb34df4d400) 00010000:00010000:3.0:1787826396.005369:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005372:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005377:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714000/0x878a5eea00cee9c4 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005387:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005393:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005398:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005403:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005406:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005411:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005417:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xc1e56442 (ffff8eb34df4d100) 00010000:00010000:3.0:1787826396.005419:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005421:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005426:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715400/0x878a5eea00cee9e7 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005435:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005440:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005445:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005449:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005451:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005457:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005463:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xef08328a (ffff8eb34df4df00) 00010000:00010000:3.0:1787826396.005465:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005467:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005472:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714600/0x878a5eea00ceea0a lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005482:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005488:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005493:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005498:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ec00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005501:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005507:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005514:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x1c2b00d3 (ffff8eb453a77700) 00010000:00010000:3.0:1787826396.005517:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005520:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005526:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ec00/0x878a5eea00ceea2d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005539:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005544:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005550:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005554:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3ea00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005557:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005563:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005574:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x494dcf1b (ffff8eb453a77200) 00010000:00010000:3.0:1787826396.005577:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005579:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005584:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3ea00/0x878a5eea00ceea50 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005594:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005600:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005605:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005609:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005612:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005617:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005623:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x76709d63 (ffff8eb453a77500) 00010000:00010000:3.0:1787826396.005625:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005628:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005633:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e600/0x878a5eea00ceea73 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005643:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005648:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005653:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005658:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005660:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005666:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005684:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xa3936bac (ffff8eb45ed20400) 00010000:00010000:3.0:1787826396.005687:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005690:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005695:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357800/0x878a5eea00ceea96 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005705:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005710:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005716:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005721:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005724:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005729:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005734:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xd0b639f4 (ffff8eb45ed20e00) 00010000:00010000:3.0:1787826396.005736:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005738:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005743:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356600/0x878a5eea00ceeab9 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005752:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005759:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005764:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005769:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fe00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005771:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005777:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005788:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xfdd9083c (ffff8eb453a77300) 00010000:00010000:3.0:1787826396.005790:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005793:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005799:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fe00/0x878a5eea00ceeadc lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005809:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005815:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005821:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005825:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005828:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005833:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005840:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x1b7026cc (ffff8eb45ed20700) 00010000:00010000:3.0:1787826396.005842:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005844:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005849:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356a00/0x878a5eea00ceeaff lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005859:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005865:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005870:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005875:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005877:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005883:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005890:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x3e3e6f26 (ffff8eb45ed20c00) 00010000:00010000:3.0:1787826396.005892:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005895:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005902:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441357c00/0x878a5eea00ceeb22 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005912:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005918:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005924:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005929:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005931:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005936:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005943:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x610cb780 (ffff8eb481697300) 00010000:00010000:3.0:1787826396.005945:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.005947:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005952:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d64a00/0x878a5eea00ceeb45 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005963:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005969:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005974:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005979:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.005982:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.005993:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006004:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x83daffd9 (ffff8eb45ed20300) 00010000:00010000:3.0:1787826396.006006:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006008:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006014:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e600/0x878a5eea00ceeb68 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006029:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006234:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006240:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006245:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006249:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006255:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006264:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xa6a94833 (ffff8eb34df4d000) 00010000:00010000:3.0:1787826396.006266:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006269:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006275:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715800/0x878a5eea00ceeb8b lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006288:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006293:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006299:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006303:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3fa00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006305:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006310:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006316:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xc977908d (ffff8eb453a77600) 00010000:00010000:3.0:1787826396.006319:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006321:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006348:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3fa00/0x878a5eea00ceebae lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006359:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006364:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006369:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006374:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006377:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006382:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006389:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xec45d8e7 (ffff8eb45ed20d00) 00010000:00010000:3.0:1787826396.006391:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006393:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006399:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e400/0x878a5eea00ceebd1 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006408:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006414:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006420:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006424:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006426:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006431:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006440:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xf142140 (ffff8eb453a77c00) 00010000:00010000:3.0:1787826396.006442:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006445:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006451:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e400/0x878a5eea00ceebf4 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006462:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006468:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006473:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006478:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb479b3e000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006481:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006487:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006495:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x31e2699a (ffff8eb453a77000) 00010000:00010000:3.0:1787826396.006497:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006500:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006506:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb479b3e000/0x878a5eea00ceec17 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006518:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006524:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006529:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006534:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006536:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006542:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006549:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x54b0b1f4 (ffff8eb45ed20500) 00010000:00010000:3.0:1787826396.006551:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006554:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006559:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e800/0x878a5eea00ceec3a lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006569:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006574:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006579:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006583:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006586:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006591:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006597:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x494dcf1b (ffff8eb453a77200) 00010000:00010000:3.0:1787826396.006599:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006601:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006606:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715000/0x878a5eea00ceeccd lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006623:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826396.006625:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1787826396.006629:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006634:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006639:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc1a414f0) 00000100:00100000:2.0:1787826396.006641:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049441408:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1787826396.006642:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006648:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826396.006706:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826396.006823:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x679fc7b1 (ffff8eb34df4d900) 00010000:00010000:3.0:1787826396.006826:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006830:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006836:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568c00/0x878a5eea00ceece9 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006853:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006859:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006865:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006870:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8e200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006873:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006879:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006885:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x76709d63 (ffff8eb453a77500) 00010000:00010000:3.0:1787826396.006888:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006890:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006896:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8e200/0x878a5eea00ceed05 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006911:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006917:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006922:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006927:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006929:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006934:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006940:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xa6a94833 (ffff8eb34df4d000) 00010000:00010000:3.0:1787826396.006942:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006945:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006951:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714a00/0x878a5eea00ceed21 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006962:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006967:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006972:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006976:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.006979:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006984:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006990:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xd0b639f4 (ffff8eb45ed20e00) 00010000:00010000:3.0:1787826396.006991:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.006993:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.006998:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65800/0x878a5eea00ceed3d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007009:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007014:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007019:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007022:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007025:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007029:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007115:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x1c2b00d3 (ffff8eb453a77700) 00010000:00010000:3.0:1787826396.007118:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007120:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007126:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f600/0x878a5eea00ceed59 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007139:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007144:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007150:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007155:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007158:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007163:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007169:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x83daffd9 (ffff8eb45ed20300) 00010000:00010000:3.0:1787826396.007171:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007173:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007178:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf38600/0x878a5eea00ceed75 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007189:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007195:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007200:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007204:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007207:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007213:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007219:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xc977908d (ffff8eb453a77600) 00010000:00010000:3.0:1787826396.007221:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007223:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007229:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00ceed91 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007242:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007248:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007254:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007260:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d65400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007262:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007268:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007276:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x3e3e6f26 (ffff8eb45ed20c00) 00010000:00010000:3.0:1787826396.007278:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007281:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007287:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb480d65400/0x878a5eea00ceedad lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007299:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007305:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007310:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007315:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007318:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007349:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826396.007360:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049441408 00010000:00010000:3.0:1787826396.007360:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xfdd9083c (ffff8eb453a77300) 00010000:00010000:3.0:1787826396.007363:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007365:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826396.007367:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049441408 00010000:00010000:3.0:1787826396.007371:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724ed200/0x878a5eea00ceedc9 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007384:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007389:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007395:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007399:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8ee00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007402:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007408:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826396.007411:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22643 00010000:00010000:3.0:1787826396.007415:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xef08328a (ffff8eb34df4df00) 00010000:00010000:3.0:1787826396.007417:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007419:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826396.007420:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049441408:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1787826396.007425:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8ee00/0x878a5eea00ceede5 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007438:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007443:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787826396.007446:0:43904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:932 count 1 00010000:00010000:3.0:1787826396.007449:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007453:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb47fa8f800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007455:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007460:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007466:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x54b0b1f4 (ffff8eb45ed20500) 00010000:00010000:3.0:1787826396.007468:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007471:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826396.007474:0:43904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826396.007476:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb47fa8f800/0x878a5eea00ceee01 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.007480:0:43904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007487:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007493:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007498:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.007499:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a4:0x0].0x0 since=8462s v=(0 0) 00010000:00010000:2.0:1787826396.007504:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826396.007504:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007507:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.007511:0:43904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007512:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007519:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x31e2699a (ffff8eb453a77000) 00010000:00010000:3.0:1787826396.007521:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007523:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.007525:0:43904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007529:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb4724eda00/0x878a5eea00ceee1d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.007534:0:43904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.007540:0:43904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007542:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007547:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007552:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.007557:0:43904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826396.007557:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007560:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007565:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007574:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xc1e56442 (ffff8eb34df4d100) 00010000:00010000:3.0:1787826396.007576:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007578:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007583:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568600/0x878a5eea00ceee39 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007595:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007600:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007605:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007609:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007612:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007617:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007623:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x94c295fa (ffff8eb34df4d400) 00010000:00010000:3.0:1787826396.007625:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007628:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007632:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb441356800/0x878a5eea00ceee55 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007646:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007651:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826396.007709:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049441408:12345-0@lo:6:osp-syn-0-1.0 Request processed in 289us (1001us total) trans 38654705680 rc 0/0 00000100:00100000:2.0:1787826396.007717:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22643 00010000:00010000:3.0:1787826396.007850:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007857:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007860:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007866:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007874:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xec45d8e7 (ffff8eb45ed20d00) 00010000:00010000:3.0:1787826396.007876:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007879:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007885:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34bf39600/0x878a5eea00ceee71 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007900:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007907:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007913:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007918:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007921:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007926:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007933:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xa3936bac (ffff8eb45ed20400) 00010000:00010000:3.0:1787826396.007935:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007937:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007943:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a568a00/0x878a5eea00ceee8d lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007955:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007960:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007965:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007968:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.007971:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007976:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007985:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x610cb780 (ffff8eb481697300) 00010000:00010000:3.0:1787826396.007987:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.007989:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.007994:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569400/0x878a5eea00ceeea9 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008005:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008009:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008014:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008019:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481715a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.008021:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008027:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008110:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0x1b7026cc (ffff8eb45ed20700) 00010000:00010000:3.0:1787826396.008112:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.008115:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008121:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481715a00/0x878a5eea00ceeec5 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008135:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008140:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008145:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008150:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481714c00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826396.008153:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008158:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008164:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x16:0x0].0xf142140 (ffff8eb453a77c00) 00010000:00010000:3.0:1787826396.008167:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826396.008169:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826396.008174:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb481714c00/0x878a5eea00ceeee1 lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826396.008450:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481af4000/2, rc 0, transno 38654705680 00000100:00100000:2.0:1787826396.008464:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049441408:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1787826396.008585:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826396.008593:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826396.008602:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826396.008606:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826396.008613:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826396.008627:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826396.008634:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003930055a/0x878a5eea00ceef66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826396.008648:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826396.008650:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826396.008651:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826396.008665:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049441152:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1787826396.008710:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826396.008751:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826396.008832:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049441280:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826396.008927:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826396.008956:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049441152 00000100:00100000:0.0:1787826396.008963:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049441152 00000100:00100000:0.0:1787826396.009011:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4252 00000100:00100000:0.0:1787826396.009019:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3617:x1874663049441152:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1787826396.009215:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049441280 00000100:00100000:2.0:1787826396.009220:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049441280 00000100:00100000:2.0:1787826396.009255:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22644 00000100:00100000:2.0:1787826396.009262:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049441280:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1787826396.009283:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:930 count 1 00002000:00010000:2.0:1787826396.009311:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826396.009317:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009354:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a2:0x0].0x0 since=8462s v=(0 0) 00010000:00010000:2.0:1787826396.009358:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826396.009364:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009377:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009385:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009393:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009413:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826396.009561:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049441280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 298us (633us total) trans 4294975549 rc 0/0 00000100:00100000:2.0:1787826396.009569:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22644 00010000:00010000:2.0:1787826396.009588:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826396.009593:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009601:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826396.009604:0:66923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009611:0:66923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009623:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009629:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000260aef8a/0x878a5eea00ceef6d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826396.009643:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826396.009645:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826396.009646:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826396.009763:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826396.009782:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00ceef35 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceef2e expref: 7 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826396.009796:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x4:0x0].0xf7117594 (ffff8eb452580b00) 00010000:00010000:0.0:1787826396.009804:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1787826396.009841:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481b75500/2, rc 0, transno 4294975549 00000100:00100000:2.0:1787826396.009854:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049441280:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1787826396.010173:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3617:x1874663049441152:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 1154us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826396.010181:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4252 00000100:00100000:2.0:1787826396.010231:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049441152:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:0.0:1787826396.507859:0:198816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8463334531163ns, next at 8464334528655ns, rc = 0 00000100:00100000:0.0:1787826396.507884:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826396.507902:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049441536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826396.507965:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826396.508007:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049441536 00000100:00100000:0.0:1787826396.508014:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049441536 00000100:00100000:0.0:1787826396.508074:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5926 00000100:00100000:0.0:1787826396.508083:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049441536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826396.508109:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1787826396.508156:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1874663049441536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826396.508163:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5926 00000100:00100000:3.0:1787826396.508192:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049441536:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1787826396.508286:0:198814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8463334959665ns, next at 8464334958070ns, rc = 0 00000100:00100000:0.0:1787826396.508346:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826396.508356:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049441664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826396.508383:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826396.508465:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049441664 00000100:00100000:2.0:1787826396.508469:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049441664 00000100:00100000:2.0:1787826396.508496:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5927 00000100:00100000:2.0:1787826396.508503:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049441664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826396.508519:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826396.508558:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1874663049441664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826396.508563:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5927 00000100:00100000:2.0:1787826396.508595:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049441664:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787826397.013088:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826397.951839:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826397.951899:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826397.951931:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826397.951952:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826397.951982:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826397.952015:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043062272 00000100:00100000:0.0:1787826397.952028:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043062272 00000100:00100000:0.0:1787826397.952122:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043062144 00000100:00100000:0.0:1787826397.952126:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043062144 00000100:00100000:0.0:1787826397.952156:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7193 00000100:00100000:0.0:1787826397.952168:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043062272:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826397.952263:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043062272:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 96us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826397.952272:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7193 00000100:00100000:0.0:1787826397.952293:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7194 00000100:00100000:0.0:1787826397.952300:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043062144:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826397.952364:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043062144:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 63us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826397.952549:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7194 00000100:00100000:0.0:1787826397.952600:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043062016 00000100:00100000:0.0:1787826397.952605:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043062016 00000100:00100000:0.0:1787826397.952638:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043061888 00000100:00100000:0.0:1787826397.952642:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043061888 00000100:00100000:2.0:1787826397.952773:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043061760 00000100:00100000:2.0:1787826397.952778:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043061760 00000100:00100000:2.0:1787826397.952815:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 136 00000100:00100000:2.0:1787826397.952823:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043061760:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826397.952857:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043061760:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.952863:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 136 00000100:00100000:2.0:1787826397.952899:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 455 00000100:00100000:2.0:1787826397.952906:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043062016:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826397.952935:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043062016:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.952941:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 455 00000100:00100000:2.0:1787826397.952958:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 456 00000100:00100000:2.0:1787826397.952963:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043061888:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:2.0:1787826397.952978:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481aff100 x1874663043061888/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:753/0 lens 224/224 e 0 to 0 dl 1787826408 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826397.953003:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043061888:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 40us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.953010:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 456 00000100:00080000:0.0:1787826397.953480:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826397.953486:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826397.953489:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826397.953492:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826398.036845:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826398.292919:0:199613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80c: DNE: create remote dir, drop update rep from MDT1, fail MDT[0,1] ========================================================== 06:26:37 (1787826397) 00000100:00100000:0.0:1787826398.391416:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826398.391495:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043062400 00000100:00100000:3.0:1787826398.391505:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043062400 00000100:00100000:3.0:1787826398.391569:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1260 00000100:00100000:3.0:1787826398.391579:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:163648:x1874663043062400:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826398.391600:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826398.391620:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceef74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f473 expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.391699:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00ceef7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.391712:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00ceef7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.391724:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00ceef7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826398.391769:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787826398.391773:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1787826398.391789:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00ceef7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.391813:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceef74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f473 expref: 8 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.391828:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00ceef7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f473 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.391836:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826398.391840:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826398.391843:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed000, rc 0) 00010000:00000080:3.0:1787826398.391851:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afce00 x1874663043062400/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:754/0 lens 576/688 e 0 to 0 dl 1787826409 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826398.391912:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163648:x1874663043062400:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 335us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826398.391918:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1260 00000100:00100000:3.0:1787826398.401793:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826398.402014:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043062528 00000100:00100000:0.0:1787826398.402028:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043062528 00000100:00100000:0.0:1787826398.402117:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1261 00000100:00100000:0.0:1787826398.402130:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163648:x1874663043062528:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826398.402157:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826398.402194:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f47a expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.402286:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.402303:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.402315:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.402362:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.402370:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.402390:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404597:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404620:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404628:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404634:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826398.404661:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404675:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404696:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826398.404700:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826398.404706:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404712:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569200/0x878a5eea00ceef89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404742:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404748:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404754:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404760:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826398.404762:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404768:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404776:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8eb452580b00) 00010000:00010000:0.0:1787826398.404778:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826398.404782:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404792:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00ceef90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404851:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f47a expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404863:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826398.404865:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826398.404869:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00ceef82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f47a expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826398.404879:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569c00, rc 0) 00010000:00000080:0.0:1787826398.404890:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afbb80 x1874663043062528/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:754/0 lens 592/584 e 0 to 0 dl 1787826409 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826398.405003:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163648:x1874663043062528:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 2871us (3220us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826398.405016:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1261 00000100:00100000:3.0:1787826398.422419:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826398.422738:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043062784 00000100:00100000:2.0:1787826398.422758:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043062784 00000100:00100000:2.0:1787826398.422821:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1262 00000100:00100000:2.0:1787826398.422831:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163648:x1874663043062784:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:2.0:1787826398.422896:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826398.422924:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed000/0x878a5eea00ceef7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f473 expref: 7 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826398.422942:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:2.0:1787826398.422947:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826398.423021:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826398.423046:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826398.423058:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826398.423079:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826398.423085:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826398.423091:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424634:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424650:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424659:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826398.424673:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e196532 reply state 00000000441bf724 transno 352187318303 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424683:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424691:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826398.424693:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826398.424696:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787826398.424701:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1787826398.424709:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424716:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424721:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424728:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424734:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826398.424739:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424746:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424828:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826398.424832:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826398.424835:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424842:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf39a00/0x878a5eea00ceef97 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826398.424925:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e196532 reply state 00000000441bf724 transno 352187318303 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424936:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826398.424944:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8eb34df4d700) 00010000:00010000:3.0:1787826398.424947:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826398.424950:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00000080:3.0:1787826398.424982:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af8700 x1874663043062784/t352187318303(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:754/0 lens 568/448 e 0 to 0 dl 1787826409 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826398.425110:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163648:x1874663043062784:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 2279us (2788us total) trans 352187318303 rc 0/0 00000100:00100000:3.0:1787826398.425119:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1262 00000100:00100000:1.0:1787826398.548673:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826398.548700:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049441792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826398.548773:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826398.548871:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049441792 00000100:00100000:0.0:1787826398.548879:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049441792 00000100:00100000:0.0:1787826398.548947:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5928 00000100:00100000:0.0:1787826398.548957:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049441792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826398.548987:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826398.549047:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049441792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826398.549054:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5928 00000100:00100000:2.0:1787826398.549094:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049441792:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787826398.549135:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826398.549316:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049441920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826398.549382:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826398.549408:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049441920 00000100:00100000:1.0:1787826398.549413:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049441920 00000100:00100000:1.0:1787826398.549463:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:1.0:1787826398.549471:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47993b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049441920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826398.549488:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826398.549527:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47993b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049441920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.549534:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00000100:00100000:1.0:1787826398.549578:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049441920:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787826398.549608:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826399.069197:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826399.617018:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826399.617090:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043062912 00000100:00100000:3.0:1787826399.617100:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043062912 00000100:00080000:2.0:1787826399.617187:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826399.617222:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1263 00000100:00100000:3.0:1787826399.617237:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb48110b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163667:x1874663043062912:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826399.617260:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826399.617281:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00ceefac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f481 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.617372:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00ceefb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.617385:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00ceefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.617397:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00ceefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826399.617435:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787826399.617438:0:188682:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1787826399.617453:0:188682:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00ceefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.617475:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00ceefac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f481 expref: 10 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.617490:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00ceefb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f481 expref: 9 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.617504:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826399.617508:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826399.617512:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ece00, rc 0) 00010000:00000080:3.0:1787826399.617518:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb48110b480 x1874663043062912/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:0/0 lens 576/688 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826399.617575:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb48110b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163667:x1874663043062912:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 344us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826399.617582:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1263 00000100:00100000:2.0:1787826399.622054:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826399.622145:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043063040 00000100:00100000:0.0:1787826399.622157:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043063040 00000100:00100000:0.0:1787826399.622216:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1264 00000100:00100000:0.0:1787826399.622226:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163667:x1874663043063040:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826399.622246:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826399.622265:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ceefba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f488 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622374:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622389:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622401:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622411:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622418:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622424:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622513:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ceefcf lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622522:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ceefcf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622529:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ceefcf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826399.622562:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1787826399.622566:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:0.0:1787826399.622584:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ceefcf lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622595:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622602:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622608:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622614:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826399.622618:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622625:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622637:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826399.622640:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826399.622644:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622650:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00ceefc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622663:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622673:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622678:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622683:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826399.622685:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622691:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622697:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8eb34df4d700) 00010000:00010000:0.0:1787826399.622700:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826399.622703:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622709:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00ceefc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622734:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00ceefba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f488 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622758:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ceefcf lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f488 expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.622766:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:0.0:1787826399.622768:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787826399.622771:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568a00, rc 0) 00010000:00000080:0.0:1787826399.622779:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde3800 x1874663043063040/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:0/0 lens 592/688 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826399.622839:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163667:x1874663043063040:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 615us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826399.622846:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1264 00000100:00100000:2.0:1787826399.636684:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826399.636742:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043063168 00000100:00100000:3.0:1787826399.636759:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043063168 00000100:00100000:3.0:1787826399.636841:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1265 00000100:00100000:3.0:1787826399.636851:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47fb0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163667:x1874663043063168:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826399.636870:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826399.636887:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00ceefd6 lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f48f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.636943:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.636955:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.636966:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.636980:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.636992:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.636998:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637040:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637047:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637053:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637059:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637065:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724edc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826399.637069:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637075:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 5/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637086:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826399.637089:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.637092:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637099:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceefdd lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637110:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637116:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637123:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637127:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826399.637130:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637136:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637142:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0xf7117594 (ffff8eb481693200) 00010000:00010000:3.0:1787826399.637144:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.637146:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637151:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceefe4 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637177:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00ceefd6 lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f48f expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637185:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826399.637187:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.637191:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00ceefd6 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f48f expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.637200:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ecc00, rc 0) 00010000:00000080:3.0:1787826399.637207:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47fb0b850 x1874663043063168/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:0/0 lens 584/584 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826399.637262:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47fb0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163667:x1874663043063168:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 413us (588us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826399.637269:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1265 00000100:00100000:2.0:1787826399.651827:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826399.651915:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043063296 00000100:00100000:3.0:1787826399.651933:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043063296 00000100:00100000:3.0:1787826399.652031:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1266 00000100:00100000:3.0:1787826399.652048:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163667:x1874663043063296:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826399.652086:0:188682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826399.652115:0:188682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00ceefeb lrc: 2/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f496 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652205:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 3/1,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652223:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652237:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 3/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652257:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652265:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652273:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652375:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652383:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 4/1,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652391:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 3/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652399:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652406:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826399.652412:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 4/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652421:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 5/0,0 mode: CR/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652436:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826399.652440:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.652447:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 3/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652454:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00ceeff2 lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652475:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652483:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652489:0:188682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652495:0:188682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724edc00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826399.652498:0:188682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652505:0:188682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652514:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0xf7117594 (ffff8eb481693200) 00010000:00010000:3.0:1787826399.652517:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.652520:0:188682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 2/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652526:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00ceeff9 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652571:0:188682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00ceefeb lrc: 1/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f496 expref: 11 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652585:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826399.652588:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.652593:0:188682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00ceefeb lrc: 0/0,0 mode: --/CR res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f496 expref: 11 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.652609:0:188682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ecc00, rc 0) 00010000:00000080:3.0:1787826399.652620:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde0e00 x1874663043063296/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:0/0 lens 584/584 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826399.652912:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163667:x1874663043063296:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 867us (1090us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826399.652922:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1266 00000100:00100000:2.0:1787826399.669960:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826399.670533:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043063424 00000100:00100000:3.0:1787826399.670551:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043063424 00000100:00100000:3.0:1787826399.670764:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1267 00000100:00100000:3.0:1787826399.670781:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163667:x1874663043063424:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1787826399.670810:0:187906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826399.670839:0:187906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cef000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f49d expref: -99 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.670933:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.670951:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.670965:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826399.671035:0:187906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787826399.671040:0:187906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1787826399.671065:0:187906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.673242:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ecc00/0x878a5eea00cef000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 12 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.673269:0:187906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.673280:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826399.673283:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826399.673289:0:187906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724edc00, rc 0) 00010000:00000080:3.0:1787826399.673302:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde3100 x1874663043063424/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:0/0 lens 576/688 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826399.673438:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163667:x1874663043063424:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 2659us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826399.673452:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1267 00000100:00100000:3.0:1787826399.676838:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826399.681614:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043063680 00000100:00100000:0.0:1787826399.681637:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043063680 00000100:00100000:0.0:1787826399.681752:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1268 00000100:00100000:0.0:1787826399.681768:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163667:x1874663043063680:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826399.681797:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826399.681827:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cef00e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f4a4 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826399.681967:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1787826399.682133:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cef00e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4a4 expref: 13 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.682152:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826399.682155:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826399.682161:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568c00/0x878a5eea00cef00e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4a4 expref: 13 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.682178:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a568c00, rc 0) 00010000:00000080:0.0:1787826399.682188:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afb800 x1874663043063680/t352187318304(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:0/0 lens 648/664 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826399.682467:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+12:163667:x1874663043063680:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 701us (5636us total) trans 352187318304 rc 301/301 00000100:00100000:0.0:1787826399.682477:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1268 00000100:00100000:2.0:1787826399.691909:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826399.692660:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043063936 00000100:00100000:3.0:1787826399.692673:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043063936 00000100:00100000:3.0:1787826399.692760:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1269 00000100:00100000:3.0:1787826399.692776:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:163667:x1874663043063936:12345-192.168.203.47@tcp:36:lfs.0 00000100:00100000:3.0:1787826399.692901:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442048:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826399.692963:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826399.693014:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481c6e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826399.693036:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049442048 00000100:00100000:0.0:1787826399.693050:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049442048 00000100:00100000:0.0:1787826399.693135:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787826399.693146:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049442048:12345-0@lo:1000:mdt00_003.0 00010000:00000080:0.0:1787826399.693206:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afb480 x1874663049442048/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 304/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826399.693288:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049442048:12345-0@lo:1000:mdt00_003.0 Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826399.693295:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787826399.697119:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826399.697290:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442048:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826399.697413:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442176:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826399.697471:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826399.697512:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481c6e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826399.697628:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049442176 00000100:00100000:0.0:1787826399.697781:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049442176 00000100:00100000:0.0:1787826399.697865:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787826399.697878:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049442176:12345-0@lo:1000:mdt00_003.0 00010000:00000080:0.0:1787826399.697959:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afbb80 x1874663049442176/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 328/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826399.698065:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049442176:12345-0@lo:1000:mdt00_003.0 Request processed in 189us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826399.698079:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787826399.698105:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442176:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826399.698165:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442304:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826399.698198:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826399.698228:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481c6e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826399.699003:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049442304 00000100:00100000:0.0:1787826399.699016:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049442304 00000100:00100000:2.0:1787826399.699461:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787826399.699486:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049442304:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1787826399.699561:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af8700 x1874663049442304/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 328/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.699627:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049442304:12345-0@lo:1000:mdt00_003.0 Request processed in 151us (1428us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826399.699635:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787826399.699760:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442304:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787826399.699830:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.699839:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.699848:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 3/0,1 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826399.699863:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442432:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826399.699898:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826399.699935:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb481c6ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.699988:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049442432 00000100:00100000:2.0:1787826399.699995:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049442432 00000100:00100000:2.0:1787826399.700043:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787826399.700050:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:188682:x1874663049442432:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826399.700060:0:187910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826399.700076:0:187910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cef01c expref: -99 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.700097:0:187910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 2/0,1 mode: TXN/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.700108:0:187910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 2/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.700116:0:187910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 5/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 7 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.700155:0:187910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 11 pid: 187906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.700168:0:187910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 11 pid: 187906 timeout: 8566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826399.700180:0:187910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde2d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:187910:1874663049442560:192.168.203.47@tcp:104: 00010000:00010000:2.0:1787826399.700244:0:187910:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1787826399.700276:0:187910:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787826399.700308:0:187910:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3445370c0 going to sleep for 11 seconds 00000001:00080000:2.0:1787826399.700906:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318304 is committed 00010000:00010000:3.0:1787826399.701034:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701044:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701050:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701055:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826399.701060:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701067:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701082:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff8eb34df4d700) 00010000:00010000:3.0:1787826399.701085:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.701090:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701096:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38e00/0x878a5eea00ceef9e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701123:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701130:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701212:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701219:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826399.701223:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701230:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701241:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826399.701245:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.701250:0:3604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 7 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701259:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 2/0,0 mode: --/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.701265:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00ceefa5 lrc: 0/0,0 mode: --/TXN res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826399.706677:0:187910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde2d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:187910:1874663049442560:192.168.203.47@tcp:104: 00010000:00010000:3.0:1787826399.706733:0:187910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 7 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.706748:0:187910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826399.706752:0:187910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826399.706757:0:187910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 3/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 7 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826399.706769:0:187910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38600, rc 0) 00010000:00000080:3.0:1787826399.706785:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af8a80 x1874663049442432/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 328/344 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826399.706885:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049442432:12345-0@lo:101:mdt00_003.0 Request processed in 6834us (6986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826399.706896:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787826399.706960:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442432:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826399.706989:0:188682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.707003:0:188682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 4/0,1 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826399.716609:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826399.716694:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043064064 00000100:00100000:0.0:1787826399.716705:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043064064 00010000:00010000:0.0:1787826399.716753:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 9 pid: 187906 timeout: 8566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826399.716813:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12237 00000100:00100000:0.0:1787826399.716825:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:2391:x1874663043064064:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826399.716840:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826399.716848:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 4/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 9 pid: 187906 timeout: 8566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.716863:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 9 pid: 187906 timeout: 8566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.716886:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724edc00/0x878a5eea00cef007 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f49d expref: 9 pid: 187906 timeout: 8566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.716909:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:0.0:1787826399.716917:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 6 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.716929:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 6 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.716938:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 6 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826399.716990:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 6 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826399.717005:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10369:1874663049442688:0@lo:105: 00000100:00100000:0.0:1787826399.717071:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826399.717109:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3452679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.717279:0:9494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787826399.717291:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049442688 00000100:00100000:2.0:1787826399.717295:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049442688 00000100:00100000:2.0:1787826399.717367:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4780 00000100:00100000:2.0:1787826399.717379:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10369:x1874663049442688:12345-0@lo:105: 00010000:00010000:2.0:1787826399.717390:0:9494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717401:0:9494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717411:0:9494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 5/0,1 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717419:0:9494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 5/0,1 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717428:0:9494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717436:0:9494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 6/0,1 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717455:0:9494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8eb4724ecc00) 00000100:00100000:2.0:1787826399.717500:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10369:x1874663049442688:12345-0@lo:105: Request processed in 125us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.717507:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4780 00010000:00010000:2.0:1787826399.717569:0:188682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717577:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826399.717602:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x7:0x0] 00010000:00010000:2.0:1787826399.717637:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717645:0:188682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.717653:0:188682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826399.717670:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442816:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787826399.717700:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.717725:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb472779540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.717765:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10369:1874663049442688:0@lo:105: 00010000:00010000:2.0:1787826399.717994:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826399.718092:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2391:x1874663043064064:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1266us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.718100:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12237 00000100:00100000:2.0:1787826399.718149:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049442816 00000100:00100000:2.0:1787826399.718154:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049442816 00000100:00100000:2.0:1787826399.718185:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787826399.718192:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:188682:x1874663049442816:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826399.718206:0:187909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826399.718222:0:187909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00cef031 lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x878a5eea00cef02a expref: -99 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.718241:0:187909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00cef031 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cef02a expref: 8 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.718252:0:187909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00cef031 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef02a expref: 8 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.718261:0:187909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0xf7117594 (ffff8eb34df4d300) 00010000:00010000:2.0:1787826399.718264:0:187909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826399.718267:0:187909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf38a00, rc 0) 00010000:00000080:2.0:1787826399.718272:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde1880 x1874663049442816/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 328/344 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.718313:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049442816:12345-0@lo:101:mdt00_003.0 Request processed in 122us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.718362:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787826399.718392:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442816:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826399.718404:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef031 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826399.718413:0:188682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef031 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826399.718425:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x7:0x0] 00000100:00100000:2.0:1787826399.718459:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442944:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.718486:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.718500:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450964cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.718514:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049442944 00000100:00100000:2.0:1787826399.718517:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049442944 00000100:00100000:2.0:1787826399.718541:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787826399.718547:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049442944:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1787826399.718577:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde0000 x1874663049442944/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 304/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.718607:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049442944:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.718614:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787826399.718635:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049442944:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.718676:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443072:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.718699:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.718712:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.718724:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049443072 00000100:00100000:2.0:1787826399.718727:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049443072 00000100:00100000:2.0:1787826399.718745:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787826399.718752:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443072:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1787826399.718824:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde3800 x1874663049443072/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 328/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.718861:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443072:12345-0@lo:1000:mdt00_003.0 Request processed in 111us (163us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826399.718868:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787826399.718898:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443072:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.718970:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.719009:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.719034:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.719047:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049443200 00000100:00100000:2.0:1787826399.719050:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049443200 00000100:00100000:2.0:1787826399.719076:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787826399.719083:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47999a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443200:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1787826399.719107:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47999a450 x1874663049443200/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 328/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.719142:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47999a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443200:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (133us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826399.719149:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787826399.719497:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.719549:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443328:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.719623:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.719641:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.719654:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049443328 00000100:00100000:2.0:1787826399.719658:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049443328 00000100:00100000:2.0:1787826399.719686:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787826399.719695:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443328:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1787826399.719724:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde1880 x1874663049443328/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 344/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.719762:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443328:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.719768:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787826399.719797:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443328:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.719842:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443456:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.719868:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.719881:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.719893:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049443456 00000100:00100000:2.0:1787826399.719896:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049443456 00000100:00100000:2.0:1787826399.719921:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787826399.719931:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443456:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1787826399.719966:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde0000 x1874663049443456/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 328/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.720005:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443456:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.720011:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787826399.720048:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443456:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.720081:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443584:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.720104:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.720116:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb3436b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.720126:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049443584 00000100:00100000:2.0:1787826399.720129:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049443584 00000100:00100000:2.0:1787826399.720147:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787826399.720152:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443584:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1787826399.720178:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde3800 x1874663049443584/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 328/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.720209:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443584:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.720217:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787826399.720248:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443584:0@lo:1000:mdt00_003.0 00000040:00080000:2.0:1787826399.720787:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002728:0x1:0x0].2, 1096 off34528 00000100:00100000:2.0:1787826399.720871:0:188682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826399.720912:0:188682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.720936:0:188682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb444dde0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826399.720955:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049443712 00000100:00100000:2.0:1787826399.720960:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049443712 00000100:00100000:2.0:1787826399.720986:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787826399.720993:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443712:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1787826399.722009:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde2d80 x1874663049443712/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 304/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826399.722124:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:188682:x1874663049443712:12345-0@lo:1000:mdt00_003.0 Request processed in 1131us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826399.722143:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787826399.722434:0:188682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188682:1874663049443712:0@lo:1000:mdt00_003.0 00000040:00080000:0.0:1787826399.722475:0:188682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000284a1:0x1:0x0].2, 1240 off34752 00000004:00080000:0.0:1787826399.722486:0:188682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8eb3436b2240 with version 6 00000004:00080000:2.0:1787826399.722676:0:198811:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8eb47a62e3c0 version 6 rpc_version 6 00000020:00100000:2.0:1787826399.722702:0:198811:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826399.722709:0:198811:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8eb34dde0a80 x1874663049443968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826399.722729:0:198811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049443968:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826399.722768:0:198811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826399.722803:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826399.722902:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049443968 00000100:00100000:0.0:1787826399.722908:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049443968 00000100:00100000:0.0:1787826399.722947:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787826399.722965:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:198811:x1874663049443968:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:0.0:1787826399.723445:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472974a80 x1874663049443968/t352187318305(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 2520/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787826399.723457:0:187909:0:(ldlm_lib.c:3372:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00010000:00020000:0.0:1787826399.723461:0:187909:0:(ldlm_lib.c:3373:target_send_reply_msg()) @@@ dropping reply req@ffff8eb472974a80 x1874663049443968/t352187318305(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 2520/4320 e 0 to 0 dl 1787826410 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826399.754508:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:198811:x1874663049443968:12345-0@lo:1000:osp_up0-1.0 Request processed in 31535us (31730us total) trans 352187318305 rc 0/0 00000100:00100000:0.0:1787826399.754523:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:2.0:1787826400.087010:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787826400.485048:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318305 is committed 00000001:00080000:2.0:1787826400.485353:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975549 is committed 00000001:00080000:0.0:1787826400.486194:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705680 is committed 00000001:00080000:0.0:1787826400.487867:0:198805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836550 is committed 00000004:00080000:0.0:1787826400.487884:0:198805:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000100:00100000:1.0:1787826400.488158:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049444096:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1787826400.488228:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826400.488284:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049444096 00000100:00100000:1.0:1787826400.488291:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049444096 00000100:00100000:1.0:1787826400.488377:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22645 00000100:00100000:1.0:1787826400.488387:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049444096:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1787826400.488413:0:8723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:936 count 1 00002000:00010000:1.0:1787826400.488445:0:8723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826400.488453:0:8723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488469:0:8723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a8:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:1.0:1787826400.488474:0:8723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826400.488480:0:8723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488502:0:8723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488511:0:8723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488519:0:8723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488537:0:8723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826400.488692:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049444096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 306us (464us total) trans 38654705681 rc 0/0 00000100:00100000:1.0:1787826400.488700:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22645 00000100:00080000:1.0:1787826400.488723:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826400.488736:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826400.488742:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488750:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.488755:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488764:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488786:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488794:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3e11888/0x878a5eea00cef038 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.488812:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826400.488814:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826400.488816:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826400.488845:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705680 gen 2 00000004:00080000:1.0:1787826400.488851:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481af4000, transno 38654705680 00000100:00100000:1.0:1787826400.488859:0:3620:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8eb472975c00 x1874663049444096/t38654705681(38654705681) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787826416 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787826400.488871:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb472975c00/2, rc 0, transno 38654705681 00000100:00100000:1.0:1787826400.488876:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049444096:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1787826400.489219:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049444480:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1787826400.489255:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826400.489278:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049444992:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1787826400.489301:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826400.489319:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787826400.489345:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049444608:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1787826400.489366:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826400.489380:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049445120:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1787826400.489398:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826400.489544:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049444352:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826400.489574:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826400.489591:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049444864:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826400.489620:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826400.489647:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826400.489654:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049444224:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826400.489673:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826400.489687:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049444736:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826400.489703:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826400.489730:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049444480 00000100:00100000:3.0:1787826400.489736:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049444480 00000100:00100000:3.0:1787826400.489767:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049444992 00000100:00100000:3.0:1787826400.489771:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049444992 00000100:00100000:3.0:1787826400.489787:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049444608 00000100:00100000:3.0:1787826400.489790:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049444608 00000100:00100000:3.0:1787826400.489805:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049445120 00000100:00100000:3.0:1787826400.489808:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049445120 00000100:00100000:3.0:1787826400.489821:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049444352 00000100:00100000:3.0:1787826400.489824:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049444352 00000100:00100000:3.0:1787826400.489838:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049444864 00000100:00100000:3.0:1787826400.489841:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049444864 00000100:00100000:3.0:1787826400.489857:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049444224 00000100:00100000:3.0:1787826400.489860:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049444224 00000100:00100000:3.0:1787826400.489873:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049444736 00000100:00100000:3.0:1787826400.489876:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049444736 00000100:00100000:3.0:1787826400.489891:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22646 00000100:00100000:3.0:1787826400.489899:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3619:x1874663049444480:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826400.489919:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:934 count 1 00002000:00010000:3.0:1787826400.489944:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826400.489951:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.489965:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a6:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:3.0:1787826400.489969:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826400.489974:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.489985:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.489994:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490002:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490481:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826400.490622:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3619:x1874663049444480:12345-0@lo:6:osp-syn-0-1.0 Request processed in 722us (1365us total) trans 38654705682 rc 0/0 00000100:00100000:3.0:1787826400.490631:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22646 00000100:00100000:3.0:1787826400.490664:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22647 00000100:00100000:3.0:1787826400.490674:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3619:x1874663049444992:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826400.490692:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:933 count 1 00002000:00010000:3.0:1787826400.490711:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826400.490717:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490728:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a5:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:3.0:1787826400.490732:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826400.490736:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490747:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490756:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490763:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490777:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787826400.490844:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3619:x1874663049444992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 172us (1541us total) trans 38654705683 rc 0/0 00000100:00100000:3.0:1787826400.490851:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22647 00000100:00100000:3.0:1787826400.490865:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22648 00000100:00100000:3.0:1787826400.490872:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3619:x1874663049444608:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826400.490884:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:931 count 1 00002000:00010000:3.0:1787826400.490899:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826400.490903:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490912:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a3:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:3.0:1787826400.490915:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826400.490919:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490934:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490942:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490949:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.490962:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1787826400.491039:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3619:x1874663049444608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 167us (1671us total) trans 38654705684 rc 0/0 00000100:00100000:3.0:1787826400.491046:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22648 00000100:00100000:3.0:1787826400.491060:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22649 00000100:00100000:3.0:1787826400.491068:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3619:x1874663049445120:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826400.491213:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:938 count 1 00002000:00010000:3.0:1787826400.491228:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826400.491233:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.491243:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3aa:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:3.0:1787826400.491246:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826400.491250:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.491265:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.491274:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.491281:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.491294:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1787826400.491395:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3619:x1874663049445120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 328us (1995us total) trans 38654705685 rc 0/0 00000100:00100000:3.0:1787826400.491402:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22649 00000100:00100000:3.0:1787826400.491417:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22650 00000100:00100000:3.0:1787826400.491424:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3618:x1874663049444352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826400.491437:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:935 count 1 00000100:00100000:2.0:1787826400.491700:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22651 00000100:00100000:2.0:1787826400.491711:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+13:3618:x1874663049444864:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1787826400.491725:0:179223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:930 count 1 00002000:00010000:2.0:1787826400.491744:0:179223:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826400.491750:0:179223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491760:0:179223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a2:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:2.0:1787826400.491763:0:179223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826400.491768:0:179223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491778:0:179223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491786:0:179223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491793:0:179223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491802:0:179223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1787826400.491889:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+14:3618:x1874663049444864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 180us (2278us total) trans 38654705686 rc 0/0 00000100:00100000:2.0:1787826400.491895:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22651 00000100:00100000:2.0:1787826400.491910:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22652 00000100:00100000:2.0:1787826400.491917:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+13:3618:x1874663049444224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1787826400.491929:0:179223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:937 count 1 00002000:00010000:2.0:1787826400.491942:0:179223:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826400.491947:0:179223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491956:0:179223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a9:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:2.0:1787826400.491959:0:179223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826400.491963:0:179223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491978:0:179223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491986:0:179223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.491993:0:179223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492002:0:179223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787826400.492155:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826400.492161:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.492170:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a7:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:3.0:1787826400.492172:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826400.492177:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.492189:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.492196:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.492203:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.492212:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1787826400.492361:0:179222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22653 00000100:00100000:1.0:1787826400.492372:0:179222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+15:3618:x1874663049444736:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1787826400.492389:0:179222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:939 count 1 00002000:00010000:1.0:1787826400.492404:0:179222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826400.492409:0:179222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.492417:0:179222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ab:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:1.0:1787826400.492420:0:179222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826400.492424:0:179222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.492434:0:179222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.492442:0:179222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.492450:0:179222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.492459:0:179222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1787826400.492573:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+16:3618:x1874663049444224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 655us (2897us total) trans 38654705687 rc 0/0 00000100:00100000:2.0:1787826400.492579:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22652 00010000:00010000:2.0:1787826400.492606:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1787826400.492612:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492620:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826400.492625:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492633:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492664:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492673:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff49a089/0x878a5eea00cef03f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492693:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787826400.492697:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492703:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826400.492707:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492714:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492724:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492731:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd802470/0x878a5eea00cef046 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492743:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787826400.492747:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492753:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826400.492757:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492764:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492774:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492782:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4691a5a/0x878a5eea00cef04d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492794:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787826400.492797:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492803:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826400.492806:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492814:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492823:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492830:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9e486ab/0x878a5eea00cef054 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492842:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787826400.492845:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492851:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826400.492854:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492862:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492872:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492880:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71547e3/0x878a5eea00cef05b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492892:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826400.492895:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492902:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf39800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826400.492905:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492919:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492928:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492935:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1f60fb1/0x878a5eea00cef062 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492946:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826400.492950:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492956:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826400.492959:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492967:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492977:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.492985:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8e1e7ab/0x878a5eea00cef069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.493003:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826400.493007:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.493013:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826400.493026:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.493034:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.493044:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.493051:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a24bae27/0x878a5eea00cef070 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826400.493065:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826400.493068:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826400.493081:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826400.493091:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826400.493167:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3618:x1874663049444352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1742us (3590us total) trans 38654705688 rc 0/0 00000100:00100000:3.0:1787826400.493174:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22650 00000004:00080000:0.0:1787826400.493361:0:198805:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000100:00100000:0.0:1787826400.496232:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049445632:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1787826400.496309:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826400.496383:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049446144:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1787826400.496406:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826400.496431:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787826400.496439:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049445504:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1787826400.496460:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826400.496478:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049446016:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1787826400.496497:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826400.496524:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049445632 00000100:00100000:0.0:1787826400.496533:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049445632 00000100:00100000:0.0:1787826400.496588:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22654 00000100:00100000:0.0:1787826400.496597:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049445632:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1787826400.496626:0:43897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:932 count 1 00002000:00010000:0.0:1787826400.496672:0:43897:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826400.496681:0:43897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.496698:0:43897:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a4:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:0.0:1787826400.496703:0:43897:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826400.496709:0:43897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.496725:0:43897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.496735:0:43897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.496742:0:43897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.496766:0:43897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826400.496926:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3620:x1874663049445632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 329us (616us total) trans 4294975550 rc 0/0 00000100:00100000:0.0:1787826400.496935:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22654 00000100:00100000:0.0:1787826400.496954:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049446144 00000100:00100000:0.0:1787826400.496957:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049446144 00000100:00100000:0.0:1787826400.496977:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049445504 00000100:00100000:0.0:1787826400.496980:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049445504 00000100:00100000:0.0:1787826400.496995:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049446016 00000100:00100000:0.0:1787826400.496998:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049446016 00000100:00100000:0.0:1787826400.497016:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22655 00000100:00100000:0.0:1787826400.497032:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3620:x1874663049446144:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1787826400.497045:0:43897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:936 count 1 00002000:00010000:0.0:1787826400.497062:0:43897:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826400.497067:0:43897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.497739:0:43897:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a8:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:0.0:1787826400.497744:0:43897:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826400.497750:0:43897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.497762:0:43897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.497772:0:43897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.497780:0:43897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.497802:0:43897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1787826400.497916:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3620:x1874663049446144:12345-0@lo:6:osp-syn-1-1.0 Request processed in 881us (1507us total) trans 4294975551 rc 0/0 00000100:00100000:0.0:1787826400.497925:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22655 00000100:00100000:0.0:1787826400.497946:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22656 00000100:00100000:0.0:1787826400.497954:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3620:x1874663049445504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1787826400.497975:0:43897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:934 count 1 00002000:00010000:0.0:1787826400.497995:0:43897:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826400.498001:0:43897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.498010:0:43897:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a6:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:0.0:1787826400.498013:0:43897:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826400.498029:0:43897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.498039:0:43897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.498047:0:43897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.498059:0:43897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.498067:0:43897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1787826400.499911:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3620:x1874663049445504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1953us (3444us total) trans 4294975552 rc 0/0 00000100:00100000:0.0:1787826400.499922:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22656 00000100:00100000:0.0:1787826400.499954:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22657 00000100:00100000:0.0:1787826400.499965:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3620:x1874663049446016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1787826400.499989:0:43897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:938 count 1 00002000:00010000:0.0:1787826400.500025:0:43897:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826400.500034:0:43897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.500047:0:43897:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3aa:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:0.0:1787826400.500052:0:43897:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826400.500058:0:43897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.500081:0:43897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.500091:0:43897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.500104:0:43897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.500116:0:43897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1787826400.500195:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3620:x1874663049446016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 232us (3695us total) trans 4294975553 rc 0/0 00000100:00100000:0.0:1787826400.500201:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22657 00000100:00100000:0.0:1787826400.500266:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975549 gen 2 00000004:00080000:0.0:1787826400.500272:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481b75500, transno 4294975549 00000100:00100000:0.0:1787826400.500289:0:3620:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8eb481afc700 x1874663049445504/t4294975552(4294975552) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787826416 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787826400.500300:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481afc700/2, rc 0, transno 4294975552 00000100:00100000:0.0:1787826400.500305:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049445504:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1787826400.500319:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481aff480/2, rc 0, transno 4294975553 00000100:00100000:0.0:1787826400.500322:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049446016:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1787826400.500365:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481aff800/2, rc 0, transno 4294975550 00000100:00100000:0.0:1787826400.500369:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049445632:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1787826400.500377:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481afca80/2, rc 0, transno 4294975551 00000100:00100000:0.0:1787826400.500380:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049446144:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1787826400.502498:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb472975f80/2, rc 0, transno 38654705684 00000100:00100000:3.0:1787826400.502514:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049444608:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1787826400.502526:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb348e5c700/2, rc 0, transno 38654705685 00000100:00100000:3.0:1787826400.502529:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049445120:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1787826400.502539:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb472977480/2, rc 0, transno 38654705682 00000100:00100000:3.0:1787826400.502542:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049444480:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1787826400.502551:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb348e5c000/2, rc 0, transno 38654705683 00000100:00100000:3.0:1787826400.502555:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049444992:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1787826400.503212:0:179222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+14:3618:x1874663049444736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10836us (13500us total) trans 38654705689 rc 0/0 00000100:00100000:1.0:1787826400.503224:0:179222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22653 00000100:00080000:1.0:1787826400.503256:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826400.503274:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787826400.503282:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503295:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.503300:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503311:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503361:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503369:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc8e118/0x878a5eea00cef077 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503391:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826400.503394:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503401:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.503403:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503410:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503419:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503426:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001025d6ff/0x878a5eea00cef07e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503438:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826400.503442:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503448:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.503451:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503458:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503468:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503475:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede97902/0x878a5eea00cef085 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503488:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826400.503492:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503499:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.503502:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503509:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503517:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503523:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004012705e/0x878a5eea00cef08c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.503535:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826400.503537:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826400.503538:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826400.503559:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049445248:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826400.503613:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826400.503659:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049445760:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826400.503683:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826400.503705:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049446272:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826400.503724:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826400.503746:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787826400.503753:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049445376:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826400.503776:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826400.503793:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049445888:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1787826400.503813:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826400.503842:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049445248 00000100:00100000:1.0:1787826400.503849:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049445248 00000100:00100000:1.0:1787826400.503886:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049445760 00000100:00100000:1.0:1787826400.503889:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049445760 00000100:00100000:1.0:1787826400.503908:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049446272 00000100:00100000:1.0:1787826400.503911:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049446272 00000100:00100000:1.0:1787826400.503926:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049445376 00000100:00100000:1.0:1787826400.503929:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049445376 00000100:00100000:1.0:1787826400.503941:0:43904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049445888 00000100:00100000:1.0:1787826400.503944:0:43904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049445888 00000100:00100000:1.0:1787826400.503964:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22658 00000100:00100000:1.0:1787826400.503973:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049445248:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826400.504001:0:43904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:933 count 1 00002000:00010000:1.0:1787826400.504044:0:43904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826400.504051:0:43904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.504066:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a5:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:1.0:1787826400.504720:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826400.504731:0:43904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.504746:0:43904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.504757:0:43904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.504764:0:43904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.504784:0:43904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826400.504945:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+14:3617:x1874663049445248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 972us (1331us total) trans 4294975554 rc 0/0 00000100:00100000:1.0:1787826400.504953:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22658 00000100:00100000:1.0:1787826400.504977:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22659 00000100:00100000:1.0:1787826400.504987:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049445760:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826400.505005:0:43904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:939 count 1 00002000:00010000:1.0:1787826400.505037:0:43904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826400.505043:0:43904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505053:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ab:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:1.0:1787826400.505056:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826400.505060:0:43904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505144:0:43904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505155:0:43904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505162:0:43904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505172:0:43904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787826400.505238:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+14:3617:x1874663049445760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 252us (1554us total) trans 4294975555 rc 0/0 00000100:00100000:1.0:1787826400.505245:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22659 00000100:00100000:1.0:1787826400.505259:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22660 00000100:00100000:1.0:1787826400.505266:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049446272:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826400.505282:0:43904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:935 count 1 00002000:00010000:1.0:1787826400.505297:0:43904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826400.505302:0:43904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505310:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a7:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:1.0:1787826400.505313:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826400.505317:0:43904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505345:0:43904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505355:0:43904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505362:0:43904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505371:0:43904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1787826400.505436:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+14:3617:x1874663049446272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 170us (1710us total) trans 4294975556 rc 0/0 00000100:00100000:1.0:1787826400.505442:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22660 00000100:00100000:1.0:1787826400.505456:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22661 00000100:00100000:1.0:1787826400.505462:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049445376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826400.505475:0:43904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:937 count 1 00002000:00010000:1.0:1787826400.505490:0:43904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826400.505494:0:43904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505502:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a9:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:1.0:1787826400.505505:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826400.505509:0:43904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505518:0:43904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505525:0:43904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505531:0:43904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.505540:0:43904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1787826400.505603:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+14:3617:x1874663049445376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 141us (1825us total) trans 4294975557 rc 0/0 00000100:00100000:1.0:1787826400.505609:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22661 00000100:00100000:1.0:1787826400.505622:0:43904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22662 00000100:00100000:1.0:1787826400.505629:0:43904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+13:3617:x1874663049445888:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1787826400.506181:0:43904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:931 count 1 00002000:00010000:1.0:1787826400.506201:0:43904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826400.506208:0:43904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506219:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a3:0x0].0x0 since=8467s v=(0 0) 00010000:00010000:1.0:1787826400.506222:0:43904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826400.506226:0:43904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506235:0:43904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506243:0:43904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506251:0:43904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506260:0:43904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1787826400.506372:0:43904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+14:3617:x1874663049445888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 742us (2557us total) trans 4294975558 rc 0/0 00000100:00100000:1.0:1787826400.506379:0:43904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22662 00010000:00010000:1.0:1787826400.506413:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787826400.506419:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506427:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.506431:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506445:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506460:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506468:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e8963f5/0x878a5eea00cef093 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506488:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787826400.506492:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506498:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.506501:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506509:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506519:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506527:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba415220/0x878a5eea00cef09a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506546:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787826400.506550:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506557:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357800 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.506560:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506567:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506577:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506583:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074248535/0x878a5eea00cef0a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506594:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826400.506597:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506603:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:1.0:1787826400.506606:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506619:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506629:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.506636:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000830cd7b4/0x878a5eea00cef0a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.507769:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826400.507779:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.507790:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826400.507794:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.507802:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.507817:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.507824:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc71c8f/0x878a5eea00cef0af lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.507842:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826400.507844:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826400.507846:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787826400.508050:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb472974e00/2, rc 0, transno 38654705687 00000100:00100000:2.0:1787826400.508060:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049444224:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1787826400.508126:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787826400.508150:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb348e5ca80/2, rc 0, transno 38654705689 00000100:00100000:2.0:1787826400.508276:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049444736:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1787826400.508292:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb472976300/2, rc 0, transno 38654705688 00000100:00100000:2.0:1787826400.508296:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049444352:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1787826400.508305:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb348e5d500/2, rc 0, transno 38654705686 00000100:00100000:2.0:1787826400.508308:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049444864:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1787826400.508408:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826400.508410:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826400.508412:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826400.508438:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481affb80/2, rc 0, transno 4294975557 00000100:00100000:1.0:1787826400.508444:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049445376:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1787826400.508455:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481afd500/2, rc 0, transno 4294975558 00000100:00100000:1.0:1787826400.508458:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049445888:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1787826400.508467:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481afed80/2, rc 0, transno 4294975554 00000100:00100000:1.0:1787826400.508470:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049445248:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1787826400.508478:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481afc380/2, rc 0, transno 4294975555 00000100:00100000:1.0:1787826400.508481:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049445760:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1787826400.508488:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8eb481afea00/2, rc 0, transno 4294975556 00000100:00100000:1.0:1787826400.508491:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049446272:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1787826400.508511:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787826400.515058:0:194610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705689 is committed 00000001:00080000:1.0:1787826400.515877:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975558 is committed 00000100:00100000:1.0:1787826400.602358:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826400.602436:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043064192 00000100:00100000:3.0:1787826400.602446:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043064192 00000100:00100000:3.0:1787826400.602507:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1270 00000100:00100000:3.0:1787826400.602518:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163676:x1874663043064192:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:3.0:1787826400.602557:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445548032 avail 1299308544 00010000:00000080:3.0:1787826400.602579:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a212300 x1874663043064192/t0(0) o41->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:1/0 lens 224/368 e 0 to 0 dl 1787826411 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826400.602639:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163676:x1874663043064192:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826400.602647:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1270 00000100:00100000:3.0:1787826400.608546:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826400.608625:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043064320 00000100:00100000:0.0:1787826400.608635:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043064320 00000100:00100000:0.0:1787826400.608845:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1271 00000100:00100000:0.0:1787826400.608855:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163676:x1874663043064320:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1787826400.608892:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00000100:00100000:0.0:1787826400.608958:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163676:x1874663043064320:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 104us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826400.608966:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1271 00000100:00100000:3.0:1787826400.616204:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826400.616364:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043064448 00000100:00100000:2.0:1787826400.616374:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043064448 00000100:00100000:2.0:1787826400.616438:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5930 00000100:00100000:2.0:1787826400.616449:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163676:x1874663043064448:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:2.0:1787826400.616479:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826400.616542:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163676:x1874663043064448:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826400.616550:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5930 00000100:00080000:1.0:1787826400.616914:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826400.621516:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826400.621590:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043064576 00000100:00100000:3.0:1787826400.621600:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043064576 00000100:00080000:0.0:1787826400.621662:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826400.621687:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5931 00000100:00100000:3.0:1787826400.621698:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163676:x1874663043064576:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:3.0:1787826400.621729:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826400.621797:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163676:x1874663043064576:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 101us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826400.621805:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5931 00000100:00100000:2.0:1787826400.699838:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826400.699953:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043064832 00000100:00100000:3.0:1787826400.699963:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043064832 00000100:00100000:3.0:1787826400.700031:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1272 00000100:00100000:3.0:1787826400.700042:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163683:x1874663043064832:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00010000:3.0:1787826400.700099:0:187906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826400.700253:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00ceefb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f481 expref: 8 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.700271:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826400.700276:0:187906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826400.700604:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.700617:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.700627:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.700652:0:187906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.700661:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.700667:0:187906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701058:0:187906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701067:0:187906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701074:0:187906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701086:0:187906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701092:0:187906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826400.701097:0:187906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701182:0:187906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701195:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826400.701198:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826400.701202:0:187906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701209:0:187906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826400.701223:0:187906:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8259f0b reply state 000000001e5bbe8a transno 352187318306 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701234:0:187906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.701241:0:187906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb453a77800) 00010000:00010000:0.0:1787826400.701244:0:187906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826400.701247:0:187906:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1787826400.701272:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e868a80 x1874663043064832/t352187318306(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:1/0 lens 528/448 e 0 to 0 dl 1787826411 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826400.701380:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163683:x1874663043064832:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 1339us (1550us total) trans 352187318306 rc 0/0 00000100:00100000:0.0:1787826400.701389:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1272 00000100:00100000:2.0:1787826400.729792:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826400.729889:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043064960 00000100:00100000:1.0:1787826400.729899:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043064960 00000100:00100000:1.0:1787826400.729962:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1273 00000100:00100000:1.0:1787826400.729972:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163686:x1874663043064960:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:1.0:1787826400.730007:0:188992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826400.730037:0:188992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cef0c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f4ab expref: -99 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.730112:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cef0cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.730126:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cef0cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.730136:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cef0cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826400.730181:0:188992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787826400.730185:0:188992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:1.0:1787826400.730204:0:188992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cef0cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.730229:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356000/0x878a5eea00cef0c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4ab expref: 11 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.730259:0:188992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cef0cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4ab expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826400.730273:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:1.0:1787826400.730276:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826400.730280:0:188992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357600, rc 0) 00010000:00000080:1.0:1787826400.730287:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e86bb80 x1874663043064960/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:1/0 lens 576/688 e 0 to 0 dl 1787826411 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787826400.730395:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163686:x1874663043064960:12345-192.168.203.47@tcp:101:rm.0 Request processed in 423us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826400.730403:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1273 00000100:00100000:1.0:1787826400.735486:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826400.735717:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043065088 00000100:00100000:3.0:1787826400.735728:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043065088 00000100:00100000:3.0:1787826400.735790:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1274 00000100:00100000:3.0:1787826400.735801:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163686:x1874663043065088:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826400.735824:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826400.735843:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cef0d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f4b2 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.735900:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.735913:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.735924:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.735936:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.735943:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.735950:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736053:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef0e7 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736061:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef0e7 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736069:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef0e7 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826400.736183:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x8:0x0]: returning size 0 00000004:00200000:3.0:1787826400.736188:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1787826400.736208:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef0e7 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736220:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef0e7 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736229:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736236:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736243:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736249:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826400.736253:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736260:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736271:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826400.736274:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826400.736279:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736285:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef0d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736297:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736308:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736314:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736319:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed600 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826400.736322:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736362:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736369:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb453a77800) 00010000:00010000:3.0:1787826400.736372:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826400.736375:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736381:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef0e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736407:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cef0d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4b2 expref: 12 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736419:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef0e7 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4b2 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.736427:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x8:0x0].0x0 (ffff8eb348b07200) 00010000:00010000:3.0:1787826400.736430:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826400.736433:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed800, rc 0) 00010000:00000080:3.0:1787826400.736439:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a213100 x1874663043065088/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:1/0 lens 600/584 e 0 to 0 dl 1787826411 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826400.736609:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163686:x1874663043065088:12345-192.168.203.47@tcp:101:rm.0 Request processed in 808us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826400.736617:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1274 00000100:00100000:2.0:1787826400.743426:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826400.743861:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043065344 00000100:00100000:0.0:1787826400.743872:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043065344 00000100:00100000:0.0:1787826400.743932:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1275 00000100:00100000:0.0:1787826400.743943:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163686:x1874663043065344:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1787826400.743999:0:187905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787826400.744048:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef0e7 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4b2 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744068:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x8:0x0].0x0 (ffff8eb348b07200) 00010000:00010000:0.0:1787826400.744086:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357600/0x878a5eea00cef0cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4ab expref: 10 pid: 188992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744096:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826400.744099:0:187905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826400.744123:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744134:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744143:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744152:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744159:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744166:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744253:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744261:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744268:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744487:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744496:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744504:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744511:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744517:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744524:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744556:0:187905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826400.744574:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744581:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744587:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.744594:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826400.744598:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.744666:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826400.744674:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.744682:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568600 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826400.744685:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.744693:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.744703:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x8:0x0].0x0 (ffff8eb453a77a00) 00010000:00010000:3.0:1787826400.744706:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826400.744709:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 1/0,0 mode: --/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.744715:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568600/0x878a5eea00cef103 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826400.744729:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826400.744731:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826400.744732:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826400.745880:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745897:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x8:0x0].0x0 (ffff8eb453a77a00) 00010000:00010000:0.0:1787826400.745899:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787826400.745903:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745909:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569e00/0x878a5eea00cef0fc lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745938:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745944:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745951:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745957:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745962:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826400.745965:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745971:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745978:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826400.745980:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826400.745983:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.745988:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569000/0x878a5eea00cef0ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826400.745998:0:187905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e032b253 reply state 00000000f47c1708 transno 352187318307 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.746009:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826400.746027:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb453a77800) 00010000:00010000:0.0:1787826400.746030:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826400.746033:0:187905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1787826400.746062:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e868700 x1874663043065344/t352187318307(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:1/0 lens 512/456 e 0 to 0 dl 1787826411 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826400.746237:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163686:x1874663043065344:12345-192.168.203.47@tcp:36:rm.0 Request processed in 2290us (2815us total) trans 352187318307 rc 0/0 00000100:00100000:1.0:1787826400.746247:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1275 00000100:00100000:3.0:1787826401.108631:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049446528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.108696:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826401.108730:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049447040:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.108755:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826401.108773:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049447552:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.108792:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826401.108813:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787826401.108818:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049446656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.108839:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826401.108855:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049447168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.108877:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826401.108894:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb4607f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049447680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.108915:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826401.108950:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049446528 00000100:00100000:3.0:1787826401.108957:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049446528 00000100:00100000:3.0:1787826401.109010:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049446656 00000100:00100000:3.0:1787826401.109023:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049446656 00000100:00100000:3.0:1787826401.109040:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049447680 00000100:00100000:3.0:1787826401.109042:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049447680 00000100:00100000:3.0:1787826401.109061:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1787826401.109070:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049446528:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826401.109091:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4607f5c00 x1874663049446528/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1787826412 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826401.109131:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049446528:12345-0@lo:400:kworker.0 Request processed in 63us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.109138:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1787826401.109156:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1787826401.109163:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049446656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.109193:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049446656:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.109199:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1787826401.109210:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1787826401.109232:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049447680:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826401.109243:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb477dd6a00 x1874663049447680/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1787826412 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826401.109268:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049447680:12345-0@lo:400:kworker.0 Request processed in 38us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.109274:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1787826401.109292:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049447040 00000100:00100000:3.0:1787826401.109295:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049447040 00000100:00100000:3.0:1787826401.109312:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049447552 00000100:00100000:3.0:1787826401.109314:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049447552 00000100:00100000:3.0:1787826401.109349:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787826401.109357:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049447040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.109390:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049447040:12345-0@lo:400:kworker.0 Request processed in 34us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.109395:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787826401.109407:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826401.109413:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049447552:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826401.109425:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb4607f4e00 x1874663049447552/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1787826412 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826401.109449:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049447552:12345-0@lo:400:kworker.0 Request processed in 37us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.109455:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787826401.109476:0:43896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049447168 00000100:00100000:3.0:1787826401.109480:0:43896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049447168 00000100:00100000:3.0:1787826401.109511:0:43896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7195 00000100:00100000:3.0:1787826401.109517:0:43896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049447168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.109548:0:43896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3619:x1874663049447168:12345-0@lo:400:kworker.0 Request processed in 32us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.109554:0:43896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7195 00000100:00080000:3.0:1787826401.109573:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826401.109577:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826401.109579:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826401.109628:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826401.109655:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049446656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.109665:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049447168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.109674:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb4607f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049447680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.109682:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049446528:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.109691:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049447040:0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.109700:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049447552:0@lo:400:kworker.0 00000100:00100000:2.0:1787826401.110321:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049446400:0@lo:400:kworker.0 00000100:00100000:2.0:1787826401.110388:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826401.110430:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049446912:0@lo:400:kworker.0 00000100:00100000:2.0:1787826401.110455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826401.110470:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049447424:0@lo:400:kworker.0 00000100:00100000:2.0:1787826401.110601:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826401.110622:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787826401.110641:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049446784:0@lo:400:kworker.0 00000100:00100000:2.0:1787826401.110665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826401.110680:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049447296:0@lo:400:kworker.0 00000100:00100000:2.0:1787826401.110705:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826401.110739:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049447296 00000100:00100000:2.0:1787826401.110744:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049447296 00000100:00100000:2.0:1787826401.110786:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7196 00000100:00100000:2.0:1787826401.110794:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049447296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826401.110837:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049447296:12345-0@lo:400:kworker.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826401.110842:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7196 00000100:00100000:2.0:1787826401.110975:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049447296:0@lo:400:kworker.0 00000100:00100000:1.0:1787826401.112827:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049447808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826401.112880:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826401.113626:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826401.113712:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049446400 00000100:00100000:3.0:1787826401.113720:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049446400 00000100:00100000:3.0:1787826401.113773:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787826401.113783:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049446400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.113837:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47f7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049446400:12345-0@lo:400:kworker.0 Request processed in 56us (3448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.113843:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787826401.113880:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049446912 00000100:00100000:3.0:1787826401.113884:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049446912 00000100:00100000:3.0:1787826401.113914:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049447424 00000100:00100000:3.0:1787826401.113918:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049447424 00000100:00100000:3.0:1787826401.113931:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049446784 00000100:00100000:3.0:1787826401.113933:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049446784 00000100:00100000:3.0:1787826401.113949:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1787826401.113955:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049446912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826401.113990:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049446912:12345-0@lo:400:kworker.0 Request processed in 35us (3534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.113996:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1787826401.114008:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1787826401.114025:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049447424:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826401.114039:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e869500 x1874663049447424/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1787826412 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826401.114067:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874663049447424:12345-0@lo:400:kworker.0 Request processed in 53us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.114073:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1787826401.114085:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1787826401.114092:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049446784:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826401.114103:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e869c00 x1874663049446784/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1787826412 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826401.114128:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874663049446784:12345-0@lo:400:kworker.0 Request processed in 37us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.114132:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00080000:3.0:1787826401.114154:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826401.114158:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826401.114160:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826401.114315:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049447808 00000100:00100000:3.0:1787826401.114320:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049447808 00000100:00100000:3.0:1787826401.114368:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787826401.114375:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049447808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826401.114394:0:187910:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00000100:00100000:0.0:1787826401.116849:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1874663049446784:0@lo:400:kworker.0 00000100:00100000:0.0:1787826401.116864:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049446400:0@lo:400:kworker.0 00000100:00100000:0.0:1787826401.116876:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049446912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826401.116886:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874663049447424:0@lo:400:kworker.0 00000100:00100000:1.0:1787826401.120805:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049447936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826401.120879:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826401.121011:0:187909:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787826401.121032:0:187909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787826401.121141:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049447936 00000100:00100000:0.0:1787826401.121149:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049447936 00000100:00100000:0.0:1787826401.121281:0:199731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787826401.121290:0:199731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3617:x1874663049447936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826401.121318:0:199731:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445548032 avail 1299308544 00010000:00000080:0.0:1787826401.121351:0:199731:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a213b80 x1874663049447936/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:2/0 lens 224/368 e 0 to 0 dl 1787826412 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826401.121393:0:199731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3617:x1874663049447936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826401.121414:0:199731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787826401.123737:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049447808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9352us (10847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.123752:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787826401.125696:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049447808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826401.125735:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049447936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826401.620617:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826401.620642:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049448064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826401.620717:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826401.620799:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049448064 00000100:00100000:3.0:1787826401.620807:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049448064 00000100:00100000:3.0:1787826401.620869:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:3.0:1787826401.620880:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049448064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826401.620902:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826401.620950:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049448064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826401.620956:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:3.0:1787826401.620993:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 2 00000004:00080000:3.0:1787826401.620998:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb472975c00, transno 38654705681 00000004:00080000:3.0:1787826401.621006:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb472977480, transno 38654705682 00000004:00080000:3.0:1787826401.621019:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb348e5c000, transno 38654705683 00000004:00080000:3.0:1787826401.621023:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb472975f80, transno 38654705684 00000004:00080000:3.0:1787826401.621025:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb348e5c700, transno 38654705685 00000004:00080000:3.0:1787826401.621027:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb348e5d500, transno 38654705686 00000004:00080000:3.0:1787826401.621030:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb472974e00, transno 38654705687 00000004:00080000:3.0:1787826401.621032:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb472976300, transno 38654705688 00000004:00080000:3.0:1787826401.621034:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb348e5ca80, transno 38654705689 00000100:00100000:3.0:1787826401.621045:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049448064:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1787826401.621181:0:198813:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:3.0:1787826401.621465:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049448192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826401.621500:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826401.621565:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049448192 00000100:00100000:1.0:1787826401.621571:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049448192 00000100:00100000:1.0:1787826401.621604:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5933 00000100:00100000:1.0:1787826401.621612:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049448192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826401.621625:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826401.621666:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049448192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826401.621672:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5933 00000100:00100000:3.0:1787826401.621944:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975558 gen 2 00000004:00080000:3.0:1787826401.621949:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481aff800, transno 4294975550 00000004:00080000:3.0:1787826401.621964:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481afca80, transno 4294975551 00000004:00080000:3.0:1787826401.621967:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481afc700, transno 4294975552 00000004:00080000:3.0:1787826401.621970:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481aff480, transno 4294975553 00000004:00080000:3.0:1787826401.621973:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481afed80, transno 4294975554 00000004:00080000:3.0:1787826401.621975:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481afc380, transno 4294975555 00000004:00080000:3.0:1787826401.621977:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481afea00, transno 4294975556 00000004:00080000:3.0:1787826401.621980:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481affb80, transno 4294975557 00000004:00080000:3.0:1787826401.621982:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8eb481afd500, transno 4294975558 00000100:00100000:3.0:1787826401.621991:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049448192:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1787826401.622166:0:198815:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 9 done 00010000:00010000:1.0:1787826402.132579:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826403.066603:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826403.066650:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826403.066675:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826403.066696:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826403.066730:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826403.066759:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043065728 00000100:00100000:3.0:1787826403.066768:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043065728 00000100:00100000:3.0:1787826403.066830:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043065600 00000100:00100000:1.0:1787826403.066831:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043065472 00000100:00100000:3.0:1787826403.066835:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043065600 00000100:00100000:1.0:1787826403.066838:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043065472 00000100:00100000:3.0:1787826403.066870:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 463 00000100:00100000:3.0:1787826403.066896:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2389:x1874663043065728:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826403.066981:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2389:x1874663043065728:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.066989:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 463 00000100:00100000:1.0:1787826403.067016:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 138 00000100:00100000:3.0:1787826403.067020:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 464 00000100:00100000:1.0:1787826403.067032:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663043065472:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826403.067034:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2389:x1874663043065600:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:3.0:1787826403.067062:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb477dd5880 x1874663043065600/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:4/0 lens 224/224 e 0 to 0 dl 1787826414 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826403.067074:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2389:x1874663043065472:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 44us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.067083:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 138 00000100:00100000:3.0:1787826403.067097:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2389:x1874663043065600:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 66us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.067105:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 464 00000100:00100000:3.0:1787826403.067131:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043065984 00000100:00100000:3.0:1787826403.067135:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043065984 00000100:00100000:3.0:1787826403.067168:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043065856 00000100:00100000:3.0:1787826403.067171:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043065856 00000100:00100000:3.0:1787826403.067194:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7197 00000100:00100000:3.0:1787826403.067201:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043065984:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826403.067228:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043065984:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.067234:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7197 00000100:00100000:3.0:1787826403.067245:0:43905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7198 00000100:00100000:3.0:1787826403.067252:0:43905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043065856:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826403.067272:0:43905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2389:x1874663043065856:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 22us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.067278:0:43905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7198 00000100:00080000:3.0:1787826403.067300:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826403.067304:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826403.067307:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826403.067309:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787826403.161485:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826403.671450:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049448320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826403.671534:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826403.671577:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826403.671584:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049448448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826403.671606:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826403.671651:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049448320 00000100:00100000:1.0:1787826403.671657:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049448320 00000100:00100000:1.0:1787826403.671709:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049448448 00000100:00100000:1.0:1787826403.671712:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049448448 00000100:00100000:1.0:1787826403.671736:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5934 00000100:00100000:1.0:1787826403.671745:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049448320:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826403.671768:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5935 00002000:00000024:1.0:1787826403.671774:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826403.671778:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049448448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826403.671793:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826403.671815:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049448320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.671819:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049448448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.671822:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5934 00000100:00100000:3.0:1787826403.671825:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5935 00000100:00080000:1.0:1787826403.671842:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826403.671846:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826403.671881:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049448448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826403.671894:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049448320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787826404.180660:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826405.208079:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826406.228665:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049448576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.228766:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.228824:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049449088:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.228854:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.228876:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049449600:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.228897:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.228928:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049450112:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.228948:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.228976:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787826406.228993:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049448704:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229018:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.229037:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049449216:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229065:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.229089:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049449728:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229111:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.229139:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049448832:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229165:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.229176:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049449344:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229199:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.229218:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049449856:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229238:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.229257:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787826406.229262:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049448960:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229285:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.229296:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049449472:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229315:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826406.229359:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049449984:0@lo:400:kworker.0 00000100:00100000:2.0:1787826406.229383:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826406.229744:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049448576 00000100:00100000:3.0:1787826406.229755:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049448576 00000100:00100000:1.0:1787826406.229782:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826406.229793:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049450368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826406.229827:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826406.229860:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826406.229868:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049450240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826406.229889:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787826406.229895:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826406.229906:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049448576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.229976:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049448576:12345-0@lo:400:kworker.0 Request processed in 76us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.229999:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787826406.230057:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049449088 00000100:00100000:3.0:1787826406.230062:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049449088 00000100:00100000:3.0:1787826406.230098:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049449600 00000100:00100000:3.0:1787826406.230101:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049449600 00000100:00100000:3.0:1787826406.230113:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049450112 00000100:00100000:3.0:1787826406.230116:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049450112 00000100:00100000:3.0:1787826406.230126:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049448704 00000100:00100000:3.0:1787826406.230129:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049448704 00000100:00100000:3.0:1787826406.230140:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049448832 00000100:00100000:3.0:1787826406.230143:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049448832 00000100:00100000:3.0:1787826406.230157:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049448960 00000100:00100000:3.0:1787826406.230159:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049448960 00000100:00100000:3.0:1787826406.230175:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1787826406.230182:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049449088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.230220:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049449088:12345-0@lo:400:kworker.0 Request processed in 38us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230230:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1787826406.230244:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1787826406.230251:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049449600:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826406.230266:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348e5c000 x1874663049449600/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1787826417 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826406.230295:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049449600:12345-0@lo:400:kworker.0 Request processed in 45us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230301:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1787826406.230313:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1787826406.230319:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049450112:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826406.230351:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348e5c700 x1874663049450112/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1787826417 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826406.230390:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874663049450112:12345-0@lo:400:kworker.0 Request processed in 71us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230397:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1787826406.230408:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1787826406.230415:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049448704:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826406.230427:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348e5d500 x1874663049448704/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1787826417 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826406.230452:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874663049448704:12345-0@lo:400:kworker.0 Request processed in 38us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230459:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1787826406.230471:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1787826406.230477:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049448832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.230519:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049448832:12345-0@lo:400:kworker.0 Request processed in 42us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230526:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1787826406.230538:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1787826406.230544:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049448960:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826406.230568:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cd5500 x1874663049448960/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1787826417 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826406.230594:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049448960:12345-0@lo:400:kworker.0 Request processed in 51us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230600:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1787826406.230633:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049449344 00000100:00100000:3.0:1787826406.230638:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049449344 00000100:00100000:3.0:1787826406.230667:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049449856 00000100:00100000:3.0:1787826406.230670:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049449856 00000100:00100000:3.0:1787826406.230687:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049449472 00000100:00100000:3.0:1787826406.230690:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049449472 00000100:00100000:3.0:1787826406.230707:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049449984 00000100:00100000:3.0:1787826406.230710:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049449984 00000100:00100000:3.0:1787826406.230730:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7199 00000100:00100000:3.0:1787826406.230737:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049449344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.230769:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049449344:12345-0@lo:400:kworker.0 Request processed in 33us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230776:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7199 00000100:00100000:3.0:1787826406.230786:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7200 00000100:00100000:3.0:1787826406.230793:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049449856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.230818:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049449856:12345-0@lo:400:kworker.0 Request processed in 26us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230828:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7200 00000100:00100000:3.0:1787826406.230837:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7201 00000100:00100000:3.0:1787826406.230843:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049449472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.230868:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049449472:12345-0@lo:400:kworker.0 Request processed in 26us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230874:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7201 00000100:00100000:3.0:1787826406.230883:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7202 00000100:00100000:3.0:1787826406.230890:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049449984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.230929:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049449984:12345-0@lo:400:kworker.0 Request processed in 40us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.230935:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7202 00000100:00100000:3.0:1787826406.230994:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049449216 00000100:00100000:3.0:1787826406.231000:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049449216 00000100:00100000:3.0:1787826406.231021:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049449728 00000100:00100000:3.0:1787826406.231024:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049449728 00000100:00100000:3.0:1787826406.231034:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049450368 00000100:00100000:3.0:1787826406.231038:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049450368 00000100:00100000:3.0:1787826406.231046:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049450240 00000100:00100000:3.0:1787826406.231048:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049450240 00000100:00100000:3.0:1787826406.231058:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787826406.231064:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049449216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231102:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3619:x1874663049449216:12345-0@lo:400:kworker.0 Request processed in 39us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.231109:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787826406.231119:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787826406.231126:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049449728:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826406.231141:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348e5f100 x1874663049449728/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1787826417 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826406.231166:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3619:x1874663049449728:12345-0@lo:400:kworker.0 Request processed in 41us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.231171:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787826406.231181:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787826406.231187:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049450368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826406.231216:0:187910:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00000100:00100000:3.0:1787826406.231257:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049450368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.231264:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787826406.231275:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787826406.231281:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049450240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826406.231298:0:187910:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445548032 avail 1299308544 00010000:00000080:3.0:1787826406.231308:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a212680 x1874663049450240/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:7/0 lens 224/368 e 0 to 0 dl 1787826417 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826406.231362:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049450240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.231381:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1787826406.231407:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826406.231412:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826406.231415:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826406.231418:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826406.231455:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049448960:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231470:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049449472:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231482:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049449984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231494:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049448832:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231505:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049449344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231516:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049449856:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231583:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049450368:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826406.231643:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826406.231665:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049450240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826406.231677:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1874663049448704:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231686:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049449216:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231694:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049449728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231705:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049448576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231718:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049449088:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.231729:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049449600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.235869:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874663049450112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826406.740758:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826406.740807:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049450496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826406.740909:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826406.740991:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049450496 00000100:00100000:3.0:1787826406.741003:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049450496 00000100:00100000:3.0:1787826406.741078:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5936 00000100:00100000:3.0:1787826406.741093:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049450496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826406.741141:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826406.741202:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049450496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826406.741212:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5936 00000100:00100000:3.0:1787826406.741289:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049450496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826406.741753:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826406.741778:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049450624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826406.741825:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826406.741965:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049450624 00000100:00100000:1.0:1787826406.741972:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049450624 00000100:00100000:1.0:1787826406.742028:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5937 00000100:00100000:1.0:1787826406.742038:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049450624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826406.742066:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826406.742116:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049450624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826406.742125:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5937 00000100:00100000:0.0:1787826406.742213:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049450624:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1787826406.988896:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318307 is committed 00010000:00010000:1.0:1787826406.991379:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991401:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991411:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991418:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826406.991424:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991433:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991455:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb453a77800) 00010000:00010000:1.0:1787826406.991459:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.991464:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991470:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568000/0x878a5eea00cef0bd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991496:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991502:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991507:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991512:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826406.991515:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991525:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991533:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb453a77800) 00010000:00010000:1.0:1787826406.991535:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826406.991538:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826406.991544:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569400/0x878a5eea00cef0f5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826407.262169:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826408.156882:0:200057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1787826408.191585:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826408.191667:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826408.191711:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826408.191735:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826408.191927:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043066496 00000100:00100000:2.0:1787826408.191941:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043066496 00000100:00100000:2.0:1787826408.192061:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7203 00000100:00100000:2.0:1787826408.192077:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043066496:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826408.192179:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043066496:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 106us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.192191:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7203 00000100:00080000:2.0:1787826408.192217:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826408.192895:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826408.192978:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043066240 00000100:00100000:3.0:1787826408.192985:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043066240 00000100:00100000:3.0:1787826408.193100:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043066368 00000100:00100000:3.0:1787826408.193104:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043066368 00000100:00100000:3.0:1787826408.193133:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 471 00000100:00100000:3.0:1787826408.193142:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043066240:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:3.0:1787826408.193171:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb477dd7480 x1874663043066240/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:9/0 lens 224/224 e 0 to 0 dl 1787826419 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826408.193221:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043066240:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 81us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.193228:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 471 00000100:00100000:3.0:1787826408.193247:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 472 00000100:00100000:3.0:1787826408.193254:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043066368:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826408.193281:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043066368:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.193288:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 472 00000100:00100000:1.0:1787826408.193667:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043066112 00000100:00100000:1.0:1787826408.193674:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043066112 00000100:00100000:1.0:1787826408.193716:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 140 00000100:00100000:1.0:1787826408.193725:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043066112:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826408.193781:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043066112:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 56us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.193789:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 140 00000100:00100000:1.0:1787826408.193825:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043066624 00000100:00100000:1.0:1787826408.193830:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043066624 00000100:00100000:1.0:1787826408.193861:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7204 00000100:00100000:1.0:1787826408.193868:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043066624:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826408.193894:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043066624:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.193900:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7204 00000100:00080000:2.0:1787826408.194196:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826408.194203:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826408.194206:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787826408.277420:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826408.790178:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049450752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826408.790285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826408.790475:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049450752 00000100:00100000:0.0:1787826408.790487:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049450752 00000100:00100000:0.0:1787826408.790585:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5938 00000100:00100000:0.0:1787826408.790598:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049450752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826408.790639:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826408.790698:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1874663049450752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.790708:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5938 00000100:00080000:2.0:1787826408.790833:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826408.790883:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049450752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826408.800096:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826408.800301:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049450880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826408.800564:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826408.800702:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049450880 00000100:00100000:1.0:1787826408.800715:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049450880 00000100:00100000:1.0:1787826408.800794:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5939 00000100:00100000:1.0:1787826408.800806:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049450880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826408.800858:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826408.800917:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049450880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.800925:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5939 00000100:00080000:0.0:1787826408.801320:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826408.803253:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049450880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787826409.304538:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826409.391736:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826409.391848:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043066752 00000100:00100000:0.0:1787826409.391865:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043066752 00000100:00100000:0.0:1787826409.391965:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1276 00000100:00100000:0.0:1787826409.391980:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163768:x1874663043066752:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1787826409.392009:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826409.392039:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cef10a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f4b9 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826409.392135:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cef111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826409.392151:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cef111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826409.392164:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cef111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826409.392233:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787826409.392238:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:0.0:1787826409.392585:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cef111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826409.392620:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569a00/0x878a5eea00cef10a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4b9 expref: 9 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826409.392644:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cef111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4b9 expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826409.392660:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:0.0:1787826409.392664:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826409.392670:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569c00, rc 0) 00010000:00000080:0.0:1787826409.392681:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb477dd5180 x1874663043066752/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:49/0 lens 576/688 e 0 to 0 dl 1787826459 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787826409.392775:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163768:x1874663043066752:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 797us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826409.392784:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1276 00000100:00100000:2.0:1787826409.400438:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826409.400970:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043066880 00000100:00100000:3.0:1787826409.400981:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043066880 00000100:00100000:3.0:1787826409.401050:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1277 00000100:00100000:3.0:1787826409.401063:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163768:x1874663043066880:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:3.0:1787826409.401104:0:188992:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445548032 avail 1299308544 00010000:00000080:3.0:1787826409.401127:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb448cd4e00 x1874663043066880/t0(0) o41->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:49/0 lens 224/368 e 0 to 0 dl 1787826459 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826409.401195:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163768:x1874663043066880:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 135us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826409.401203:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1277 00000100:00100000:0.0:1787826409.404476:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826409.404693:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043067008 00000100:00100000:2.0:1787826409.404707:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043067008 00000100:00100000:2.0:1787826409.404767:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1278 00000100:00100000:2.0:1787826409.404791:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163768:x1874663043067008:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:2.0:1787826409.404827:0:187906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00000100:00100000:2.0:1787826409.404901:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163768:x1874663043067008:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 112us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.404909:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1278 00000100:00100000:3.0:1787826409.418219:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826409.422580:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043067136 00000100:00100000:0.0:1787826409.422602:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043067136 00000100:00100000:0.0:1787826409.422705:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5940 00000100:00100000:0.0:1787826409.422721:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163768:x1874663043067136:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:0.0:1787826409.422767:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826409.422878:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163768:x1874663043067136:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 160us (4677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826409.422888:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5940 00000100:00100000:1.0:1787826409.427271:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826409.427877:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043067264 00000100:00100000:2.0:1787826409.427887:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043067264 00000100:00100000:2.0:1787826409.427937:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5941 00000100:00100000:2.0:1787826409.427947:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163768:x1874663043067264:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:2.0:1787826409.427982:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826409.428043:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:163768:x1874663043067264:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 98us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826409.428054:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5941 00000100:00100000:0.0:1787826409.510843:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826409.510981:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043067520 00000100:00100000:1.0:1787826409.510995:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043067520 00000100:00100000:1.0:1787826409.511072:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1279 00000100:00100000:1.0:1787826409.511086:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163775:x1874663043067520:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00010000:1.0:1787826409.511165:0:188992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826409.511203:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a569c00/0x878a5eea00cef111 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4b9 expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.511227:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:1.0:1787826409.511234:0:188992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826409.511788:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.511806:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.511817:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.511834:0:188992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.511846:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.511854:0:188992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512397:0:188992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512411:0:188992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512418:0:188992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512426:0:188992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441357a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:1.0:1787826409.512431:0:188992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512440:0:188992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512455:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:1.0:1787826409.512458:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826409.512464:0:188992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512470:0:188992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441357a00/0x878a5eea00cef118 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826409.512484:0:188992:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7d25343 reply state 000000002e722b37 transno 352187318308 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512497:0:188992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826409.512504:0:188992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb45ed20200) 00010000:00010000:1.0:1787826409.512506:0:188992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826409.512510:0:188992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1787826409.512550:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afc700 x1874663043067520/t352187318308(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:49/0 lens 528/448 e 0 to 0 dl 1787826459 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826409.514548:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163775:x1874663043067520:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 3445us (3702us total) trans 352187318308 rc 0/0 00000100:00100000:1.0:1787826409.514565:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1279 00000100:00100000:0.0:1787826409.576359:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826409.577319:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043067648 00000100:00100000:3.0:1787826409.577351:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043067648 00000100:00100000:3.0:1787826409.577433:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1280 00000100:00100000:3.0:1787826409.577447:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+9:163778:x1874663043067648:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826409.577482:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826409.577510:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cef126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f4c0 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.577681:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef12d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.577698:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef12d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.577711:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef12d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826409.577772:0:187904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787826409.577778:0:187904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1787826409.577805:0:187904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef12d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.577834:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ece00/0x878a5eea00cef126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4c0 expref: 11 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.577856:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef12d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4c0 expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.577866:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826409.577869:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826409.577873:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ed600, rc 0) 00010000:00000080:3.0:1787826409.577883:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481aff480 x1874663043067648/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:49/0 lens 576/688 e 0 to 0 dl 1787826459 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826409.577983:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163778:x1874663043067648:12345-192.168.203.47@tcp:101:rm.0 Request processed in 538us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826409.577990:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1280 00000100:00100000:3.0:1787826409.582449:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826409.582509:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043067776 00000100:00100000:3.0:1787826409.582522:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043067776 00000100:00100000:3.0:1787826409.582607:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1281 00000100:00100000:3.0:1787826409.582622:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+10:163778:x1874663043067776:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1787826409.582650:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826409.582678:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbef42c0221d6f4c7 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582767:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582783:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582796:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582810:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582817:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582823:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582934:0:187905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cef149 lrc: 3/1,0 mode: --/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582941:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cef149 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.582948:0:187905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cef149 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826409.583011:0:187905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200027cd1:0x9:0x0]: returning size 0 00000004:00200000:3.0:1787826409.583015:0:187905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1787826409.583037:0:187905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cef149 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583049:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cef149 lrc: 3/1,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583059:0:187905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583066:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583071:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583078:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583084:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec000 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826409.583089:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583096:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583111:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826409.583115:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826409.583120:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583128:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec000/0x878a5eea00cef13b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583149:0:187905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583154:0:187905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583159:0:187905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583165:0:187905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed800 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826409.583167:0:187905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583172:0:187905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583179:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb45ed20200) 00010000:00010000:3.0:1787826409.583181:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826409.583184:0:187905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583188:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed800/0x878a5eea00cef142 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583219:0:187905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec800/0x878a5eea00cef134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4c7 expref: 12 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583234:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cef149 lrc: 3/0,0 mode: PR/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4c7 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.583242:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x9:0x0].0x0 (ffff8eb44972e700) 00010000:00010000:3.0:1787826409.583244:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826409.583247:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ec600, rc 0) 00010000:00000080:3.0:1787826409.583256:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e869180 x1874663043067776/t0(0) o101->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:49/0 lens 600/584 e 0 to 0 dl 1787826459 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787826409.583371:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163778:x1874663043067776:12345-192.168.203.47@tcp:101:rm.0 Request processed in 752us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826409.583380:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1281 00000100:00100000:3.0:1787826409.589045:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826409.589114:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043068032 00000100:00100000:3.0:1787826409.589127:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043068032 00000100:00100000:3.0:1787826409.589201:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1282 00000100:00100000:3.0:1787826409.589215:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163778:x1874663043068032:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1787826409.589289:0:187904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826409.589348:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec600/0x878a5eea00cef149 lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4c7 expref: 11 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589370:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x9:0x0].0x0 (ffff8eb44972e700) 00010000:00010000:3.0:1787826409.589391:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed600/0x878a5eea00cef12d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f4c0 expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589401:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826409.589406:0:187904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826409.589435:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589452:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589464:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589476:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589485:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589492:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589691:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 3/0,1 mode: --/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589700:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589707:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589966:0:187904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 3/0,1 mode: --/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589976:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589988:0:187904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 3/0,1 mode: PW/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.589995:0:187904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590001:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590008:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590031:0:187904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826409.590051:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 3/0,1 mode: EX/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590056:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 2/0,0 mode: EX/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590062:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590069:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec200 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826409.590074:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 3/0,0 mode: EX/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590082:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 4/0,0 mode: EX/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590090:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x9:0x0].0x0 (ffff8eb44972e300) 00010000:00010000:3.0:1787826409.590093:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826409.590097:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 2/0,0 mode: --/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590103:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec200/0x878a5eea00cef15e lrc: 0/0,0 mode: --/EX res: [0x200027cd1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590121:0:187904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590127:0:187904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590132:0:187904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590137:0:187904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ed400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826409.590140:0:187904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590146:0:187904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590152:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eb444e01900) 00010000:00010000:3.0:1787826409.590155:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826409.590157:0:187904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590162:0:187904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ed400/0x878a5eea00cef150 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826409.590171:0:187904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003da444e6 reply state 00000000dd0eeb1e transno 352187318309 ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590187:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590193:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb45ed20200) 00010000:00010000:3.0:1787826409.590196:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826409.590200:0:187904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1787826409.590222:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e869880 x1874663043068032/t352187318309(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:49/0 lens 512/456 e 0 to 0 dl 1787826459 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826409.590308:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:163778:x1874663043068032:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1095us (1276us total) trans 352187318309 rc 0/0 00000100:00100000:3.0:1787826409.590317:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1282 00010000:00010000:3.0:1787826409.590393:0:9495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826409.590400:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590406:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724eda00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:3.0:1787826409.590410:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 2/0,0 mode: PW/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590416:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590426:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x9:0x0].0x0 (ffff8eb44972e300) 00010000:00010000:3.0:1787826409.590429:0:9495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826409.590432:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 1/0,0 mode: --/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590438:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724eda00/0x878a5eea00cef165 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826409.590457:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826409.590459:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826409.590460:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826410.324925:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826410.837685:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 1 seconds 00000100:00100000:0.0:1787826411.348696:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049451008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826411.348775:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.348968:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049451136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826411.349011:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.349044:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826411.349052:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049451264:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.349084:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826411.349106:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826411.349135:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049451008 00000100:00100000:1.0:1787826411.349144:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049451008 00000100:00100000:1.0:1787826411.349197:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049451136 00000100:00100000:1.0:1787826411.349200:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049451136 00000100:00100000:1.0:1787826411.349216:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787826411.349224:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049451008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826411.349258:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00010000:00000080:1.0:1787826411.349273:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afed80 x1874663049451008/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:12/0 lens 224/368 e 0 to 0 dl 1787826422 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826411.349351:0:199731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787826411.349365:0:199731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049451136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826411.349387:0:199731:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445548032 avail 1299308544 00010000:00000080:3.0:1787826411.349399:0:199731:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a210e00 x1874663049451136/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:12/0 lens 224/368 e 0 to 0 dl 1787826422 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826411.349437:0:199731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049451136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.349445:0:199731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787826411.350414:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049451008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1185us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.350426:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787826411.350581:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049451392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.350625:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.350666:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049451776:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.351418:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049451904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.351468:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.351503:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049452416:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.351524:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.351546:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826411.351552:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049451520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.351571:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.351588:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049452032:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.351607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.351622:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049452544:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.351640:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.351668:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049451904 00000100:00100000:1.0:1787826411.351675:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049451264 00000100:00100000:3.0:1787826411.351676:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049451904 00000100:00100000:1.0:1787826411.351682:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049451264 00000100:00100000:1.0:1787826411.351731:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787826411.351740:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049451264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826411.351790:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049452416 00000100:00100000:1.0:1787826411.351792:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049451264:12345-0@lo:400:kworker.0 Request processed in 52us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.351796:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049452416 00000100:00100000:1.0:1787826411.351803:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787826411.351833:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049452032 00000100:00100000:3.0:1787826411.351837:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049452032 00000100:00100000:1.0:1787826411.351847:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049451648:0@lo:400:kworker.0 00000100:00100000:3.0:1787826411.351867:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7205 00000100:00100000:3.0:1787826411.351879:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049451904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.351880:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.351908:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049452160:0@lo:400:kworker.0 00000100:00100000:3.0:1787826411.351934:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049451904:12345-0@lo:400:kworker.0 Request processed in 58us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.351951:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.351958:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7205 00000100:00100000:3.0:1787826411.351978:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7206 00000100:00100000:1.0:1787826411.351983:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049451264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826411.351990:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049452416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352012:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049451136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826411.352030:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049452416:12345-0@lo:400:kworker.0 Request processed in 44us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.352037:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7206 00000100:00100000:1.0:1787826411.352054:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7207 00000100:00100000:1.0:1787826411.352062:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049452032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352095:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049452032:12345-0@lo:400:kworker.0 Request processed in 34us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.352101:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7207 00000100:00100000:1.0:1787826411.352121:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049451392 00000100:00100000:1.0:1787826411.352124:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049451392 00000100:00100000:1.0:1787826411.352143:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049451520 00000100:00100000:1.0:1787826411.352146:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049451520 00000100:00100000:1.0:1787826411.352157:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049452544 00000100:00100000:1.0:1787826411.352160:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049452544 00000100:00100000:1.0:1787826411.352169:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049451648 00000100:00100000:1.0:1787826411.352171:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049451648 00000100:00100000:1.0:1787826411.352189:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049452160 00000100:00100000:1.0:1787826411.352192:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049452160 00000100:00080000:3.0:1787826411.352194:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826411.352201:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826411.352205:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826411.352209:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00080000:3.0:1787826411.352209:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826411.352229:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1787826411.352234:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049451392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826411.352241:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049451520:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826411.352257:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a212d80 x1874663049451392/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:51/0 lens 224/224 e 0 to 0 dl 1787826461 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000080:3.0:1787826411.352260:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a211500 x1874663049451520/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:51/0 lens 224/224 e 0 to 0 dl 1787826461 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826411.352314:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874663049451392:12345-0@lo:400:kworker.0 Request processed in 96us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.352321:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049451520:12345-0@lo:400:kworker.0 Request processed in 83us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.352345:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1787826411.352356:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1787826411.352364:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1787826411.352374:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049452544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826411.352378:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1787826411.352389:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049451648:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826411.352390:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46a210380 x1874663049452544/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:51/0 lens 224/224 e 0 to 0 dl 1787826461 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000080:3.0:1787826411.352406:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479841180 x1874663049451648/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:51/0 lens 224/224 e 0 to 0 dl 1787826461 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826411.352425:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049452544:12345-0@lo:400:kworker.0 Request processed in 52us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.352432:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1787826411.352447:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874663049451648:12345-0@lo:400:kworker.0 Request processed in 60us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.352450:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1787826411.352459:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1787826411.352464:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049452160:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826411.352477:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479841c00 x1874663049452160/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:51/0 lens 224/224 e 0 to 0 dl 1787826461 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826411.352505:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049452160:12345-0@lo:400:kworker.0 Request processed in 46us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.352511:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1787826411.352555:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049451520:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352566:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049452032:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352574:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049452544:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352583:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1874663049451392:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352592:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049451904:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352601:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049452416:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352630:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1874663049451648:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352638:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049452160:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.352654:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.352686:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049452288:0@lo:400:kworker.0 00000100:00100000:2.0:1787826411.352702:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049451776 00000100:00100000:2.0:1787826411.352708:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049451776 00000100:00100000:1.0:1787826411.352713:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.352753:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049452288 00000100:00100000:1.0:1787826411.352757:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049452288 00000100:00100000:2.0:1787826411.352764:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1787826411.352774:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049451776:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787826411.352788:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479840000 x1874663049451776/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:51/0 lens 224/224 e 0 to 0 dl 1787826461 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826411.352794:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7208 00000100:00100000:1.0:1787826411.352807:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049452288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826411.352834:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1874663049451776:12345-0@lo:400:kworker.0 Request processed in 63us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826411.352841:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00080000:2.0:1787826411.352863:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826411.352866:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826411.352884:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1874663049451776:0@lo:400:kworker.0 00000100:00100000:0.0:1787826411.354993:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049451008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826411.354994:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049452288:12345-0@lo:400:kworker.0 Request processed in 2185us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.355010:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7208 00000100:00100000:2.0:1787826411.355612:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049452288:0@lo:400:kworker.0 00000100:00100000:1.0:1787826411.860607:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049452672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826411.860683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.860849:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049452672 00000100:00100000:3.0:1787826411.860857:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049452672 00000100:00100000:3.0:1787826411.860911:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5942 00000100:00100000:3.0:1787826411.860922:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049452672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826411.860961:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1787826411.861111:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 1 seconds 00000100:00100000:0.0:1787826411.861494:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826411.861506:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049452800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826411.861544:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.861769:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049452800 00000100:00100000:3.0:1787826411.861775:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049452800 00000100:00100000:3.0:1787826411.861814:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5943 00000100:00100000:3.0:1787826411.861823:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049452800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826411.861844:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826411.861896:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049452800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.861902:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5943 00000100:00100000:2.0:1787826411.862007:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049452800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826411.863221:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049452672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2296us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.863231:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5942 00000100:00100000:2.0:1787826411.863352:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049452672:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787826412.373768:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826412.888615:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 1 seconds 00000100:00100000:1.0:1787826413.312672:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826413.312725:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826413.312766:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826413.312788:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826413.312818:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826413.312851:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043068672 00000100:00100000:1.0:1787826413.312864:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043068672 00000100:00100000:2.0:1787826413.312990:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043068160 00000100:00100000:2.0:1787826413.312996:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043068160 00000100:00100000:2.0:1787826413.313040:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 142 00000100:00100000:2.0:1787826413.313051:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043068160:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826413.313153:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2391:x1874663043068160:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 103us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.313165:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 142 00000100:00100000:0.0:1787826413.313250:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043068416 00000100:00100000:0.0:1787826413.313255:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043068416 00000100:00100000:0.0:1787826413.313293:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043068288 00000100:00100000:0.0:1787826413.313296:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043068288 00000100:00100000:0.0:1787826413.313319:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 479 00000100:00100000:0.0:1787826413.313349:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043068416:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826413.313371:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479843100 x1874663043068416/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:53/0 lens 224/224 e 0 to 0 dl 1787826463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826413.313400:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:2391:x1874663043068416:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 75us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.313408:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 479 00000100:00100000:0.0:1787826413.313423:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 480 00000100:00100000:0.0:1787826413.313429:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2391:x1874663043068288:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826413.313447:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb479840e00 x1874663043068288/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:53/0 lens 224/224 e 0 to 0 dl 1787826463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826413.313467:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+11:2391:x1874663043068288:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.313473:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 480 00000100:00100000:1.0:1787826413.313955:0:43905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043068544 00000100:00100000:1.0:1787826413.313962:0:43905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043068544 00000100:00100000:2.0:1787826413.315966:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7209 00000100:00100000:2.0:1787826413.316009:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043068672:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826413.316467:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043068672:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 432us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.316477:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7209 00000100:00100000:2.0:1787826413.316515:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7210 00000100:00100000:2.0:1787826413.316525:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043068544:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826413.316634:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043068544:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 111us (3814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.316641:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7210 00000100:00080000:2.0:1787826413.316681:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826413.316689:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826413.316692:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826413.316695:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787826413.401019:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826413.908517:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826413.908669:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049452928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826413.908836:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826413.908898:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049452928 00000100:00100000:2.0:1787826413.908909:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049452928 00000100:00100000:2.0:1787826413.909002:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5944 00000100:00100000:2.0:1787826413.909015:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049452928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826413.909056:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00080000:0.0:1787826413.909059:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826413.909137:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874663049452928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.909257:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049452928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826413.909564:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5944 00000100:00100000:1.0:1787826413.911061:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826413.911090:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049453056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826413.911181:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826413.911240:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049453056 00000100:00100000:1.0:1787826413.911248:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049453056 00000100:00100000:1.0:1787826413.911312:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5945 00000100:00100000:1.0:1787826413.911353:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049453056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826413.911391:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826413.911571:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049453056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.911579:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5945 00000100:00080000:1.0:1787826413.911616:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826413.911659:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049453056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826413.911825:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 1 seconds 00010000:00010000:2.0:1787826414.422528:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787826414.934785:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318309 is committed 00000100:00100000:0.0:1787826414.934934:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 1 seconds 00010000:00010000:3.0:1787826414.935095:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935111:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935120:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935128:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb441356a00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826414.935134:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935144:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935166:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb45ed20200) 00010000:00010000:3.0:1787826414.935170:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826414.935176:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935188:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb441356a00/0x878a5eea00cef11f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935212:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935218:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935225:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935231:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ec400 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:3.0:1787826414.935234:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935240:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935249:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeda9eca1 (ffff8eb45ed20200) 00010000:00010000:3.0:1787826414.935251:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826414.935254:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.935260:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb4724ec400/0x878a5eea00cef157 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeda9eca1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.448839:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787826415.957128:0:198811:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826399/real 1787826399] req@ffff8eb34dde0a80 x1874663049443968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1787826415 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826415.957342:0:198811:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787826415.957349:0:198811:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787826415.957357:0:198811:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1787826415.957372:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 0 seconds 00000100:00080000:1.0:1787826415.958093:0:172937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826415.958100:0:172937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826415.958104:0:172937:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826415.958114:0:172937:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8436 00000100:00080000:1.0:1787826415.958126:0:172937:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb341ac8800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826415.958154:0:172937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448cd7b80 x1874663049454336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826415.958783:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049453184:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.958884:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826415.958956:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049453696:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.958994:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.959512:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049453312:0@lo:400:kworker.0 00000100:00100000:1.0:1787826415.959552:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.959579:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049453824:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.960463:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049454208:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.960521:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826415.960722:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049453696 00000100:00100000:3.0:1787826415.960733:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049453696 00000100:00100000:3.0:1787826415.960805:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049453312 00000100:00100000:3.0:1787826415.960809:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049453312 00000100:00100000:3.0:1787826415.960827:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049454208 00000100:00100000:3.0:1787826415.960830:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049454208 00000100:00100000:3.0:1787826415.960854:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1787826415.960866:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049453696:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826415.960900:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afea00 x1874663049453696/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1787826465 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826415.960967:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049453696:12345-0@lo:400:kworker.0 Request processed in 102us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.960975:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826415.960976:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1787826415.961000:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1787826415.961001:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049454464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826415.961008:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049453312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826415.961027:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:3.0:1787826415.961032:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481231880 x1874663049453312/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1787826465 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826415.961062:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049453440:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.961078:0:196427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049453184 00000100:00100000:0.0:1787826415.961084:0:196427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049453184 00000100:00100000:1.0:1787826415.961091:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.961107:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049453952:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.961123:0:196427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787826415.961128:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826415.961130:0:196427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049453184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826415.961148:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049454592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.961165:0:196427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049453184:12345-0@lo:400:kworker.0 Request processed in 35us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.961169:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.961190:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826415.961198:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049453568:0@lo:400:kworker.0 00000100:00100000:1.0:1787826415.961292:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.961307:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049454080:0@lo:400:kworker.0 00000100:00100000:1.0:1787826415.961363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.961384:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049454720:0@lo:400:kworker.0 00000100:00100000:1.0:1787826415.961406:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.961435:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049454336:0@lo:38:kworker.0 00000100:00100000:1.0:1787826415.961462:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.961501:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049454464 00000100:00100000:1.0:1787826415.961505:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049454464 00000100:00100000:1.0:1787826415.961544:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049453952 00000100:00100000:1.0:1787826415.961547:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049453952 00000100:00100000:1.0:1787826415.961568:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049454592 00000100:00100000:1.0:1787826415.961572:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049454592 00000100:00100000:1.0:1787826415.961594:0:43901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049454080 00000100:00100000:1.0:1787826415.961597:0:43901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049454080 00000100:00100000:1.0:1787826415.961620:0:43901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7211 00000100:00100000:1.0:1787826415.961627:0:43901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049454464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.961752:0:196427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787826415.961794:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049453440 00000100:00100000:0.0:1787826415.961798:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049453440 00000100:00100000:0.0:1787826415.961818:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049453568 00000100:00100000:0.0:1787826415.961820:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049453568 00000100:00100000:0.0:1787826415.961833:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049454720 00000100:00100000:0.0:1787826415.961836:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049454720 00000100:00100000:0.0:1787826415.961848:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1787826415.961855:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049454208:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826415.961868:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afd500 x1874663049454208/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1787826465 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826415.964570:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874663049454208:12345-0@lo:400:kworker.0 Request processed in 2699us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.964673:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1874663049453312:12345-0@lo:400:kworker.0 Request processed in 3664us (5118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.964685:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1787826415.964756:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1787826415.964775:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049453440:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826415.964807:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481233100 x1874663049453440/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1787826465 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826415.964889:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049453440:12345-0@lo:400:kworker.0 Request processed in 112us (3785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.964896:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1787826415.964929:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1787826415.964937:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049453568:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826415.964950:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1fea00 x1874663049453568/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1787826465 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826415.964979:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874663049453568:12345-0@lo:400:kworker.0 Request processed in 44us (3688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.964986:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1787826415.965002:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1787826415.965010:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049454720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.965102:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1787826415.965157:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7212 00000100:00100000:0.0:1787826415.965169:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049453952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.965807:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049453952:12345-0@lo:400:kworker.0 Request processed in 640us (4675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.965815:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7212 00000100:00100000:0.0:1787826415.965839:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7213 00000100:00100000:0.0:1787826415.965850:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049454592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.965881:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049454592:12345-0@lo:400:kworker.0 Request processed in 35us (4711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.965887:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7213 00000100:00100000:0.0:1787826415.965899:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7214 00000100:00100000:0.0:1787826415.965905:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049454080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.965943:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3617:x1874663049454080:12345-0@lo:400:kworker.0 Request processed in 39us (4580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.965950:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7214 00010000:00000080:3.0:1787826415.966427:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1fed80 x1874663049454720/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1787826465 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826415.966468:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874663049454720:12345-0@lo:400:kworker.0 Request processed in 1459us (5060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.966475:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00080000:3.0:1787826415.966516:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826415.966522:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826415.966527:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826415.966531:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826415.966551:0:199731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049453824 00000100:00100000:3.0:1787826415.966561:0:199731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049453824 00000100:00100000:3.0:1787826415.966617:0:199731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049454336 00000100:00100000:3.0:1787826415.966621:0:199731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049454336 00000100:00100000:3.0:1787826415.966637:0:199731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787826415.966644:0:199731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049453824:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826415.966661:0:199731:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481231f80 x1874663049453824/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:16/0 lens 224/224 e 0 to 0 dl 1787826426 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826415.966698:0:199731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1874663049453824:12345-0@lo:400:kworker.0 Request processed in 54us (5722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.966706:0:199731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787826415.966723:0:199731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787826415.966732:0:199731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3616:x1874663049454336:12345-0@lo:38:kworker.0 00010000:02000400:3.0:1787826415.966763:0:199731:0:(ldlm_lib.c:1363:target_handle_connect()) lustre-MDT0000: Received new MDS connection from 0@lo, keep former export from same NID 00000100:00100000:1.0:1787826415.966986:0:43901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049454464:12345-0@lo:400:kworker.0 Request processed in 5357us (5955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.966996:0:43901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7211 00000100:00100000:2.0:1787826415.968859:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb479841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049453184:0@lo:400:kworker.0 00000100:00100000:2.0:1787826415.968888:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049453696:0@lo:400:kworker.0 00000100:00100000:2.0:1787826415.968903:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874663049454208:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.970248:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049453312:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.970270:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1874663049453824:0@lo:400:kworker.0 00000100:00100000:0.0:1787826415.970285:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049454464:0@lo:400:kworker.0 00000100:00100000:2.0:1787826415.971978:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049453568:0@lo:400:kworker.0 00000100:00100000:2.0:1787826415.972004:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049454080:0@lo:400:kworker.0 00000100:00100000:2.0:1787826415.972020:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049454720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826415.972035:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049453440:0@lo:400:kworker.0 00000100:00100000:2.0:1787826415.972052:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049453952:0@lo:400:kworker.0 00000100:00100000:2.0:1787826415.972067:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049454592:0@lo:400:kworker.0 00010000:00080000:3.0:1787826415.980749:0:199731:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t352187318293 exp ffff8eb47a4ea800 cur 8482 last 1787826370 00000004:00100000:3.0:1787826415.980783:0:199731:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli 0@lo does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787826415.980808:0:199731:0:(import.c:65:import_set_state_nolock()) ffff8eb45eb95800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1787826415.980820:0:199731:0:(import.c:65:import_set_state_nolock()) ffff8eb45eb95800 : changing import state from RECOVER to FULL 00010000:00000080:3.0:1787826415.980849:0:199731:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1fc000 x1874663049454336/t0(0) o38->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787826435 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826415.980969:0:199731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3616:x1874663049454336:12345-0@lo:38:kworker.0 Request processed in 14239us (19505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.980982:0:199731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787826415.981416:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 82 00000100:00080000:1.0:1787826415.981435:0:3616:0:(import.c:1297:ptlrpc_connect_interpret()) reconnected to lustre-MDT0000_UUID@0@lo after partition 00000100:00080000:1.0:1787826415.981438:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787826415.981443:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826415.981461:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1787826415.981470:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004d8d8c29): req@ffff8eb34dde0a80 x1874663049443968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1787826415 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826415.981497:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049454336:0@lo:38:kworker.0 00000100:00100000:3.0:1787826415.981711:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049454848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826415.981768:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826415.981821:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049454848 00000100:00100000:3.0:1787826415.981830:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049454848 00000100:00100000:3.0:1787826415.981882:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787826415.981893:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049454848:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826415.982012:0:198811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826415.982032:0:198811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.982443:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049443968 00000100:00100000:0.0:1787826415.982449:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049443968 00000100:00100000:0.0:1787826415.982476:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826415.982484:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198811:x1874663049443968:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1787826415.982517:0:187910:0:(tgt_handler.c:3156:tgt_check_resent()) @@@ reconstruct resent RPC req@ffff8eb481afe680 x1874663049443968/t352187318305(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:16/0 lens 2520/4320 e 0 to 0 dl 1787826426 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:0.0:1787826415.982536:0:187910:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb472466208 index 0: rc = 0 00000020:00080000:0.0:1787826415.982541:0:187910:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb472466208 index 1: rc = 0 00000020:00080000:0.0:1787826415.982544:0:187910:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb472466208 index 2: rc = 0 00000020:00080000:0.0:1787826415.982551:0:187910:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb472466208 index 3: rc = 0 00000020:00080000:0.0:1787826415.982557:0:187910:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb472466208 index 4: rc = 0 00000020:00080000:0.0:1787826415.982560:0:187910:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb472466208 index 5: rc = 0 00000020:00080000:0.0:1787826415.982563:0:187910:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb472466208 index 6: rc = 0 00000020:00080000:0.0:1787826415.982566:0:187910:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff8eb472466208 index 7: rc = 0 00010000:00000080:0.0:1787826415.982574:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afe680 x1874663049443968/t352187318305(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:16/0 lens 2520/4320 e 0 to 0 dl 1787826426 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826415.982629:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198811:x1874663049443968:12345-0@lo:1000:osp_up0-1.0 Request processed in 144us (616us total) trans 352187318305 rc 0/0 00000100:00100000:0.0:1787826415.982636:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787826415.982699:0:198811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34dde0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198811:1874663049443968:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1787826415.982813:0:188682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 3/0,1 mode: --/PW res: [0x240001f59:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.982833:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.982849:0:188682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826415.982871:0:188682:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008620bd60 reply state 00000000a2947eb9 transno 21474836550 ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 3/0,1 mode: PW/PW res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.982887:0:188682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.982895:0:188682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2b:0x0].0x0 (ffff8eb453a77800) 00010000:00010000:0.0:1787826415.982899:0:188682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826415.982903:0:188682:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787826415.982926:0:188682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240001f59:0x2b:0x0]: returning size 4096 00000004:00080000:0.0:1787826415.982939:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x7:0x0] 00010000:00010000:0.0:1787826415.982953:0:188682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.982962:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 4/0,1 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.982969:0:188682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.982991:0:188682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826415.982995:0:188682:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027cd1:0x7:0x0] 00010000:00010000:0.0:1787826415.983000:0:188682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 4/0,1 mode: PW/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef031 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.983007:0:188682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef031 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1787826415.983049:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34dde0380 x1874663043063936/t21474836550(0) o36->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:25/0 lens 560/448 e 1 to 0 dl 1787826435 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787826415.983117:0:188682:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787826415.983133:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163667:x1874663043063936:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 16290363us (16291236us total) trans 21474836550 rc 0/0 00000100:00100000:0.0:1787826415.983140:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1269 00010000:00010000:0.0:1787826415.983168:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 3/0,1 mode: TXN/TXN res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.983175:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 2/0,0 mode: TXN/TXN res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.983181:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.983186:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a569e00 already unused, calling callback (ffffffffc1a414f0) 00010000:00010000:0.0:1787826415.983191:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 3/0,0 mode: TXN/TXN res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.983199:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 4/0,0 mode: TXN/TXN res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.983211:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240001f59:0x2b:0x0].0x0 (ffff8eb453a77800) 00010000:00010000:0.0:1787826415.983214:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826415.983218:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 2/0,0 mode: --/TXN res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.983224:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8eb34a569e00/0x878a5eea00cef16c lrc: 0/0,0 mode: --/TXN res: [0x240001f59:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188682 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00000024:3.0:1787826415.983454:0:187909:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445548032 avail 1299308544 00010000:00000080:3.0:1787826415.983472:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb46e868000 x1874663049454848/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:16/0 lens 224/368 e 0 to 0 dl 1787826426 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826415.983521:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3619:x1874663049454848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1630us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.983529:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1787826415.983551:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826415.983558:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 2/0,0 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.983566:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb4724ecc00 already unused, calling callback (ffffffffc1a4dee0) 00010000:00010000:3.0:1787826415.983571:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826415.983580:0:66923:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 3/0,0 mode: CW/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.983614:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 2/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.983621:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826415.983649:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 1/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.983657:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb4724ecc00/0x878a5eea00cef01c lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cef023 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.983678:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826415.983680:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826415.983682:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826415.983932:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049454848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826415.983958:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049454976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826415.984011:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826415.987300:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049454976 00000100:00100000:3.0:1787826415.987318:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049454976 00000100:00100000:3.0:1787826415.987533:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4253 00000100:00100000:3.0:1787826415.987548:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3620:x1874663049454976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.987569:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.987602:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38600/0x878a5eea00cef023 lrc: 0/0,0 mode: --/CW res: [0x200027cd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cef01c expref: 8 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.987840:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200027cd1:0x7:0x0].0x0 (ffff8eb481693500) 00010000:00010000:3.0:1787826415.987846:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.987956:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3620:x1874663049454976:12345-0@lo:103:ldlm_bl.0 Request processed in 413us (3945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.987965:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4253 00000100:00100000:0.0:1787826415.988064:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826415.988213:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049454976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826415.988963:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043068928 00000100:00100000:3.0:1787826415.988973:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043068928 00000100:00100000:3.0:1787826415.989052:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:0.0:1787826415.989059:0:187907:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1787826415.989064:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+7:163667:x1874663043068928:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:0.0:1787826415.989070:0:187907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00000080:3.0:1787826415.989371:0:187908:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afdc00 x1874663043068928/t352187318310(0) o35->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:16/0 lens 392/456 e 0 to 0 dl 1787826426 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1787826415.989629:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826415.991358:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:163667:x1874663043068928:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 2282us (3282us total) trans 352187318310 rc 0/0 00000100:00100000:3.0:1787826415.992073:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00010000:00010000:0.0:1787826416.468788:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826416.469180:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826416.473249:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049455104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826416.474136:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826416.480195:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049455104 00000100:00100000:0.0:1787826416.480218:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049455104 00000100:00100000:2.0:1787826416.480990:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787826416.481212:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049455104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826416.481270:0:187910:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00010000:00000080:2.0:1787826416.481292:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1fc700 x1874663049455104/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:17/0 lens 224/368 e 0 to 0 dl 1787826427 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826416.481447:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049455104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 242us (7313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.481456:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787826416.481769:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049455104:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787826416.722797:0:200454:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00100000:1.0:1787826416.983427:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826416.983462:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049455232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826416.983568:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826416.983639:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049455232 00000100:00100000:1.0:1787826416.983649:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049455232 00000100:00100000:1.0:1787826416.983711:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5946 00000100:00100000:1.0:1787826416.983723:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049455232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826416.983765:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826416.983821:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049455232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.983830:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5946 00000100:00100000:1.0:1787826416.983888:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049455232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826416.985356:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826416.985378:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049455360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826416.985441:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826416.985534:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049455360 00000100:00100000:3.0:1787826416.985541:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049455360 00000100:00100000:3.0:1787826416.985607:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5947 00000100:00100000:3.0:1787826416.985617:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049455360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826416.985798:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826416.985870:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049455360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 254us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.985879:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5947 00000100:00100000:2.0:1787826416.985977:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049455360:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787826417.492538:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826418.428066:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826418.428110:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826418.428141:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826418.428213:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826418.428240:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826418.428283:0:196429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043069056 00000100:00100000:2.0:1787826418.428293:0:196429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043069056 00000100:00100000:2.0:1787826418.428367:0:196429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 144 00000100:00100000:2.0:1787826418.428378:0:196429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043069056:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1787826418.428446:0:196429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f40147eb-9b53-47d4-b77c-99ceedd9664c+10:2392:x1874663043069056:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 70us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.428454:0:196429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 144 00000100:00100000:0.0:1787826418.428680:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043069312 00000100:00100000:0.0:1787826418.428685:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043069312 00000100:00100000:0.0:1787826418.428736:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043069184 00000100:00100000:0.0:1787826418.428740:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043069184 00000100:00100000:0.0:1787826418.428764:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 487 00000100:00100000:0.0:1787826418.428772:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043069312:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826418.428794:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1ff800 x1874663043069312/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:33/0 lens 224/224 e 0 to 0 dl 1787826443 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826418.428827:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043069312:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 56us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.428833:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 487 00000100:00100000:0.0:1787826418.428847:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 488 00000100:00100000:0.0:1787826418.428865:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2392:x1874663043069184:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:0.0:1787826418.428882:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb47a1fe300 x1874663043069184/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:19/0 lens 224/224 e 0 to 0 dl 1787826429 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826418.428916:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+8:2392:x1874663043069184:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 62us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.428922:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 488 00000100:00080000:2.0:1787826418.429127:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826418.429131:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826418.434839:0:43900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043069568 00000100:00100000:3.0:1787826418.434867:0:43900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043069568 00000100:00100000:0.0:1787826418.437286:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043069440 00000100:00100000:0.0:1787826418.437300:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043069440 00000100:00100000:0.0:1787826418.437400:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7215 00000100:00100000:0.0:1787826418.437413:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043069568:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826418.437498:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043069568:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 89us (9355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.437507:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7215 00000100:00100000:0.0:1787826418.437526:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7216 00000100:00100000:0.0:1787826418.437533:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043069440:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826418.437558:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47a1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043069440:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (9318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.437565:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7216 00000100:00080000:1.0:1787826418.440074:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826418.440087:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826418.516429:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787826418.694099:0:200551:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787826418.694184:0:200551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.694202:0:200551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.694211:0:200551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.694218:0:200551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.694239:0:200551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787826418.694245:0:200551:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787826418.694259:0:66923:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826418.694268:0:66923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.694276:0:66923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38000 already unused, calling callback (ffffffffc1431c20) 00000100:00080000:0.0:1787826418.694280:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:1.0:1787826418.694280:0:66923:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.694285:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1787826418.694289:0:66923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826418.694292:0:200551:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:1.0:1787826418.694296:0:66923:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826418.694302:0:66923:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826418.694304:0:66923:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787826418.694306:0:66923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1787826418.694338:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb348a38000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787826418.694355:0:66923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.694367:0:66923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826418.694392:0:66923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.694398:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38000/0x878a5eea00cedb54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedb5b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.694411:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.694413:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.694414:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826418.694433:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049455488:0@lo:39:umount.0 00000100:00100000:1.0:1787826418.694518:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826418.694578:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826418.694587:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049455616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826418.694624:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826418.694672:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049455488 00000100:00100000:1.0:1787826418.694681:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049455488 00000100:00100000:1.0:1787826418.694737:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1787826418.694749:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874663049455488:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787826418.694780:0:188682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedc8f 00000100:00080000:1.0:1787826418.694789:0:188682:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a6000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1787826418.694823:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb476d31180 x1874663049455488/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:19/0 lens 224/224 e 0 to 0 dl 1787826429 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826418.694871:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1874663049455488:12345-0@lo:39:umount.0 Request processed in 123us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.694878:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000020:00000080:1.0:1787826418.694903:0:188682:0:(genops.c:885:class_export_put()) final put ffff8eb47f9a4000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1787826418.694935:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049455616 00000100:00100000:1.0:1787826418.694938:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049455616 00000100:00100000:1.0:1787826418.694971:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4254 00000100:00100000:1.0:1787826418.694978:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eda2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3619:x1874663049455616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826418.694992:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826418.695012:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf39400/0x878a5eea00cedb5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedb54 expref: 24 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.695029:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826418.695059:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eda2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3619:x1874663049455616:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.695066:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4254 00000020:00000080:2.0:1787826418.695120:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f9a4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1787826418.695149:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826418.695180:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f9a6000 for lustre-MDT0000 00000100:00100000:1.0:1787826418.695693:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049455616:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787826418.695822:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb348a38000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826418.695862:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049455488:0@lo:39:umount.0 00000100:00080000:0.0:1787826418.695930:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826418.695935:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787826418.695941:0:200551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787826418.696952:0:200551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.696970:0:200551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.696977:0:200551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.696984:0:200551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697011:0:200551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826418.697019:0:200551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697026:0:200551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697032:0:200551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697037:0:200551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697048:0:200551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787826418.697055:0:200551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697061:0:200551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697068:0:200551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697074:0:200551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697087:0:200551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787826418.697092:0:200551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697097:0:200551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697102:0:200551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697109:0:200551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.697119:0:200551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787826418.697122:0:200551:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787826418.697286:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826418.697294:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697303:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce3a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826418.697307:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697316:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826418.697338:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826418.697344:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826418.697347:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787826418.697350:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787826418.697388:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697400:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826418.697425:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697432:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3a00/0x878a5eea00ceda6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceda7b expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697444:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826418.697447:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697452:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34ab18000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826418.697455:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697461:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826418.697467:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826418.697471:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826418.697473:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787826418.697474:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787826418.697483:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697487:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826418.697491:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697501:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab18000/0x878a5eea00cee7e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cee7ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697509:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826418.697513:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697518:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb480d64800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826418.697526:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697532:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826418.697538:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826418.697543:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787826418.697545:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787826418.697547:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787826418.697563:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697569:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826418.697582:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697589:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d64800/0x878a5eea00cedb46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00cedb4d expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697603:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826418.697607:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697612:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb481ce2600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1787826418.697615:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697622:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787826418.697627:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826418.697633:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787826418.697635:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787826418.697637:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787826418.697650:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697655:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826418.697661:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697667:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce2600/0x878a5eea00ceda5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x878a5eea00ceda66 expref: -99 pid: 196422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.697677:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826418.697678:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826418.697681:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826418.697703:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049455872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826418.697786:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826418.697848:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826418.697854:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049455744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826418.697877:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787826418.697925:0:200551:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787826418.697931:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1787826418.697938:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1787826418.697944:0:200551:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1787826418.698770:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826418.698798:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049455872 00000100:00100000:2.0:1787826418.698808:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049455872 00000100:00100000:2.0:1787826418.698880:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049455744 00000100:00100000:2.0:1787826418.698883:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049455744 00000100:00100000:2.0:1787826418.698922:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4255 00000100:00100000:2.0:1787826418.698935:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+24:3618:x1874663049455872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.698955:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.698978:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb441510c00/0x878a5eea00cee7ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee7e8 expref: 24 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.698998:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826418.699448:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.699456:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826418.699473:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049456000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826418.699574:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049456128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826418.699689:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+23:3618:x1874663049455872:12345-0@lo:103:ldlm_bl.0 Request processed in 755us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.699699:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4255 00000100:00100000:2.0:1787826418.699726:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4256 00000100:00100000:2.0:1787826418.699736:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+22:3618:x1874663049455744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.699747:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.699763:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64400/0x878a5eea00ceda7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceda6d expref: 22 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.699775:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.699801:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3618:x1874663049455744:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.699807:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4256 00000100:00100000:2.0:1787826418.699858:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049455744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826418.699869:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049455872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826418.700041:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826418.700242:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049456000 00000100:00100000:2.0:1787826418.700249:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049456000 00000100:00100000:2.0:1787826418.700295:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4257 00000100:00100000:2.0:1787826418.700303:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+21:3619:x1874663049456000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.700344:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.700357:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65600/0x878a5eea00cedb4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedb46 expref: 21 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.700369:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.700405:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:3619:x1874663049456000:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.700412:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4257 00000004:00000080:0.0:1787826418.700438:0:200551:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:2.0:1787826418.700438:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049456000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826418.700638:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826418.700737:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049456128 00000100:00100000:2.0:1787826418.700742:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049456128 00000100:00100000:2.0:1787826418.700807:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4258 00000100:00100000:2.0:1787826418.700815:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+20:3620:x1874663049456128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.700824:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.700836:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3800/0x878a5eea00ceda66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00ceda5f expref: 20 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.700847:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.700884:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:205ad83e-e455-4070-92a2-f1e25b8f3f40+19:3620:x1874663049456128:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.700900:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4258 00000100:00100000:3.0:1787826418.700948:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049456128:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1787826418.702276:0:196423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 352187318310 is committed 00000020:00000080:0.0:1787826418.703149:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1787826418.703161:0:200551:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb34df96000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826418.703169:0:200551:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb47a4ea800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 2) 0 0 0 0: 0000000000000000 352187318305 stale:0 00000020:00080000:0.0:1787826418.703175:0:200551:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb4770d9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826418.703179:0:200551:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb47f7e0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826418.703186:0:200551:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8eb34b9e0000 c0d7758a-4501-4a89-8ec1-407fef4f0c7f 192.168.203.47@tcp 6 (0 0 1) 0 0 0 0: 0000000000000000 352187318310 stale:0 00000020:00080000:0.0:1787826418.703192:0:200551:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8eb47a4319b8) has exports, disconnecting them 00000020:00080000:0.0:1787826418.703197:0:200551:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb34df96000), last request at 1787826370 00000020:00000080:0.0:1787826418.703205:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cee7cc 00000100:00080000:0.0:1787826418.703217:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb34df97800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826418.703247:0:200551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb34df96000): rc 0 00000020:00000080:0.0:1787826418.703249:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb34df96000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787826418.703295:0:200551:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb47a4ea800), last request at 1787826370 00000020:00000080:0.0:1787826418.703300:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cee763 00000020:00010000:0.0:1787826418.703304:0:200551:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb47a4ea800: total 1 00000100:00080000:0.0:1787826418.703307:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb45eb95800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826418.703353:0:200551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb47a4ea800): rc 0 00000020:00080000:0.0:1787826418.703357:0:200551:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb4770d9000), last request at 1787826415 00000020:00000080:0.0:1787826418.703360:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedc88 00000100:00080000:0.0:1787826418.703364:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a0000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787826418.703396:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34df96000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00010000:3.0:1787826418.703444:0:6479:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb47a4ea800: total 1 00000020:00000080:2.0:1787826418.703459:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb34df97800 for lustre-MDT0000 00010000:00010000:3.0:1787826418.703513:0:6479:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb47a4ea800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787826418.703557:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34bf38a00/0x878a5eea00cef031 lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cef02a expref: 3 pid: 187909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.703589:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb479b3ee00/0x878a5eea00cee993 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee98c expref: 2 pid: 187910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.703605:0:6479:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb47a4ea800, canceled 2 locks, left on hash table 0. 00000020:00080000:0.0:1787826418.705099:0:200551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb4770d9000): rc 0 00000020:00000080:0.0:1787826418.705106:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb4770d9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787826418.705123:0:200551:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8eb47f7e0800), last request at 1787826415 00000020:00000080:0.0:1787826418.705138:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedc6c 00000100:00080000:0.0:1787826418.705161:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb44908f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787826418.705212:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826418.705280:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826418.705293:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb4770d9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:0.0:1787826418.705798:0:200551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb47f7e0800): rc 0 00000020:00000080:0.0:1787826418.705801:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb47f7e0800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1787826418.705826:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826418.705985:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb47f9a0000 for lustre-MDT0000 00000020:00080000:0.0:1787826418.706057:0:200551:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.47@tcp (ffff8eb34b9e0000), last request at 1787826418 00000020:00000080:0.0:1787826418.706063:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedac1 00000020:00010000:0.0:1787826418.706079:0:200551:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb34b9e0000: total 1 00000100:00080000:0.0:1787826418.706084:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb3434f2000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826418.706138:0:200551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb34b9e0000): rc 0 00000004:00000080:0.0:1787826418.706148:0:200551:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb65b81d17ae0 00000100:00080000:0.0:1787826418.706173:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826418.706178:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:2.0:1787826418.706643:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47f7e0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787826418.706688:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb44908f800 for lustre-MDT0000 00000020:00010000:1.0:1787826418.707915:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb34b9e0000: total 0 00010000:00010000:1.0:1787826418.708021:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb34b9e0000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787826418.708076:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eb34a568a00/0x878a5eea00ceefcf lrc: 0/0,0 mode: --/PR res: [0x200027cd1:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f488 expref: 2 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.708116:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb34b9e0000, canceled 1 locks, left on hash table 0. 00000100:00080000:0.0:1787826418.709283:0:200551:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787826418.709374:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787826418.711426:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049456256:0@lo:39:umount.0 00000100:00100000:0.0:1787826418.711715:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826418.712001:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049456256 00000100:00100000:2.0:1787826418.712015:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049456256 00000100:00100000:2.0:1787826418.712088:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787826418.712100:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049456256:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787826418.712145:0:187909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cee732 00000100:00080000:2.0:1787826418.712173:0:187909:0:(import.c:65:import_set_state_nolock()) ffff8eb472781800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826418.712201:0:187909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474836550 00010000:00000080:2.0:1787826418.712370:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afd180 x1874663049456256/t21474836551(0) o39->lustre-MDT0000-mdtlov_UUID@0@lo:19/0 lens 224/224 e 0 to 0 dl 1787826429 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826418.712433:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3616:x1874663049456256:12345-0@lo:39:umount.0 Request processed in 334us (718us total) trans 21474836551 rc 0/0 00000100:00100000:2.0:1787826418.712443:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:2.0:1787826418.712471:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826418.713873:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45ec36000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787826418.713901:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049456256:0@lo:39:umount.0 00000100:00080000:2.0:1787826418.714281:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787826418.714286:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 3 00000004:00080000:2.0:1787826418.715002:0:200551:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787826418.715065:0:200551:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787826418.715104:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb45a03b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787826418.715128:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787826418.715132:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975537 gen 3 00000004:00080000:2.0:1787826418.715150:0:200551:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826418.715233:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049456384:0@lo:9:umount.0 00000100:00100000:2.0:1787826418.715319:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826418.715409:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049456384 00000100:00100000:2.0:1787826418.715419:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049456384 00000100:00100000:2.0:1787826418.715491:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22663 00000100:00100000:2.0:1787826418.715502:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049456384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787826418.715534:0:151857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedb23 00000100:00080000:2.0:1787826418.715542:0:151857:0:(import.c:65:import_set_state_nolock()) ffff8eb349080000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826418.715609:0:151857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705689 00000100:00100000:2.0:1787826418.715928:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049456384:12345-0@lo:9:umount.0 Request processed in 426us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.715936:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22663 00000100:00080000:2.0:1787826418.715988:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb45a03b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787826418.718906:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787826418.718922:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826418.718936:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049456384:0@lo:9:umount.0 00000100:00080000:2.0:1787826418.719024:0:200551:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787826418.719063:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb349083800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787826418.719102:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049456512:0@lo:9:umount.0 00000100:00100000:2.0:1787826418.719192:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787826418.719297:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb47a4319b8) has no exports 00000100:00100000:2.0:1787826418.719377:0:43902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049456512 00000100:00100000:2.0:1787826418.719388:0:43902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049456512 00000100:00100000:2.0:1787826418.719449:0:43902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22664 00000100:00100000:2.0:1787826418.719460:0:43902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1874663049456512:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787826418.719494:0:43902:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedb31 00000100:00080000:2.0:1787826418.719731:0:43902:0:(import.c:65:import_set_state_nolock()) ffff8eb46e2a3800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787826418.720854:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787826418.720937:0:43902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975558 00000100:00100000:2.0:1787826418.721300:0:43902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3616:x1874663049456512:12345-0@lo:9:umount.0 Request processed in 1835us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.721311:0:43902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22664 00000100:00080000:0.0:1787826418.721737:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb349083800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787826418.721850:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787826418.721854:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826418.721860:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049456512:0@lo:9:umount.0 00000100:00080000:0.0:1787826418.722411:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826418.722419:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826418.724443:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826418.745693:0:6479:0:(genops.c:885:class_export_put()) final put ffff8eb47a4ea800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1787826418.745881:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.745885:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.745898:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826418.746093:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb47a4ea800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787826418.746186:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb45eb95800 for lustre-MDT0000 00000020:00080000:0.0:1787826418.751066:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8eb47a4319b8) has no exports 00000020:00000080:1.0:1787826418.763876:0:6478:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e0000/c0d7758a-4501-4a89-8ec1-407fef4f0c7f 00000020:00000080:2.0:1787826418.764072:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e0000/c0d7758a-4501-4a89-8ec1-407fef4f0c7f for lustre-MDT0000 00000020:00000080:2.0:1787826418.764307:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb3434f2000 for lustre-MDT0000 00010000:00010000:1.0:1787826418.764467:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.764472:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.764475:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826418.816984:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedadd 00000020:00000080:0.0:1787826418.817009:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb450c21000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787826418.817043:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787826418.817168:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb450c21000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787826418.822696:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826418.822719:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787826418.822725:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8eb344e60000) has no exports 00000020:00000080:1.0:1787826418.823905:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedad6 00000020:00000080:1.0:1787826418.823921:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb481683800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787826418.824007:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481683800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787826418.824088:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826418.824100:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787826418.824104:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb34b9e0800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787826418.824106:0:200551:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34b9e0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787826418.824119:0:200551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1787826418.824878:0:200551:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb4815fe840 - data ffff8eb4478d9af8/ffff8eb46e0d4c00 00000020:01000000:1.0:1787826418.825082:0:200551:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb47749ed20 - data ffff8eb4479c5d80/ffff8eb3422aac00 00000100:00080000:0.0:1787826418.875656:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826418.875668:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787826418.875690:0:200551:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8eb481afdf80 x1874663049456256/t21474836551(21474836551) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826428 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826418.875733:0:200551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787826418.878381:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787826418.878391:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 4 00000004:00080000:0.0:1787826418.878407:0:200551:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826418.878412:0:200551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787826418.878710:0:196441:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787826418.878718:0:196441:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x148:0x0] index 1 count 1 00000040:00080000:2.0:1787826418.878730:0:196441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 82 count 2 00000100:00080000:0.0:1787826418.879585:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787826418.879590:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975537 gen 4 00000004:00080000:0.0:1787826418.879610:0:200551:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826418.879612:0:200551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787826418.879846:0:196443:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787826418.879851:0:196443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14a:0x0] index 1 count 1 00000040:00080000:1.0:1787826418.879863:0:196443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 82 count 2 00000020:00000080:0.0:1787826418.882101:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceda97 00000020:00000080:0.0:1787826418.882117:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb445628000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826418.882867:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedaac 00000020:00000080:0.0:1787826418.882876:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb481226000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787826418.882882:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787826418.882899:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826418.882911:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826418.882916:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8eb341a68000) has no exports 00000004:01000000:0.0:1787826418.883096:0:200551:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787826418.883107:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedb2a 00000020:00000080:0.0:1787826418.883112:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb46e2a4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787826418.883117:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787826418.883121:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826418.883126:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787826418.883128:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8eb344e619b8) has no exports 00000020:00000080:0.0:1787826418.883135:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedb1c 00000020:00000080:0.0:1787826418.883140:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb349083000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787826418.883538:0:200551:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787826418.883544:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787826418.883548:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975537 gen 5 00000004:00080000:0.0:1787826418.883555:0:200551:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826418.883558:0:200551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826418.883608:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826418.883616:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826418.883623:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedb0e 00000020:00000080:0.0:1787826418.883628:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb481220000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787826418.883632:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787826418.883636:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826418.883639:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787826418.883641:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8eb45eb84d28) has no exports 00000020:00000080:0.0:1787826418.883645:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedb07 00000020:00000080:0.0:1787826418.883648:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb448c38000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787826418.883994:0:200551:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787826418.883999:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787826418.884001:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 5 00000004:00080000:0.0:1787826418.884005:0:200551:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787826418.884007:0:200551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826418.884032:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826418.884037:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787826418.884050:0:200551:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787826418.884057:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedaf2 00000020:00000080:0.0:1787826418.884062:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb448c3d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787826418.884066:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787826418.884069:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826418.884072:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787826418.884074:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8eb47a434d28) has no exports 00000020:00000080:0.0:1787826418.884079:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedaeb 00000020:00000080:0.0:1787826418.884082:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb45ec34800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787826418.885230:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb445628000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826418.885248:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481226000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787826418.885256:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e2a4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787826418.885262:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb349083000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826418.885268:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb349083800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787826418.885277:0:188541:0:(genops.c:885:class_export_put()) final put ffff8eb481224800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826418.885279:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481224800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787826418.885285:0:188541:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826418.885417:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481220000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787826418.885425:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c38000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826418.885429:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb45a03b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787826418.885433:0:188541:0:(genops.c:885:class_export_put()) final put ffff8eb481222000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826418.885435:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481222000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787826418.885439:0:188541:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826418.885469:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c3d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787826418.885474:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb45ec34800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787826418.886098:0:200551:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787826418.886104:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787826418.886108:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787826418.886115:0:200551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787826418.886185:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826418.886197:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826418.886234:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826418.886238:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826418.886242:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb45ec31000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826418.886246:0:200551:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb45ec31000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787826418.886251:0:200551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826418.886373:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedab3 00000020:00000080:1.0:1787826418.886381:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb481224000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787826418.886387:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787826418.886391:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826418.886396:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787826418.886400:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8eb47a430000) has no exports 00000020:00000080:1.0:1787826418.886422:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826418.886426:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787826418.886430:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedaba 00000020:00000080:1.0:1787826418.886434:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb481225000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787826418.886443:0:200551:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb448c99000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787826418.886447:0:200551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb448c99000 3 00000020:01000004:1.0:1787826418.886450:0:200551:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb448c99000 from lustre-MDT0000 00000020:00000080:1.0:1787826418.886471:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826418.886475:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787826418.886477:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb44562b800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787826418.886480:0:200551:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb44562b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787826418.886487:0:200551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787826418.886526:0:200551:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787826418.886531:0:200551:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787826418.886533:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787826418.886537:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826418.886539:0:200551:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787826418.886550:0:200551:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb34c51c800 f40147eb-9b53-47d4-b77c-99ceedd9664c 192.168.203.47@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787826418.886557:0:200551:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8eb341af8800 205ad83e-e455-4070-92a2-f1e25b8f3f40 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787826418.886561:0:200551:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8eb481d9b370) has exports, disconnecting them 00000020:00080000:1.0:1787826418.886566:0:200551:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.47@tcp (ffff8eb34c51c800), last request at 1787826302 00000020:00000080:1.0:1787826418.886591:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedc3b 00000020:00010000:1.0:1787826418.886597:0:200551:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb34c51c800: total 2 00000100:00080000:1.0:1787826418.886602:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb34c51a800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826418.886617:0:200551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.47@tcp (ffff8eb34c51c800): rc 0 00000020:00080000:1.0:1787826418.886620:0:200551:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8eb341af8800), last request at 1787826300 00000020:00000080:1.0:1787826418.886668:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceda58 00000020:00010000:1.0:1787826418.886672:0:200551:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8eb341af8800: total 2 00000100:00080000:1.0:1787826418.886675:0:200551:0:(import.c:65:import_set_state_nolock()) ffff8eb341afb000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787826418.886686:0:200551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb341af8800): rc 0 00000020:00080000:1.0:1787826418.886690:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8eb481d9b370) has no exports 00000100:00100000:2.0:1787826418.886808:0:196429:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8eb481133800:196429] 2 exiting: rc = 0 00000100:00100000:2.0:1787826418.886949:0:196428:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8eb47740e600:196428] 1 exiting: rc = 0 00000020:00000080:2.0:1787826418.886997:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb45ec36000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787826418.887004:0:188541:0:(genops.c:885:class_export_put()) final put ffff8eb481223000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826418.887007:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481223000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787826418.887011:0:188541:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826418.887064:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481224000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787826418.887068:0:188541:0:(genops.c:885:class_export_put()) final put ffff8eb481220800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787826418.887070:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481220800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787826418.887075:0:188541:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787826418.887100:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb481225000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1787826418.888392:0:66923:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb34c51c800: total 0 00010000:00010000:1.0:1787826418.888458:0:66923:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb34c51c800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1787826418.888505:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64000/0x878a5eea00cedc5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f23c expref: 5 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888529:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb441511400/0x878a5eea00cee7f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f38c expref: 4 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888543:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64e00/0x878a5eea00cedc57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f235 expref: 3 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888555:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65e00/0x878a5eea00cedc65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xbef42c0221d6f243 expref: 2 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888564:0:66923:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb34c51c800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1787826418.888586:0:66923:0:(genops.c:885:class_export_put()) final put ffff8eb34c51c800/f40147eb-9b53-47d4-b77c-99ceedd9664c 00000020:00010000:1.0:1787826418.888598:0:66923:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8eb341af8800: total 1 00010000:00010000:1.0:1787826418.888602:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.888617:0:66923:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8eb341af8800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787826418.888633:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb441356200/0x878a5eea00cee7a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee79b expref: 14 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888651:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb441510a00/0x878a5eea00cee7e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee7da expref: 13 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888669:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb441511a00/0x878a5eea00cee6ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee6e5 expref: 12 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888694:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb481ce3200/0x878a5eea00cedb9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedb93 expref: 11 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888705:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf39200/0x878a5eea00cedbfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedbf5 expref: 10 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888715:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a568e00/0x878a5eea00cedb8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedb85 expref: 9 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888727:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a568400/0x878a5eea00cedc0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedc03 expref: 8 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888738:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65c00/0x878a5eea00cedc18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedc11 expref: 7 pid: 196428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888749:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34ab18c00/0x878a5eea00cee6fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee6f3 expref: 6 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888760:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d64c00/0x878a5eea00cedba8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedba1 expref: 5 pid: 196429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888773:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb441356c00/0x878a5eea00cee7b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cee7b0 expref: 4 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888788:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cedc26 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedc1f expref: 3 pid: 196427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888800:0:66923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb480d65a00/0x878a5eea00cedc34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x878a5eea00cedc2d expref: 2 pid: 196434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.888811:0:66923:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8eb341af8800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787826418.888823:0:66923:0:(genops.c:885:class_export_put()) final put ffff8eb341af8800/205ad83e-e455-4070-92a2-f1e25b8f3f40 00010000:00010000:1.0:1787826418.888827:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.888829:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.888831:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826418.888842:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826418.888943:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c51c800/f40147eb-9b53-47d4-b77c-99ceedd9664c for MGS 00000020:00000080:2.0:1787826418.888990:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb341af8800/205ad83e-e455-4070-92a2-f1e25b8f3f40 for MGS 00000020:00000080:2.0:1787826418.889010:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb34c51a800 for MGS 00000020:00000080:2.0:1787826418.889014:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb341afb000 for MGS 00000100:00100000:2.0:1787826418.889414:0:196427:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8eb342773a00:196427] 0 exiting: rc = 1 00000100:00100000:0.0:1787826418.896548:0:196434:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8eb450978600:196434] 3 exiting: rc = 0 00000100:00100000:1.0:1787826418.896817:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896833:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896841:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896847:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896854:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896860:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896865:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896872:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896878:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896884:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896899:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896906:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896913:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896919:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896925:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896932:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896937:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896943:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896948:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896955:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896961:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896967:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896973:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896978:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896984:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896990:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.896996:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897002:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897007:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897012:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897018:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897024:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897029:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897035:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897041:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897046:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897052:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897058:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897064:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897070:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897076:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897088:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897097:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897103:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897110:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897115:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897121:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897126:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897132:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897137:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897142:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.897148:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898468:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898491:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898501:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898508:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898514:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898522:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898528:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898537:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898546:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898552:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898558:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787826418.898564:0:200551:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787826418.899722:0:200551:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb4815fe4e0 - data ffff8eb447ad6a20/ffff8eb345600400 00000020:01000000:2.0:1787826418.899871:0:200551:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8eb47a5a4c60 - data ffff8eb44795eaf8/ffff8eb34daf4800 00000020:00000080:2.0:1787826418.900406:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceda51 00000020:00000080:2.0:1787826418.900418:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb34c519800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787826418.900431:0:200551:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb448c99000 from MGS, refs=2 00000020:01000004:2.0:1787826418.900435:0:200551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb448c99000 2 00000020:01000004:2.0:1787826418.900439:0:200551:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8eb448c99000 from MGS 00000020:00000080:2.0:1787826418.900468:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826418.900476:0:200551:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787826418.900478:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb34c518000/MGS 00000020:00000080:2.0:1787826418.900481:0:200551:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c518000/MGS for MGS 00000020:01000000:2.0:1787826418.900492:0:200551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787826418.900599:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787826418.900602:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826418.900609:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787826418.900617:0:200551:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8eb44908d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787826418.900624:0:200551:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8eb48145cd28) has exports, disconnecting them 00000020:00080000:2.0:1787826418.900629:0:200551:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8eb44908d000), last request at 1787826301 00000020:00000080:2.0:1787826418.900633:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cedb69 00000020:00080000:2.0:1787826418.900641:0:200551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8eb44908d000): rc 0 00000020:00000080:2.0:1787826418.900647:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb44908d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787826418.901095:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c519800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787826418.901103:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb44908d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787826418.904940:0:200551:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787826418.904953:0:200551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787826418.904958:0:200551:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787826418.904968:0:200551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826418.905207:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826418.905221:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787826418.905229:0:200551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb448c99000 1 00000020:00000080:2.0:1787826418.905238:0:200551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00ceda43 00000020:00000080:1.0:1787826418.905289:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb348a38000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787826418.905301:0:179516:0:(genops.c:885:class_export_put()) final put ffff8eb34c997000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787826418.905306:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c997000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787826418.905322:0:179516:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787826418.905755:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb34c51d000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787826418.905797:0:200551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787826418.905802:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826418.905807:0:200551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787826418.905812:0:200551:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8eb341a699b8) has no exports 00000020:00000080:1.0:1787826418.906073:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb34c51d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826418.954987:0:200551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826418.955010:0:200551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787826418.955017:0:200551:0:(genops.c:885:class_export_put()) final put ffff8eb448c98000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787826418.955023:0:200551:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb448c98000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787826418.955039:0:200551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787826418.955215:0:200551:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8eb448c98800 00000020:02000400:2.0:1787826418.955654:0:200551:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787826419.541076:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826420.565636:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826421.077269:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826421.077301:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049456640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826421.077422:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826421.077490:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049456640 00000100:00100000:0.0:1787826421.077511:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049456640 00000100:00100000:0.0:1787826421.077569:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787826421.077580:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874663049456640:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787826421.077590:0:187910:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787826421.077642:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1874663049456640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (219us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826421.077650:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:02020000:0.0:1787826421.077903:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1787826421.077911:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826421.077917:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826421.077922:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826421.077931:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826421.077936:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8482 00000100:00080000:0.0:1787826421.077945:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb341ac8800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826421.077974:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481aff100 x1874663049456768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826421.078053:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049456768:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787826421.078094:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826421.078263:0:199731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049456768 00000100:00100000:0.0:1787826421.078268:0:199731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049456768 00000100:00100000:0.0:1787826421.078302:0:199731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787826421.078309:0:199731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1874663049456768:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1787826421.078358:0:199731:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826421.078404:0:199731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1874663049456768:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 94us (308us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826421.078412:0:199731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787826421.078445:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826421.078450:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826421.078456:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049456768:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787826421.082100:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049456896:0@lo:400:kworker.0 00000400:00000100:0.0:1787826421.082195:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049456896 offset 0 length 224: 4 00000100:00100000:1.0:1787826421.083390:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049457280:0@lo:400:kworker.0 00000100:00100000:1.0:1787826421.083465:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826421.083679:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049457280 00000100:00100000:3.0:1787826421.083689:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049457280 00000100:00100000:3.0:1787826421.083755:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1787826421.083764:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1874663049457280:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787826421.083775:0:187904:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826421.083838:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1874663049457280:12345-0@lo:400:kworker.0 Request processed in 73us (372us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826421.083846:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00080000:3.0:1787826421.083913:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787826421.083919:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787826421.083924:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787826421.084448:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826421.084454:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8373 00000100:00080000:3.0:1787826421.084464:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826421.084513:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46e86a300 x1874663049457408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826421.084547:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1874663049457280:0@lo:400:kworker.0 00000100:00100000:1.0:1787826421.084670:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049457408:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787826421.084729:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826421.084853:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049457408 00000100:00100000:3.0:1787826421.084859:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049457408 00000100:00100000:3.0:1787826421.084903:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1787826421.084910:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049457408:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787826421.084943:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826421.084988:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049457408:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 77us (260us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826421.084994:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00080000:3.0:1787826421.085022:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826421.085027:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826421.085030:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049457408:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787826421.085804:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049457152:0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.085859:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826421.085944:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826421.085953:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049457024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.085981:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826421.090282:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049457792:0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.090387:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826421.090414:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826421.090422:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049457664:0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.090451:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826421.090584:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049457792 00000100:00100000:0.0:1787826421.090594:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049457792 00000100:00100000:0.0:1787826421.090666:0:179223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049457664 00000100:00100000:0.0:1787826421.090669:0:179223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049457664 00000100:00100000:0.0:1787826421.090701:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7217 00000100:00100000:0.0:1787826421.090782:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049457792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.090850:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049457792:12345-0@lo:400:kworker.0 Request processed in 72us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.090858:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7217 00000100:00100000:0.0:1787826421.091139:0:179223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7218 00000100:00100000:0.0:1787826421.091148:0:179223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049457664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.091184:0:179223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049457664:12345-0@lo:400:kworker.0 Request processed in 38us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.091191:0:179223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7218 00000100:00080000:0.0:1787826421.091217:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826421.091222:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826421.091272:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049457664:0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.091285:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049457792:0@lo:400:kworker.0 00000100:00100000:3.0:1787826421.091666:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049457920:0@lo:400:kworker.0 00000100:00100000:3.0:1787826421.091722:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826421.091908:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049457152 00000100:00100000:1.0:1787826421.091916:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049457152 00000100:00100000:1.0:1787826421.091976:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049457024 00000100:00100000:1.0:1787826421.091980:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049457024 00000100:00100000:1.0:1787826421.092001:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1787826421.092010:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049457152:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826421.092032:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481aff100 x1874663049457152/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:22/0 lens 224/224 e 0 to 0 dl 1787826432 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826421.092085:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1874663049457152:12345-0@lo:400:kworker.0 Request processed in 77us (6224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826421.092092:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1787826421.092110:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1787826421.092115:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1874663049457024:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826421.092122:0:187905:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826421.092152:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1874663049457024:12345-0@lo:400:kworker.0 Request processed in 36us (6171us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826421.092158:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00080000:1.0:1787826421.092386:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826421.093311:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826421.093319:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1787826421.093381:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049457536:0@lo:400:kworker.0 00000100:02000400:0.0:1787826421.093488:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826421.093571:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826421.093579:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8373 00000100:00080000:0.0:1787826421.093588:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826421.093633:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb476e73480 x1874663049458048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826421.093713:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049458048:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787826421.094008:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1874663049457024:0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.094038:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1874663049457152:0@lo:400:kworker.0 00000100:00100000:1.0:1787826421.094264:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049457920 00000100:00100000:1.0:1787826421.094274:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049457920 00000100:00100000:1.0:1787826421.094340:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1787826421.094350:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1874663049457920:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826421.094360:0:188682:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826421.094493:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826421.094563:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049458048 00000100:00100000:2.0:1787826421.094568:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049458048 00000100:00100000:2.0:1787826421.094594:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1787826421.094600:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049458048:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1787826421.094627:0:188992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826421.094674:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1874663049458048:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 72us (181us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826421.094681:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00080000:2.0:1787826421.094733:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826421.094739:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826421.094743:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049458048:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787826421.098961:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826421.099094:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049457536 00000100:00100000:0.0:1787826421.099106:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049457536 00000100:00100000:0.0:1787826421.099202:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1787826421.099214:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049457536:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826421.099249:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb476e73800 x1874663049457536/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:22/0 lens 224/224 e 0 to 0 dl 1787826432 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826421.099344:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874663049457536:12345-0@lo:400:kworker.0 Request processed in 133us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.099353:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1787826421.099421:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1874663049457536:0@lo:400:kworker.0 00000100:00080000:0.0:1787826421.101573:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826421.102183:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1874663049457920:12345-0@lo:400:kworker.0 Request processed in 7821us (10448us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826421.102201:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00080000:2.0:1787826421.111122:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826421.111135:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826421.111142:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787826421.111149:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826421.111155:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8437 00000100:00080000:2.0:1787826421.111167:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb47f7e6800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826421.111228:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb448cd7b80 x1874663049458176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826421.111275:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874663049457920:0@lo:400:kworker.0 00000100:00100000:0.0:1787826421.111425:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049458176:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787826421.111531:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826421.111689:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049458176 00000100:00100000:2.0:1787826421.111699:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049458176 00000100:00100000:2.0:1787826421.111763:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1787826421.111772:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049458176:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787826421.111799:0:187906:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826421.111859:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049458176:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 86us (327us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826421.111867:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00080000:2.0:1787826421.111918:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826421.111922:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826421.111926:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb448cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049458176:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1787826421.590718:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826422.100930:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb476d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049458304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826422.101031:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826422.101401:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049458304 00000100:00100000:3.0:1787826422.101416:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049458304 00000100:00100000:0.0:1787826422.101446:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049458432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826422.101500:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5948 00000100:00100000:3.0:1787826422.101514:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049458304:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826422.101532:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787826422.101560:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826422.101645:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049458304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.101648:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049458432 00000100:00100000:3.0:1787826422.101661:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5948 00000100:00100000:2.0:1787826422.101664:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049458432 00000100:00100000:0.0:1787826422.101750:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049458304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826422.101753:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5949 00000100:00100000:2.0:1787826422.101919:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049458432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826422.101969:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1787826422.102043:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049458432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.102621:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049458432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826422.112108:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5949 00010000:00010000:1.0:1787826422.614165:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1787826423.546567:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663043069696 offset 0 length 224: 4 00000100:00100000:1.0:1787826423.554658:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826423.554881:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826423.554927:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826423.555111:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826423.555148:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043070080 00000100:00100000:1.0:1787826423.555157:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043070080 00000100:00100000:1.0:1787826423.555216:0:43895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043070208 00000100:00100000:1.0:1787826423.555219:0:43895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043070208 00000100:00100000:1.0:1787826423.555247:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7219 00000100:00100000:1.0:1787826423.555258:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043070080:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826423.555344:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043070080:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 66us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.555353:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7219 00000100:00100000:1.0:1787826423.555372:0:43895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7220 00000100:00100000:1.0:1787826423.555379:0:43895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043070208:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1787826423.555417:0:43895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2392:x1874663043070208:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.555423:0:43895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7220 00000100:00080000:1.0:1787826423.555459:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826423.555464:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826423.561686:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043069824 00000100:00100000:2.0:1787826423.561710:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043069824 00000100:00100000:2.0:1787826423.561768:0:188992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043069952 00000100:00100000:2.0:1787826423.561773:0:188992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043069952 00000100:00100000:2.0:1787826423.561832:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 491 00000100:00100000:2.0:1787826423.561844:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043069952:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:2.0:1787826423.561884:0:188992:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb476d32680 x1874663043069952/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:38/0 lens 224/224 e 0 to 0 dl 1787826448 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826423.561961:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043069952:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 120us (7034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.561968:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 491 00000100:00100000:2.0:1787826423.561986:0:188992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1290 00000100:00100000:2.0:1787826423.561990:0:188992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2391:x1874663043069824:12345-192.168.203.47@tcp:400:kworker.0 00000020:00080000:2.0:1787826423.561997:0:188992:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.47@tcp 00000100:00100000:2.0:1787826423.562020:0:188992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2391:x1874663043069824:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (7372us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787826423.562026:0:188992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1290 00000100:00080000:3.0:1787826423.562544:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826423.568818:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826423.569100:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043070336 00000100:00100000:0.0:1787826423.569110:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043070336 00000100:00100000:0.0:1787826423.569163:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1291 00000100:00100000:0.0:1787826423.569171:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663043070336:12345-192.168.203.47@tcp:38:ptlrpcd_01_00.0 00010000:00020000:0.0:1787826423.569195:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826423.569260:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34dde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663043070336:12345-192.168.203.47@tcp:38:ptlrpcd_01_00.0 Request processed in 88us (452us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826423.569267:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1291 00010000:00010000:1.0:1787826423.636737:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826424.148700:0:198805:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787826424.148726:0:198805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x878a5eea00cef031 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826424.148900:0:198805:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 3/0,0 mode: PW/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x878a5eea00cef031 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.148945:0:198805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 2/0,0 mode: --/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cef031 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.148953:0:198805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826424.148972:0:198805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8eb34bf39600/0x878a5eea00cef02a lrc: 0/0,0 mode: --/PW res: [0x200027cd1:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x878a5eea00cef031 expref: -99 pid: 188682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826424.148993:0:198805:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836551 is committed 00000020:00000080:2.0:1787826424.148996:0:198805:0:(genops.c:885:class_export_put()) final put ffff8eb342757800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826424.149038:0:179516:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb342757800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787826424.149149:0:179516:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb472781800 for lustre-MDT0001 00000100:00080000:0.0:1787826424.149362:0:3620:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8eb448cd5180 x1874663049458560/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000001:00100000:1.0:1787826424.150609:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826424.150616:0:9485:0:(genops.c:885:class_export_put()) final put ffff8eb46e2a1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826424.150764:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb46e2a1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787826424.152141:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb46e2a3800 for lustre-OST0001 00000001:00100000:1.0:1787826424.152269:0:194610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787826424.152274:0:194610:0:(genops.c:885:class_export_put()) final put ffff8eb349086000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787826424.152641:0:188541:0:(genops.c:844:class_export_destroy()) destroying export ffff8eb349086000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787826424.152801:0:188541:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8eb349080000 for lustre-OST0000 00010000:00010000:1.0:1787826424.660587:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826425.684508:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826426.198258:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826426.198266:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826426.198269:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826426.198277:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8487 00000100:00080000:3.0:1787826426.198283:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826426.198289:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826426.198312:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46e86b480 x1874663049458816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826426.198369:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826426.198390:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049458688:0@lo:400:kworker.0 00000100:00080000:3.0:1787826426.198396:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826426.198400:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826426.198402:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826426.198406:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8487 00000100:00080000:3.0:1787826426.198410:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826426.198415:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826426.198430:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb46e86a680 x1874663049459072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1787826426.198447:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049458688 offset 0 length 224: 4 00000100:00080000:3.0:1787826426.198461:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826426.198466:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826426.198468:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826426.198473:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8487 00000100:00080000:3.0:1787826426.198475:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826426.198479:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb341ac8800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826426.198494:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb472975c00 x1874663049459328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826426.198504:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049458944:0@lo:400:kworker.0 00000100:00080000:3.0:1787826426.198523:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826426.198528:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826426.198530:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826426.198534:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8487 00000100:00080000:3.0:1787826426.198536:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1787826426.198542:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826426.198544:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb47f7e6800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826426.198564:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb472974e00 x1874663049459712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826426.198567:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826426.198576:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049459584:0@lo:400:kworker.0 00000100:00100000:3.0:1787826426.198612:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049459200:0@lo:400:kworker.0 00000100:00100000:0.0:1787826426.198618:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826426.198623:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049458944 00000100:00100000:1.0:1787826426.198632:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049458944 00000100:00100000:3.0:1787826426.198654:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826426.198662:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049459584 00000100:00100000:0.0:1787826426.198667:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049459584 00000100:00100000:3.0:1787826426.198685:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826426.198694:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049459456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826426.198699:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049459200 00000100:00100000:1.0:1787826426.198704:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049459200 00000100:00100000:0.0:1787826426.198713:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7221 00000100:00100000:3.0:1787826426.198725:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826426.198736:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1787826426.198747:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049458944:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826426.198772:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb476e71880 x1874663049458944/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:41/0 lens 224/224 e 0 to 0 dl 1787826451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826426.198781:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1787826426.198790:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb476e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049459584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826426.198799:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049459200:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787826426.198816:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472976300 x1874663049459200/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:41/0 lens 224/224 e 0 to 0 dl 1787826451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826426.198825:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874663049458944:12345-0@lo:400:kworker.0 Request processed in 78us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.198837:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb476e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049459584:12345-0@lo:400:kworker.0 Request processed in 113us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.198867:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7221 00000100:00100000:1.0:1787826426.198867:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1787826426.198880:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874663049459200:12345-0@lo:400:kworker.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826426.198890:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1787826426.198893:0:43897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049459456 00000100:00100000:0.0:1787826426.198897:0:43897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049459456 00000100:00100000:2.0:1787826426.198918:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049458816:0@lo:38:kworker.0 00000100:00100000:1.0:1787826426.198927:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049459584:0@lo:400:kworker.0 00000100:00080000:3.0:1787826426.198930:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826426.198933:0:43897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7222 00000100:00080000:3.0:1787826426.198938:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826426.198944:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826426.198945:0:43897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb4607f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049459456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826426.198947:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1874663049458944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826426.198960:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826426.198976:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1874663049459200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826426.198992:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049459072:0@lo:38:kworker.0 00000100:00100000:0.0:1787826426.198998:0:43897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb4607f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049459456:12345-0@lo:400:kworker.0 Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826426.199006:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049459456:0@lo:400:kworker.0 00000100:00100000:0.0:1787826426.199007:0:43897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7222 00000100:00100000:2.0:1787826426.199027:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826426.199049:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049459328:0@lo:38:kworker.0 00000100:00100000:2.0:1787826426.199072:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826426.199095:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049459712:0@lo:38:kworker.0 00000100:00100000:2.0:1787826426.199114:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826426.199170:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049458816 00000100:00100000:3.0:1787826426.199175:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049458816 00000100:00100000:3.0:1787826426.199205:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049459072 00000100:00100000:3.0:1787826426.199209:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049459072 00000100:00100000:3.0:1787826426.199223:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049459712 00000100:00100000:3.0:1787826426.199225:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049459712 00000100:00100000:3.0:1787826426.199236:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1787826426.199246:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049458816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826426.199264:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826426.199295:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049458816:12345-0@lo:38:kworker.0 Request processed in 47us (337us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826426.199302:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1787826426.199315:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1787826426.199319:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049459072:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826426.199352:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826426.199373:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049459328 00000100:00100000:3.0:1787826426.199380:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049459072:12345-0@lo:38:kworker.0 Request processed in 58us (354us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826426.199381:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049459328 00000100:00100000:3.0:1787826426.199389:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1787826426.199404:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1787826426.199408:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049459712:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787826426.199413:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00010000:00020000:3.0:1787826426.199420:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826426.199421:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1874663049459328:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826426.199435:0:187909:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826426.199448:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1874663049459712:12345-0@lo:38:kworker.0 Request processed in 37us (331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826426.199455:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1787826426.199473:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1874663049459328:12345-0@lo:38:kworker.0 Request processed in 51us (399us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826426.199480:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1787826426.199607:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826426.199612:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826426.199616:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049458816:0@lo:38:kworker.0 00000100:00080000:2.0:1787826426.199625:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826426.199628:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826426.199631:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049459072:0@lo:38:kworker.0 00000100:00080000:2.0:1787826426.199638:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826426.199641:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826426.199644:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049459328:0@lo:38:kworker.0 00000100:00080000:2.0:1787826426.199651:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826426.199654:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826426.199656:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049459712:0@lo:38:kworker.0 00010000:00010000:1.0:1787826426.709062:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826427.220526:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826427.220543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049459840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826427.220608:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826427.220824:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049459968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826427.220863:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826427.220929:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049459840 00000100:00100000:3.0:1787826427.220937:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049459840 00000100:00100000:3.0:1787826427.220981:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049459968 00000100:00100000:3.0:1787826427.220984:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049459968 00000100:00100000:3.0:1787826427.221005:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5950 00000100:00100000:3.0:1787826427.221015:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049459840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826427.221044:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826427.221091:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874663049459840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826427.221098:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5950 00000100:00100000:3.0:1787826427.221126:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5951 00000100:00100000:3.0:1787826427.221133:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049459968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826427.221147:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826427.221249:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1874663049459840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826427.223855:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049459968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2323us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826427.223868:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5951 00000100:00100000:2.0:1787826427.223943:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049459968:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787826427.732881:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1787826428.670535:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663043070464 offset 0 length 224: 4 00000100:00100000:2.0:1787826428.670585:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826428.670686:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043070592 00000100:00100000:3.0:1787826428.670706:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043070592 00000100:00100000:3.0:1787826428.670771:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1295 00000100:00100000:3.0:1787826428.670780:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663043070592:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:3.0:1787826428.670803:0:187905:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826428.670884:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1874663043070592:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 103us (298us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826428.670891:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1295 00000100:00100000:3.0:1787826428.674037:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826428.674134:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043070720 00000100:00100000:1.0:1787826428.674144:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043070720 00000100:00100000:1.0:1787826428.674216:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 494 00000100:00100000:1.0:1787826428.674227:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043070720:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:1.0:1787826428.674254:0:187906:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af9500 x1874663043070720/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:29/0 lens 224/224 e 0 to 0 dl 1787826439 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826428.674319:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043070720:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826428.674357:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 494 00000100:00080000:3.0:1787826428.674418:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826428.687212:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826428.687252:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1787826428.687348:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043070976 00000100:00100000:3.0:1787826428.687358:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043070976 00000100:00100000:3.0:1787826428.687430:0:43903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043070848 00000100:00100000:3.0:1787826428.687434:0:43903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043070848 00000100:00100000:3.0:1787826428.687467:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7223 00000100:00100000:3.0:1787826428.687480:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043070976:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.687561:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043070976:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 84us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.687569:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7223 00000100:00100000:3.0:1787826428.687585:0:43903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7224 00000100:00100000:3.0:1787826428.687592:0:43903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043070848:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1787826428.687617:0:43903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2391:x1874663043070848:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.687623:0:43903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7224 00000100:00080000:0.0:1787826428.688397:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826428.688402:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826428.759102:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826429.781013:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826430.804847:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826431.317441:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826431.317451:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826431.317455:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826431.317465:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8493 00000100:00080000:0.0:1787826431.317472:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826431.317479:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826431.317508:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69d880 x1874663049460224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826431.317533:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826431.317536:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826431.317537:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826431.317541:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8493 00000100:00080000:0.0:1787826431.317543:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826431.317548:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826431.317558:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69e300 x1874663049460480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826431.317572:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826431.317575:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826431.317577:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826431.317581:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8493 00000100:00080000:0.0:1787826431.317584:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826431.317588:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb341ac8800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826431.317611:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69c000 x1874663049460736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826431.317632:0:188541:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826431.317635:0:188541:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826431.317637:0:188541:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826431.317640:0:188541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8493 00000100:00080000:0.0:1787826431.317642:0:188541:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787826431.317646:0:188541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb47f7e6800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826431.317655:0:188541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34c69ce00 x1874663049461120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826431.317686:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb46a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049460096:0@lo:400:kworker.0 00000400:00000100:0.0:1787826431.317755:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049460096 offset 0 length 224: 4 00000100:00100000:0.0:1787826431.317824:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049460992:0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.317861:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826431.317893:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826431.317898:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049460864:0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.317921:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826431.317948:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049460352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.317976:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826431.317997:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826431.318003:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049460608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.318026:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826431.318060:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049460992 00000100:00100000:0.0:1787826431.318070:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049460992 00000100:00100000:0.0:1787826431.318132:0:177402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049460864 00000100:00100000:0.0:1787826431.318136:0:177402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049460864 00000100:00100000:0.0:1787826431.318165:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7225 00000100:00100000:0.0:1787826431.318177:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049460992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.318240:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049460992:12345-0@lo:400:kworker.0 Request processed in 64us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826431.318248:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7225 00000100:00100000:0.0:1787826431.318269:0:177402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7226 00000100:00100000:0.0:1787826431.318275:0:177402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049460864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.318560:0:177402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049460864:12345-0@lo:400:kworker.0 Request processed in 284us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826431.318567:0:177402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7226 00000100:00100000:0.0:1787826431.318722:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049460352 00000100:00100000:0.0:1787826431.318727:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049460352 00000100:00100000:0.0:1787826431.318762:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049460608 00000100:00100000:0.0:1787826431.318765:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049460608 00000100:00100000:0.0:1787826431.318792:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1787826431.318800:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049460352:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826431.318827:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69f100 x1874663049460352/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:32/0 lens 224/224 e 0 to 0 dl 1787826442 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826431.318913:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049460352:12345-0@lo:400:kworker.0 Request processed in 115us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826431.318920:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1787826431.318933:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1787826431.318940:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049460608:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787826431.318950:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69d500 x1874663049460608/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:32/0 lens 224/224 e 0 to 0 dl 1787826442 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826431.318976:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049460608:12345-0@lo:400:kworker.0 Request processed in 37us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826431.318981:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00080000:0.0:1787826431.319000:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826431.319006:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826431.319009:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826431.319058:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049460608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.319072:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049460352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.319110:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049460864:0@lo:400:kworker.0 00000100:00100000:0.0:1787826431.319119:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049460992:0@lo:400:kworker.0 00000100:00100000:2.0:1787826431.319291:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049460224:0@lo:38:kworker.0 00000100:00100000:2.0:1787826431.319370:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826431.319398:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049460480:0@lo:38:kworker.0 00000100:00100000:2.0:1787826431.319429:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826431.319448:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049460736:0@lo:38:kworker.0 00000100:00100000:2.0:1787826431.319473:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826431.319494:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049461120:0@lo:38:kworker.0 00000100:00100000:2.0:1787826431.319521:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826431.319561:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049460224 00000100:00100000:2.0:1787826431.319566:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049460224 00000100:00100000:2.0:1787826431.319584:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049460480 00000100:00100000:2.0:1787826431.319587:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049460480 00000100:00100000:2.0:1787826431.319605:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049461120 00000100:00100000:2.0:1787826431.319608:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049461120 00000100:00100000:2.0:1787826431.319621:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1787826431.319626:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb448cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049460224:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826431.319648:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826431.319693:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb448cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049460224:12345-0@lo:38:kworker.0 Request processed in 65us (323us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826431.319701:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1787826431.319717:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1787826431.319722:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049460480:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826431.319731:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826431.319759:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049460480:12345-0@lo:38:kworker.0 Request processed in 36us (330us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826431.319766:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1787826431.319780:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1787826431.319784:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049461120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826431.319793:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826431.319831:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049461120:12345-0@lo:38:kworker.0 Request processed in 45us (309us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826431.320109:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1787826431.320137:0:199731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049460736 00000100:00100000:2.0:1787826431.320154:0:199731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049460736 00000100:00100000:2.0:1787826431.320182:0:199731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787826431.320188:0:199731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1874663049460736:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826431.320200:0:199731:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826431.320239:0:199731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb479841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1874663049460736:12345-0@lo:38:kworker.0 Request processed in 49us (763us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826431.320247:0:199731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1787826431.320313:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826431.320320:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826431.320350:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049460224:0@lo:38:kworker.0 00000100:00080000:2.0:1787826431.320363:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826431.320367:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826431.320369:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049460480:0@lo:38:kworker.0 00000100:00080000:2.0:1787826431.320378:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826431.320381:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826431.320384:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049460736:0@lo:38:kworker.0 00000100:00080000:2.0:1787826431.320398:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826431.320402:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826431.320406:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049461120:0@lo:38:kworker.0 00010000:00010000:1.0:1787826431.829779:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826432.340487:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826432.340504:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34c69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049461248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826432.340587:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826432.340643:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049461248 00000100:00100000:3.0:1787826432.340653:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049461248 00000100:00100000:3.0:1787826432.340711:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5952 00000100:00100000:3.0:1787826432.340722:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049461248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826432.340754:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1787826432.340820:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049461248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826432.340829:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5952 00000100:00100000:0.0:1787826432.340850:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34c69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049461248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826432.342444:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049461376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826432.342502:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826432.343547:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049461376 00000100:00100000:0.0:1787826432.343558:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049461376 00000100:00100000:0.0:1787826432.343609:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5953 00000100:00100000:0.0:1787826432.343619:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049461376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826432.343647:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826432.343712:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049461376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826432.343724:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5953 00000100:00100000:1.0:1787826432.344179:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049461376:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787826432.854158:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1787826433.788158:0:3610:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.47@tcp portal 26 match 1874663043071104 offset 0 length 224: 4 00000100:00100000:0.0:1787826433.788205:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826433.788245:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826433.788287:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826433.788314:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043071360 00000100:00100000:1.0:1787826433.788356:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043071360 00000100:00100000:0.0:1787826433.788367:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826433.788401:0:151857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043071488 00000100:00100000:0.0:1787826433.788406:0:151857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043071488 00000100:00100000:1.0:1787826433.788419:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043071232 00000100:00100000:1.0:1787826433.788424:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043071232 00000100:00100000:1.0:1787826433.788442:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 497 00000100:00100000:1.0:1787826433.788452:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043071360:12345-192.168.203.47@tcp:400:kworker.0 00010000:00000080:1.0:1787826433.788479:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69dc00 x1874663043071360/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:34/0 lens 224/224 e 0 to 0 dl 1787826444 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826433.788530:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2392:x1874663043071360:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.788537:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 497 00000100:00100000:1.0:1787826433.788553:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1299 00000100:00100000:1.0:1787826433.788557:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663043071232:12345-192.168.203.47@tcp:38:kworker.0 00010000:00020000:1.0:1787826433.788576:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826433.788593:0:43898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043071616 00000100:00100000:3.0:1787826433.788599:0:43898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043071616 00000100:00100000:1.0:1787826433.788600:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663043071232:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 40us (353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826433.788608:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1299 00000100:00100000:3.0:1787826433.788713:0:43898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22665 00000100:00100000:3.0:1787826433.788723:0:43898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2388:x1874663043071616:12345-192.168.203.47@tcp:9:kworker.0 00000100:00080000:1.0:1787826433.788728:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826433.788735:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1787826433.788744:0:43898:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cee954 00000100:00080000:3.0:1787826433.788753:0:43898:0:(import.c:65:import_set_state_nolock()) ffff8eb47754b000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787826433.788780:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787826433.789551:0:43898:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975558 00000100:00080000:1.0:1787826433.789584:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826433.789631:0:151857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22666 00000100:00100000:1.0:1787826433.789644:0:151857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+5:2388:x1874663043071488:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:1.0:1787826433.789662:0:151857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x878a5eea00cee94d 00000100:00080000:1.0:1787826433.789671:0:151857:0:(import.c:65:import_set_state_nolock()) ffff8eb472786800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787826433.789712:0:151857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705689 00000100:00100000:3.0:1787826433.789719:0:43898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+2:2388:x1874663043071616:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 996us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826433.789727:0:43898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22665 00000100:00100000:1.0:1787826433.789806:0:151857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+2:2388:x1874663043071488:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 166us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.789814:0:151857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22666 00010000:00010000:0.0:1787826433.789880:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826433.876667:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826434.900511:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826435.924921:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826436.436647:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826436.436655:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826436.436658:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826436.436667:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8498 00000100:00080000:2.0:1787826436.436673:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1787826436.436677:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049461504:0@lo:400:kworker.0 00000100:00080000:2.0:1787826436.436683:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826436.436706:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477df6d80 x1874663049461632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1787826436.436722:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874663049461504 offset 0 length 224: 4 00000100:00080000:2.0:1787826436.436736:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826436.436741:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826436.436743:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826436.436747:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8498 00000100:00080000:2.0:1787826436.436751:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826436.436755:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826436.436782:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826436.436783:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb477df6a00 x1874663049461888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826436.436792:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049461760:0@lo:400:kworker.0 00000100:00080000:2.0:1787826436.436824:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826436.436833:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1787826436.436833:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787826436.436838:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787826436.436840:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049462016:0@lo:400:kworker.0 00000100:00080000:2.0:1787826436.436845:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8498 00000100:00080000:2.0:1787826436.436850:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787826436.436855:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb341ac8800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826436.436873:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481af6d80 x1874663049462144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826436.436887:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826436.436917:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049462272:0@lo:400:kworker.0 00000100:00080000:2.0:1787826436.436921:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826436.436926:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826436.436928:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787826436.436932:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049461760 00000100:00080000:2.0:1787826436.436934:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8498 00000100:00080000:2.0:1787826436.436939:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1787826436.436942:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049461760 00000100:00080000:2.0:1787826436.436944:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb47f7e6800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826436.436953:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826436.436962:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481af7800 x1874663049462528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826436.436997:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049462400:0@lo:400:kworker.0 00000100:00100000:1.0:1787826436.437002:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049462016 00000100:00100000:1.0:1787826436.437007:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049462016 00000100:00100000:2.0:1787826436.437011:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049461632:0@lo:38:kworker.0 00000100:00100000:3.0:1787826436.437027:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826436.437039:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1787826436.437051:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049461760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826436.437060:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:1.0:1787826436.437079:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af9f80 x1874663049461760/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:37/0 lens 224/224 e 0 to 0 dl 1787826447 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826436.437088:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049461888:0@lo:38:kworker.0 00000100:00100000:2.0:1787826436.437124:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826436.437134:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874663049461760:12345-0@lo:400:kworker.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826436.437143:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1787826436.437146:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049462144:0@lo:38:kworker.0 00000100:00100000:3.0:1787826436.437151:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1874663049461760:0@lo:400:kworker.0 00000100:00100000:1.0:1787826436.437163:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049461632 00000100:00100000:1.0:1787826436.437168:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049461632 00000100:00100000:1.0:1787826436.437181:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049461888 00000100:00100000:2.0:1787826436.437181:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826436.437185:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049461888 00000100:00100000:1.0:1787826436.437199:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1787826436.437207:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049462016:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787826436.437217:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb472974e00 x1874663049462016/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:37/0 lens 224/224 e 0 to 0 dl 1787826447 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826436.437227:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049462528:0@lo:38:kworker.0 00000100:00100000:1.0:1787826436.437250:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049462016:12345-0@lo:400:kworker.0 Request processed in 44us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826436.437257:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1787826436.437263:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826436.437282:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049462528 00000100:00100000:1.0:1787826436.437286:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049462528 00000100:00100000:2.0:1787826436.437302:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1787826436.437380:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1787826436.437386:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049461888:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826436.437400:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826436.437401:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049462144 00000100:00100000:2.0:1787826436.437407:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049461632:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826436.437408:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049462144 00010000:00020000:2.0:1787826436.437425:0:187904:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826436.437442:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049461888:12345-0@lo:38:kworker.0 Request processed in 53us (317us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826436.437443:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787826436.437454:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049462144:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787826436.437455:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1787826436.437478:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1787826436.437480:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049461632:12345-0@lo:38:kworker.0 Request processed in 167us (423us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826436.437487:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049462528:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787826436.437493:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00010000:00020000:1.0:1787826436.437500:0:188682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1787826436.437529:0:187910:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826436.437532:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1874663049462528:12345-0@lo:38:kworker.0 Request processed in 46us (271us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826436.437539:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00080000:2.0:1787826436.437544:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826436.437550:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826436.437554:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049461632:0@lo:38:kworker.0 00000100:00080000:1.0:1787826436.437561:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826436.437570:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787826436.437576:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049462144:12345-0@lo:38:kworker.0 Request processed in 119us (394us total) trans 0 rc -19/-19 00000100:00080000:2.0:1787826436.437578:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826436.437585:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049461888:0@lo:38:kworker.0 00000100:00100000:3.0:1787826436.437590:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826436.437595:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049462016:0@lo:400:kworker.0 00000100:00080000:2.0:1787826436.437607:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826436.437613:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826436.437617:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049462144:0@lo:38:kworker.0 00000100:00080000:2.0:1787826436.437627:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826436.437632:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826436.437634:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049462528:0@lo:38:kworker.0 00000100:00100000:3.0:1787826436.437804:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049462272 00000100:00100000:3.0:1787826436.437809:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049462272 00000100:00100000:3.0:1787826436.437847:0:8723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049462400 00000100:00100000:3.0:1787826436.437850:0:8723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049462400 00000100:00080000:1.0:1787826436.437863:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826436.437867:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826436.437876:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7227 00000100:00100000:3.0:1787826436.437884:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049462272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826436.437929:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049462272:12345-0@lo:400:kworker.0 Request processed in 46us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826436.437936:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7227 00000100:00100000:3.0:1787826436.437948:0:8723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7228 00000100:00100000:3.0:1787826436.437955:0:8723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049462400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826436.437989:0:8723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1874663049462400:12345-0@lo:400:kworker.0 Request processed in 35us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826436.437995:0:8723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7228 00000100:00100000:1.0:1787826436.438371:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049462272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826436.438391:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1874663049462400:0@lo:400:kworker.0 00010000:00010000:0.0:1787826436.948922:0:9495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787826437.016553:0:201169:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787826437.016558:0:201169:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787826437.016559:0:201169:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787826437.016703:0:201169:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8eb449082000 00000020:01000004:3.0:1787826437.016718:0:201169:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787826437.016740:0:201169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787826437.016754:0:201169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8eb344e619b8) 00000020:00000080:3.0:1787826437.016779:0:201169:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787826437.080016:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787826437.081047:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787826437.081952:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787826437.082375:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.082818:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787826437.083066:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.083307:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787826437.083614:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787826437.083836:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.084081:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787826437.084297:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.084607:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.084814:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787826437.085062:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.089806:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.091558:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.091890:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.092082:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.092467:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.092697:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.092886:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.093093:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.093282:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.093548:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.093860:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.094051:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.094294:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.094659:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.094922:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.095146:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.095370:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.095730:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.095955:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.096722:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.097233:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.097516:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.097713:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.098240:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.098514:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.098785:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.099103:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.099476:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.099673:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.099930:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.100205:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.100461:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787826437.100780:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787826437.101692:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.103222:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.103641:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.104191:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.104438:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787826437.104691:0:201169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1787826437.106083:0:201169:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787826437.106272:0:201169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787826437.106279:0:201169:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787826437.106288:0:201169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cef17a 00000020:01000004:1.0:1787826437.106293:0:201169:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787826437.106304:0:201169:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787826437.106308:0:201169:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb449082000 from MGS 00000020:01000004:1.0:1787826437.106311:0:201169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787826437.106319:0:201169:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8eb48145cd28) 00000020:00000080:1.0:1787826437.106437:0:201169:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787826437.106495:0:201169:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb449082000 from MGS, refs=2 00080000:01000000:1.0:1787826437.106500:0:201169:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787826437.106505:0:201169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cef188 00010000:00010000:1.0:1787826437.106753:0:201169:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1787826437.110798:0:201169:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787826437.111890:0:201173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787826437.111927:0:201169:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787826437.111974:0:201169:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787826437.113899:0:201169:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787826437.114194:0:201169:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787826437.114378:0:201169:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787826437.114384:0:201169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787826437.114923:0:201169:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787826437.114930:0:201169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787826437.115621:0:201169:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787826437.115628:0:201169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787826437.116063:0:201169:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787826437.116088:0:201169:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1787826437.116090:0:201169:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1787826437.116094:0:201169:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1787826437.116100:0:201169:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787826437.116106:0:201169:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787826437.123471:0:201169:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.147@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787826437.123477:0:201169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787826437.123487:0:201169:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb476e71c00 x1874663049456896/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826437.123518:0:201169:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb46e868e00 x1874663049458688/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826442 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826437.123527:0:201169:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb46a213800 x1874663049460096/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826447 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826437.123688:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049458688:0@lo:400:kworker.0 00000100:00100000:3.0:1787826437.123775:0:201169:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8eb477df4700 x1874663049461504/t0(0) o400->MGC192.168.203.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826452 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826437.123778:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb46a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049460096:0@lo:400:kworker.0 10000000:01000000:3.0:1787826437.123802:0:201169:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787826437.123805:0:201169:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787826437.123807:0:201169:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787826437.123811:0:201169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1787826437.123813:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb476e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049456896:0@lo:400:kworker.0 00000100:00100000:2.0:1787826437.123860:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb477df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049461504:0@lo:400:kworker.0 10000000:01000000:2.0:1787826437.123882:0:201169:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1787826437.123896:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedc26 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.123905:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedc26 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.123912:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1787826437.123930:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.123939:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d64200/0x878a5eea00cedc1f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedc26 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.123962:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedb8c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.123969:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedb8c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.123974:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.123984:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.123989:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf39000/0x878a5eea00cedb85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedb8c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.123999:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedb9a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124008:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedb9a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124013:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.124017:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124020:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cedb93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedb9a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124028:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedbfc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124033:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedbfc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124038:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.124041:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124045:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb481ce3600/0x878a5eea00cedbf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedbfc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124053:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedc0a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124065:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedc0a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124070:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.124262:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124273:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb480d65200/0x878a5eea00cedc03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedc0a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124283:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124289:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124295:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.124303:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124307:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34a569800/0x878a5eea00cedc2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedc34 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124318:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cee6fa expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124346:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cee6fa expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124352:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.124360:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124365:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19000/0x878a5eea00cee6f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cee6fa expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124383:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cee7b7 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124390:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cee7b7 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124396:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.124404:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124408:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb441356e00/0x878a5eea00cee7b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cee7b7 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124431:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cee7e1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124438:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cee7e1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124443:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.124454:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124457:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19400/0x878a5eea00cee7da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cee7e1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124469:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cee6ec expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124476:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cee6ec expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124481:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826437.124492:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124496:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34ab19200/0x878a5eea00cee6e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cee6ec expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124570:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedba8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124578:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedba8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124584:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787826437.124593:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124598:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34a569600/0x878a5eea00cedba1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedba8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124607:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cedc18 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124613:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cedc18 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124618:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787826437.124624:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124628:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34a568800/0x878a5eea00cedc11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cedc18 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.124638:0:201169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x878a5eea00cee7a9 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826437.124644:0:201169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x878a5eea00cee7a9 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.124653:0:201169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787826437.124660:0:201169:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787826437.124663:0:201169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb441357200/0x878a5eea00cee79b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x878a5eea00cee7a9 expref: -99 pid: 198804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787826437.124678:0:201169:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8eb480df0000 already not connected (conn 369, was 0): DISCONN 00000100:00080000:2.0:1787826437.124683:0:201169:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826437.124687:0:201169:0:(import.c:510:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 8367 00000100:00080000:2.0:1787826437.124694:0:201169:0:(import.c:624:import_select_connection()) MGC192.168.203.147@tcp: import ffff8eb480df0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826437.124715:0:201169:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481af4000 x1874663049462656/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826437.124734:0:201169:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1787826437.124750:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049462656:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787826437.124816:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.124961:0:201175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049462656 00000100:00100000:2.0:1787826437.124968:0:201175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049462656 00000100:00100000:2.0:1787826437.125002:0:201175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826437.125010:0:201175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1874663049462656:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787826437.125032:0:201175:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 205ad83e-e455-4070-92a2-f1e25b8f3f40@0@lo t0 exp 0000000000000000 cur 8503 last 0 00000020:00000080:2.0:1787826437.125059:0:201175:0:(genops.c:1385:class_connect()) connect: client 205ad83e-e455-4070-92a2-f1e25b8f3f40, cookie 0x878a5eea00cef18f 00000100:00080000:2.0:1787826437.125213:0:201175:0:(import.c:65:import_set_state_nolock()) ffff8eb349084000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826437.125268:0:201175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+5:3616:x1874663049462656:12345-0@lo:250:mount.lustre.0 Request processed in 258us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.125276:0:201175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787826437.125314:0:3616:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.147@tcp: committing for last_committed 0 gen 83 00000100:00080000:2.0:1787826437.125322:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.147@tcp: connect to target with instance 0 00000100:00080000:2.0:1787826437.125380:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787826437.125383:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787826437.125387:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb480df0000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787826437.125389:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787826437.125402:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787826437.125409:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:205ad83e-e455-4070-92a2-f1e25b8f3f40:3616:1874663049462656:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1787826437.125426:0:201169:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1787826437.125435:0:201169:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787826437.125464:0:201169:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787826437.125468:0:201169:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787826437.125558:0:201169:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787826437.125582:0:201169:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787826437.125585:0:201169:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787826437.125586:0:201169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826437.125588:0:201169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826437.125589:0:201169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826437.125590:0:201169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826437.125592:0:201169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826437.125593:0:201169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826437.125594:0:201169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826437.125596:0:201169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826437.125598:0:201169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787826437.125600:0:201169:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787826437.125602:0:201169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826437.125603:0:201169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826437.125604:0:201169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826437.125605:0:201169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826437.125606:0:201169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826437.125607:0:201169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826437.125608:0:201169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826437.125609:0:201169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826437.125610:0:201169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826437.125611:0:201169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787826437.125624:0:201169:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787826437.125636:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049462784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826437.125664:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.125685:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450ceeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.125697:0:201176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049462784 00000100:00100000:2.0:1787826437.125699:0:201176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049462784 00000100:00100000:2.0:1787826437.125721:0:201175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826437.125728:0:201175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+5:201169:x1874663049462784:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826437.125757:0:201175:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787826437.125760:0:201175:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787826437.125772:0:201175:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000020:01000000:1.0:1787826437.125815:0:179516:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.147@tcp 10000000:01000000:1.0:1787826437.125829:0:179516:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1787826437.125832:0:179516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787826437.125833:0:179516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787826437.125834:0:179516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826437.125836:0:179516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826437.125837:0:179516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826437.125838:0:179516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826437.125839:0:179516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826437.125840:0:179516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826437.125841:0:179516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787826437.125868:0:179516:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787826437.125880:0:179516:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1787826437.125883:0:179516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787826437.125885:0:179516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787826437.125886:0:179516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826437.125887:0:179516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826437.125888:0:179516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826437.125890:0:179516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826437.125891:0:179516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826437.125893:0:179516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826437.125895:0:179516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787826437.125930:0:179516:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787826437.125936:0:179516:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1787826437.125938:0:179516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787826437.125940:0:179516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826437.125942:0:179516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:0.0:1787826437.125943:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049462912:0@lo:253:kworker.0 00000020:01000004:1.0:1787826437.125944:0:179516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826437.125947:0:179516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826437.125950:0:179516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826437.125952:0:179516:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826437.125953:0:179516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826437.125954:0:179516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787826437.125968:0:179516:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1787826437.125994:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826437.126010:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049463168:0@lo:253:kworker.0 00000100:00100000:0.0:1787826437.126034:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049462912 00000100:00100000:0.0:1787826437.126040:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049462912 00000100:00100000:1.0:1787826437.126052:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.126058:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049463168 00000100:00100000:0.0:1787826437.126062:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049463168 00000100:00100000:1.0:1787826437.126076:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826437.126077:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787826437.126086:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049463040:0@lo:253:kworker.0 00000100:00100000:0.0:1787826437.126087:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3620:x1874663049462912:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787826437.126111:0:201177:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1787826437.126127:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.126147:0:201176:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1787826437.126154:0:201176:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 10000000:01000000:3.0:1787826437.126901:0:201178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1787826437.127025:0:201176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049463040 00000100:00100000:0.0:1787826437.127031:0:201176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049463040 00000100:00100000:0.0:1787826437.127181:0:201179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826437.127189:0:201179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3618:x1874663049463168:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787826437.127208:0:201179:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787826437.127368:0:201175:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 339 20000000:01000000:2.0:1787826437.129485:0:201180:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787826437.129493:0:201180:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1787826437.129496:0:201180:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787826437.129500:0:201180:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787826437.129684:0:201180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787826437.129807:0:201175:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787826437.129830:0:201175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787826437.129921:0:201177:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787826437.130860:0:201177:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787826437.130878:0:201177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787826437.130878:0:201179:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787826437.130939:0:201175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:201169:x1874663049462784:12345-0@lo:253:mount.lustre.0 Request processed in 5194us (5258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826437.130955:0:201175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826437.130998:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049462784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787826437.131012:0:201169:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787826437.131015:0:201169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787826437.131017:0:201169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826437.131019:0:201169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826437.131021:0:201169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826437.131022:0:201169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826437.131024:0:201169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826437.131026:0:201169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826437.131027:0:201169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826437.131031:0:201169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:3.0:1787826437.131031:0:201175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1787826437.131035:0:201169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:3.0:1787826437.131042:0:201175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3618:x1874663049463040:12345-0@lo:253:kworker.0 00000020:01000004:2.0:1787826437.131056:0:201169:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8eb449082000 from lustre-MDT0000 20000000:01000000:3.0:1787826437.131065:0:201175:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:2.0:1787826437.131083:0:201169:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787826437.131087:0:201169:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787826437.131096:0:201169:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8eb449082000 10000000:01000000:2.0:1787826437.131100:0:201169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787826437.131106:0:201169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8eb449082000 10000000:01000000:2.0:1787826437.131110:0:201169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787826437.131115:0:201169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8eb449082000 from 1 10000000:01000000:2.0:1787826437.131118:0:201169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00000100:00100000:0.0:1787826437.131139:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:3620:x1874663049462912:12345-0@lo:253:kworker.0 Request processed in 5052us (5144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.131148:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787826437.131149:0:201169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38800/0x878a5eea00cef196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131161:0:201169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38800/0x878a5eea00cef196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131171:0:201169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38800/0x878a5eea00cef196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787826437.131182:0:3620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787826437.131186:0:3620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787826437.131187:0:3620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826437.131188:0:3620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826437.131190:0:3620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826437.131193:0:3620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:2.0:1787826437.131193:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049463296:0@lo:101:mount.lustre.0 00000020:01000004:0.0:1787826437.131196:0:3620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787826437.131199:0:3620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826437.131201:0:3620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787826437.131205:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049462912:0@lo:253:kworker.0 00000100:00100000:2.0:1787826437.131234:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.131270:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450ceed80 going to sleep for 11 seconds 20000000:01000000:2.0:1787826437.131283:0:201178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826437.131287:0:201178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826437.131300:0:201178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131313:0:201178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826437.131321:0:201178:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000034668s 00010000:00010000:2.0:1787826437.131358:0:201178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131365:0:201178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131372:0:201178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131379:0:201178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131385:0:201178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826437.131389:0:201178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131398:0:201178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131410:0:201178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131417:0:201178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.131423:0:201178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf38c00/0x878a5eea00cef19d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826437.131588:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049463296 00000100:00100000:0.0:1787826437.131595:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049463296 00000100:00100000:0.0:1787826437.131630:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787826437.131639:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+7:201169:x1874663049463296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826437.131648:0:201177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826437.131664:0:201177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cef1a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cef196 expref: -99 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.131692:0:201177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cef1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cef196 expref: 8 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.131703:0:201177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a569c00/0x878a5eea00cef1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef196 expref: 8 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.131712:0:201177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569c00, rc 0) 00000100:00100000:0.0:1787826437.131777:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:201169:x1874663049463296:12345-0@lo:101:mount.lustre.0 Request processed in 125us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.131786:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787826437.131818:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049463296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826437.131837:0:201169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38800/0x878a5eea00cef196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef1a4 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.131848:0:201169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38800/0x878a5eea00cef196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef1a4 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826437.131865:0:201169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787826437.131887:0:201169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38800/0x878a5eea00cef196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef1a4 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.131895:0:201169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38800/0x878a5eea00cef196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef1a4 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826437.131902:0:201169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787826437.131907:0:201169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787826437.131913:0:201169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8eb449082000 10000000:01000000:3.0:1787826437.131916:0:201169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787826437.131920:0:201169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787826437.131923:0:201169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787826437.132071:0:201169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ecc00/0x878a5eea00cef1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.132084:0:201169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb4724ecc00/0x878a5eea00cef1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.132092:0:201169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb4724ecc00/0x878a5eea00cef1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826437.132107:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049463424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826437.132146:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.132188:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049463424 00000100:00100000:0.0:1787826437.132194:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049463424 00000100:00100000:3.0:1787826437.132194:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4770c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826437.132231:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787826437.132241:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:201169:x1874663049463424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826437.132248:0:201177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826437.132259:0:201177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34a569200/0x878a5eea00cef1b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cef1ab expref: -99 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.132275:0:201177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a569200/0x878a5eea00cef1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cef1ab expref: 9 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.132364:0:201177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34a569200/0x878a5eea00cef1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef1ab expref: 9 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.132371:0:201177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34a569200, rc 0) 00000100:00100000:0.0:1787826437.132420:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201169:x1874663049463424:12345-0@lo:101:mount.lustre.0 Request processed in 182us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.132426:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787826437.132507:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049463424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826437.132518:0:201169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb4724ecc00/0x878a5eea00cef1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef1b2 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.132526:0:201169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb4724ecc00/0x878a5eea00cef1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef1b2 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826437.132572:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049463552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826437.132596:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.132651:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4770c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826437.132691:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049463552 00000100:00100000:0.0:1787826437.132696:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049463552 00000100:00100000:0.0:1787826437.132724:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787826437.132732:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201169:x1874663049463552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826437.132732:0:201176:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:2.0:1787826437.132760:0:201176:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:0.0:1787826437.132866:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201169:x1874663049463552:12345-0@lo:501:mount.lustre.0 Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.132874:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826437.132936:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049463552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826437.132964:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049463680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826437.133007:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.133042:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049463680 00000100:00100000:0.0:1787826437.133047:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049463680 00000100:00100000:2.0:1787826437.133048:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450ceecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826437.133071:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787826437.133081:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201169:x1874663049463680:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1787826437.134256:0:201179:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787826437.134270:0:201179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787826437.134347:0:201178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826437.134352:0:201178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826437.134367:0:201178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.134378:0:201178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826437.134385:0:201178:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000034668s 00010000:00010000:2.0:1787826437.134390:0:201178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.134396:0:201178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.134403:0:201178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.134409:0:201178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787826437.134413:0:201175:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1787826437.134415:0:201178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:2.0:1787826437.134419:0:201178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.134426:0:201178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.134444:0:201178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.134451:0:201178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.134457:0:201178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf38200/0x878a5eea00cef1b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826437.134652:0:201179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:3618:x1874663049463168:12345-0@lo:253:kworker.0 Request processed in 7462us (8598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.134665:0:201179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1787826437.134860:0:3618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787826437.134863:0:3618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787826437.134865:0:3618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826437.134866:0:3618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826437.134867:0:3618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826437.134869:0:3618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826437.134871:0:3618:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826437.134873:0:3618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826437.134875:0:3618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787826437.134879:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049463168:0@lo:253:kworker.0 00000100:00100000:3.0:1787826437.134911:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201169:x1874663049463680:12345-0@lo:503:mount.lustre.0 Request processed in 1832us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826437.134919:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826437.134944:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049463680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826437.135170:0:201182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201182:1874663049463808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826437.135220:0:201182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.135247:0:201182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450cee180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826437.135257:0:201176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049463808 00000100:00100000:0.0:1787826437.135262:0:201176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049463808 00000100:00100000:0.0:1787826437.135298:0:201176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826437.135306:0:201176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34a3cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201182:x1874663049463808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826437.136465:0:201176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201182:x1874663049463808:12345-0@lo:502:llog_process_th.0 Request processed in 1159us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.136472:0:201176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787826437.136970:0:201182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201182:1874663049463808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826437.136997:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826437.137007:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826437.137009:0:201182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787826437.137015:0:201182:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787826437.137018:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826437.137030:0:201182:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8eb4815f4d28) 00000020:00000080:2.0:1787826437.137048:0:201182:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:2.0:1787826437.137053:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787826437.137472:0:201182:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787826437.137480:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cef1c7 20000000:01000000:3.0:1787826437.137787:0:201175:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787826437.137806:0:201175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787826437.137943:0:201178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787826437.137948:0:201178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787826437.137964:0:201178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.137977:0:201178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787826437.137990:0:201178:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000042220s 00010000:00010000:0.0:1787826437.137994:0:201178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.138001:0:201178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.138008:0:201178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.138015:0:201178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.138022:0:201178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568c00 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826437.138026:0:201178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.138035:0:201178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.138048:0:201178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.138056:0:201178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.138063:0:201178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a568c00/0x878a5eea00cef1ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826437.138073:0:201175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34a3cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3618:x1874663049463040:12345-0@lo:253:kworker.0 Request processed in 7030us (11943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826437.138086:0:201175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:2.0:1787826437.138125:0:201182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787826437.138131:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826437.138136:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826437.138138:0:201182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787826437.138141:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826437.138145:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826437.138147:0:201182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787826437.138152:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826437.138159:0:201182:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8eb4815f19b8) 00000020:00000080:2.0:1787826437.138175:0:201182:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:01000004:1.0:1787826437.138180:0:3618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:00000080:2.0:1787826437.138180:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:01000004:1.0:1787826437.138183:0:3618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:00000080:2.0:1787826437.138184:0:201182:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000004:1.0:1787826437.138185:0:3618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826437.138188:0:3618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826437.138190:0:3618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000000:2.0:1787826437.138190:0:201182:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:01000004:1.0:1787826437.138194:0:3618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826437.138197:0:3618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826437.138199:0:3618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:00000080:2.0:1787826437.138199:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787826437.138201:0:3618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787826437.138207:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:205ad83e-e455-4070-92a2-f1e25b8f3f40:3618:1874663049463040:0@lo:253:kworker.0 00000020:01000004:2.0:1787826437.138245:0:201182:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb449082000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787826437.138257:0:201182:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8eb4815f3370) 00000020:00000080:2.0:1787826437.138268:0:201182:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:2.0:1787826437.138316:0:201182:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787826437.138321:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cef1e3 00000020:00000080:2.0:1787826437.138797:0:201182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787826437.138803:0:201182:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787826437.138808:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x878a5eea00cef1ea 00080000:01000000:2.0:1787826437.138812:0:201182:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787826437.138815:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cef1f1 00010000:00010000:2.0:1787826437.187548:0:201182:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1787826437.187675:0:201182:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: c0d7758a-4501-4a89-8ec1-407fef4f0c7f idx: 0 lr: 347892350985 srv lr: 352187318272 lx: 0 gen 22 00000001:00080000:2.0:1787826437.187717:0:201182:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 347892350983 srv lr: 352187318272 lx: 0 gen 21 00000001:00000004:2.0:1787826437.187740:0:201182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 83, last_transno is 352187318272 00000001:00080000:2.0:1787826437.187842:0:201182:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1787826437.187893:0:201182:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb4817ad840: xid 1874663043027968, transno 352187318284, client gen 22, slot idx 0 00000001:00080000:2.0:1787826437.187903:0:201182:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb4817ad0c0: xid 1874663049398528, transno 352187318285, client gen 21, slot idx 1 00000001:00080000:2.0:1787826437.187907:0:201182:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb4817ade40: xid 1874663049392768, transno 352187318282, client gen 21, slot idx 2 00000001:00080000:2.0:1787826437.187912:0:201182:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb4817ad600: xid 1874663043027072, transno 352187318283, client gen 22, slot idx 3 00000001:00080000:2.0:1787826437.187916:0:201182:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8eb4817ad9c0: xid 1874663048748416, transno 330712483740, client gen 21, slot idx 4 00000020:00000080:2.0:1787826437.188272:0:201182:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8eb481d9b370) 00000020:00000080:2.0:1787826437.188286:0:201182:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1787826437.188488:0:201182:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787826437.188495:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cef20d 00000020:00000080:2.0:1787826437.189755:0:201182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787826437.192188:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x878a5eea00cef214 00000020:00000080:1.0:1787826437.192859:0:201182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787826437.192871:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826437.192876:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.192878:0:201182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787826437.192881:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787826437.192883:0:201182:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787826437.192884:0:201182:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826437.192885:0:201182:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826437.192887:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787826437.192895:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.192897:0:201182:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787826437.192899:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826437.192904:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.192905:0:201182:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787826437.192910:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787826437.192965:0:201182:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787826437.193012:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826437.193016:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.193017:0:201182:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787826437.193021:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826437.193025:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.193027:0:201182:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787826437.193031:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787826437.193043:0:201182:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:1.0:1787826437.193076:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826437.193090:0:201182:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8eb47a430000) 00000020:00000080:1.0:1787826437.193118:0:201182:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787826437.193125:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787826437.193203:0:201182:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787826437.193209:0:201182:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787826437.193217:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cef222 00010000:00080000:1.0:1787826437.193245:0:201182:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb34c996000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:1.0:1787826437.195042:0:201182:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1787826437.195872:0:201182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826437.195884:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787826437.195915:0:201182:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787826437.195936:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cef229 00000100:00080000:2.0:1787826437.195946:0:201182:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826437.195952:0:201182:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8eb34c996000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1787826437.195991:0:201182:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb481af7800 x1874663049463936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826437.196024:0:201182:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787826437.196055:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049463936:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826437.196135:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787826437.196141:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826437.196147:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826437.196149:0:201182:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787826437.196153:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826437.196155:0:201182:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787826437.196157:0:201182:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826437.196159:0:201182:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826437.196161:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826437.196163:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826437.196165:0:201182:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826437.196168:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826437.196172:0:201182:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787826437.196175:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826437.196176:0:201182:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787826437.196179:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826437.196183:0:201182:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000100:00100000:0.0:1787826437.196198:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049463936 00000020:01000000:2.0:1787826437.196204:0:201182:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00100000:0.0:1787826437.196206:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049463936 00000020:00000080:2.0:1787826437.196208:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826437.196222:0:201182:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8eb45eb84d28) 00000020:00000080:2.0:1787826437.196239:0:201182:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000100:00100000:0.0:1787826437.196241:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000020:00000080:2.0:1787826437.196245:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787826437.196253:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1874663049463936:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787826437.196276:0:187909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8504 last 0 00000004:00080000:2.0:1787826437.196318:0:201182:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787826437.196357:0:201182:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787826437.196366:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cef23e 00000020:00000080:0.0:1787826437.196410:0:187909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cef237 00010000:00080000:2.0:1787826437.196411:0:201182:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb34b9e0000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.147@tcp at head 00000004:00100000:0.0:1787826437.196423:0:187909:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826437.196524:0:187909:0:(import.c:65:import_set_state_nolock()) ffff8eb469f60800 : changing import state from RECOVER to FULL 00010000:00000080:0.0:1787826437.196543:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69f800 x1874663049463936/t0(0) o38->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787826457 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826437.196587:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049463936:12345-0@lo:38:llog_process_th.0 Request processed in 335us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.196593:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:2.0:1787826437.196614:0:201182:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1787826437.196640:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826437.196648:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 5 00000100:00080000:0.0:1787826437.196654:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787826437.196659:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787826437.196661:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34c996000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787826437.196678:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049463936:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826437.196812:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049464064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826437.196834:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.196894:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049464192:0@lo:400:kworker.0 00000100:00080000:1.0:1787826437.196901:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826437.196907:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826437.196912:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826437.196917:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8503 00000100:00100000:0.0:1787826437.196923:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826437.196923:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826437.196931:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8eb343213000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826437.196962:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb472975f80 x1874663049464320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826437.197010:0:199731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049464064 00000100:00100000:3.0:1787826437.197015:0:199731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049464064 00000100:00080000:1.0:1787826437.197016:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826437.197021:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826437.197023:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826437.197026:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8503 00000100:00080000:1.0:1787826437.197030:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826437.197035:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8eb47f9a5000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1787826437.197046:0:199731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787826437.197051:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb472975c00 x1874663049464576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826437.197053:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049464448:0@lo:400:kworker.0 00000100:00100000:3.0:1787826437.197058:0:199731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049464064:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1787826437.197085:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826437.197089:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826437.197091:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826437.197096:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8503 00000100:00080000:1.0:1787826437.197098:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826437.197102:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8eb341ac8800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826437.197117:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34df17100 x1874663049464832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826437.197123:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1787826437.197143:0:199731:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00000100:00100000:2.0:1787826437.197154:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1787826437.197157:0:179516:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00000080:3.0:1787826437.197159:0:199731:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34c69e680 x1874663049464064/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:38/0 lens 224/368 e 0 to 0 dl 1787826448 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826437.197161:0:179516:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1787826437.197164:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb47a1fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049464704:0@lo:400:kworker.0 00000100:00080000:1.0:1787826437.197165:0:179516:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826437.197175:0:179516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8503 00000100:00080000:1.0:1787826437.197180:0:179516:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826437.197184:0:179516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8eb47f7e6800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826437.197200:0:179516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34df14700 x1874663049465216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826437.197212:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.197218:0:199731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1874663049464064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826437.197226:0:199731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787826437.197230:0:201179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049464192 00000100:00100000:1.0:1787826437.197236:0:201179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049464192 00000100:00100000:2.0:1787826437.197256:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049464448 00000100:00100000:2.0:1787826437.197262:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049464448 00000100:00100000:0.0:1787826437.197287:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049465088:0@lo:400:kworker.0 00000100:00100000:1.0:1787826437.197289:0:201179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787826437.197297:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049464704 00000100:00100000:1.0:1787826437.197303:0:201179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47743a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3620:x1874663049464192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826437.197303:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049464704 00000100:00100000:0.0:1787826437.197353:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.197354:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1787826437.197365:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049464448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826437.197374:0:201179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47743a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:3620:x1874663049464192:12345-0@lo:400:kworker.0 Request processed in 73us (450us total) trans 0 rc 0/0 00010000:00000080:2.0:1787826437.197382:0:187904:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af6d80 x1874663049464448/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:38/0 lens 224/224 e 0 to 0 dl 1787826448 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826437.197385:0:201179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787826437.197388:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:205ad83e-e455-4070-92a2-f1e25b8f3f40:3620:1874663049464192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826437.197406:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826437.197411:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049464960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826437.197444:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.197445:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874663049464448:12345-0@lo:400:kworker.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.197446:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1787826437.197455:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049464704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826437.197459:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00010000:00000080:1.0:1787826437.197468:0:188682:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af5500 x1874663049464704/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:38/0 lens 224/224 e 0 to 0 dl 1787826448 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826437.197490:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049465088 00000100:00100000:0.0:1787826437.197497:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049465088 00000100:00100000:1.0:1787826437.197504:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874663049464704:12345-0@lo:400:kworker.0 Request processed in 48us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.197511:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1874663049464064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826437.197514:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1787826437.197531:0:179226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049464960 00000100:00100000:0.0:1787826437.197536:0:179226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049464960 00000100:00100000:2.0:1787826437.197554:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb47a1fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1874663049464704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826437.197566:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7229 00000100:00100000:2.0:1787826437.197569:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1874663049464448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826437.197578:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049465088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826437.197629:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049465088:12345-0@lo:400:kworker.0 Request processed in 54us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.197636:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7229 00000100:00100000:0.0:1787826437.197652:0:179226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7230 00000100:00100000:0.0:1787826437.197661:0:179226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049464960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826437.197676:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049465088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826437.197699:0:179226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049464960:12345-0@lo:400:kworker.0 Request processed in 39us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.197704:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049464960:0@lo:400:kworker.0 00000100:00100000:0.0:1787826437.197710:0:179226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7230 00000100:00100000:0.0:1787826437.197746:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049464320:0@lo:38:kworker.0 00000100:00100000:0.0:1787826437.197782:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.197803:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049464576:0@lo:38:kworker.0 00000100:00100000:0.0:1787826437.197821:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826437.197906:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049464320 00000100:00100000:1.0:1787826437.197911:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049464320 00000100:00100000:0.0:1787826437.197923:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049464832:0@lo:38:kworker.0 00000100:00100000:1.0:1787826437.197937:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049464576 00000100:00100000:1.0:1787826437.197940:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049464576 00000100:00100000:1.0:1787826437.197952:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1787826437.197956:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049464320:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787826437.197998:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049464320:12345-0@lo:38:kworker.0 Request processed in 40us (215us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826437.198006:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1787826437.198019:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.198039:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049465216:0@lo:38:kworker.0 00000100:00100000:0.0:1787826437.198059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826437.198084:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049465216 00000100:00100000:1.0:1787826437.198093:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049465216 00000100:00100000:1.0:1787826437.198107:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1787826437.198110:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049464576:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787826437.198138:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049464576:12345-0@lo:38:kworker.0 Request processed in 26us (317us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826437.198148:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1787826437.198160:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00080000:0.0:1787826437.198162:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb343213000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826437.198169:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826437.198172:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1874663049464320:0@lo:38:kworker.0 00000100:00100000:1.0:1787826437.198178:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049465216:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1787826437.198188:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f9a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826437.198193:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826437.198197:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1874663049464576:0@lo:38:kworker.0 00000100:00100000:1.0:1787826437.198217:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1874663049465216:12345-0@lo:38:kworker.0 Request processed in 38us (154us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826437.198223:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00080000:0.0:1787826437.198368:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb47f7e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826437.198373:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826437.198377:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874663049465216:0@lo:38:kworker.0 00000100:00100000:1.0:1787826437.198399:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049464832 00000100:00100000:1.0:1787826437.198405:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049464832 00000040:01000000:2.0:1787826437.198408:0:201182:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787826437.198430:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000040:01000000:2.0:1787826437.198434:0:201182:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787826437.198439:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34c69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049464832:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787826437.198482:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34c69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1874663049464832:12345-0@lo:38:kworker.0 Request processed in 45us (463us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787826437.198488:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787826437.198515:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb341ac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826437.198521:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826437.198523:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1874663049464832:0@lo:38:kworker.0 00000040:00080000:2.0:1787826437.198748:0:201182:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 81, last_idx 82 00000040:00080000:2.0:1787826437.199275:0:201182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826437.199302:0:201182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].83, 64 off13504 00000040:00080000:2.0:1787826437.201753:0:201182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14c:0x0].1, 64 off8256 00000040:00080000:0.0:1787826437.202416:0:201188:0:(llog.c:805:llog_process_thread()) index: 82, lh_last_idx: 83 synced_idx: 0 lgh_last_idx: 83 00000040:00080000:0.0:1787826437.202421:0:201188:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x148:0x0] at index 82 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1787826437.202616:0:201188:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 82, last_idx 83 00000040:00080000:0.0:1787826437.202638:0:201188:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x148:0x0] at index 82 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787826437.202791:0:201182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000040:00080000:0.0:1787826437.202800:0:201188:0:(llog.c:805:llog_process_thread()) index: 83, lh_last_idx: 83 synced_idx: 83 lgh_last_idx: 83 00000020:00000080:1.0:1787826437.202802:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000040:00080000:0.0:1787826437.202804:0:201188:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14c:0x0] at index 83 of catalog [0x1:0x2:0x0] 00000004:01000000:1.0:1787826437.202836:0:201182:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787826437.202851:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cef245 00000100:00080000:1.0:1787826437.202858:0:201182:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787826437.202863:0:201182:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8eb34b9e0000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826437.202889:0:201182:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34df16d80 x1874663049465344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826437.202909:0:201182:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787826437.202974:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049465344:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1787826437.202997:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826437.203003:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.203005:0:201182:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787826437.203009:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787826437.203011:0:201182:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787826437.203013:0:201182:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826437.203015:0:201182:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787826437.203016:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787826437.203020:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.203021:0:201182:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787826437.203024:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787826437.203028:0:201182:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787826437.203032:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.203033:0:201182:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787826437.203036:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787826437.203040:0:201182:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:1.0:1787826437.203061:0:201182:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00100000:0.0:1787826437.203065:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787826437.203066:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787826437.203078:0:201182:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8eb47a434d28) 00000020:00000080:1.0:1787826437.203095:0:201182:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1787826437.203101:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787826437.203129:0:16985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049465344 00000100:00100000:0.0:1787826437.203137:0:16985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049465344 00000004:00080000:1.0:1787826437.203168:0:201182:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787826437.203174:0:201182:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000100:00100000:0.0:1787826437.203176:0:16985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22667 00000020:00000080:1.0:1787826437.203180:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x878a5eea00cef253 00000100:00100000:0.0:1787826437.203187:0:16985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3616:x1874663049465344:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1787826437.203211:0:201182:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb481222800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00080000:0.0:1787826437.203212:0:16985:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8504 last 0 00000020:00000080:0.0:1787826437.203246:0:16985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cef25a 00002000:00100000:0.0:1787826437.203259:0:16985:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8eb48146b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787826437.203264:0:16985:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787826437.203267:0:16985:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787826437.203308:0:16985:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787826437.203352:0:16985:0:(import.c:65:import_set_state_nolock()) ffff8eb48146e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826437.203406:0:16985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049465344:12345-0@lo:8:llog_process_th.0 Request processed in 219us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.203414:0:16985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22667 00010000:00010000:1.0:1787826437.203441:0:201182:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:0.0:1787826437.203454:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826437.203463:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:0.0:1787826437.203471:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787826437.203476:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787826437.203478:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb34b9e0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:01000000:1.0:1787826437.203489:0:201182:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00080000:0.0:1787826437.203492:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787826437.203499:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049465344:0@lo:8:llog_process_th.0 00000040:01000000:1.0:1787826437.203503:0:201182:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000004:00080000:2.0:1787826437.203530:0:201188:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787826437.203560:0:201188:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8504030234136ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787826437.203565:0:201188:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:1.0:1787826437.204008:0:201182:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 81, last_idx 82 00000100:00100000:2.0:1787826437.204258:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049465472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826437.204292:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.204318:0:24463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049465472 00000100:00100000:0.0:1787826437.204353:0:24463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049465472 00000100:00080000:1.0:1787826437.204385:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826437.204397:0:24463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5954 00000100:00100000:0.0:1787826437.204409:0:24463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049465472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826437.204430:0:24463:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1787826437.204476:0:24463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1874663049465472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.204483:0:24463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5954 00000100:00100000:2.0:1787826437.204519:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1874663049465472:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787826437.204808:0:201182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787826437.204834:0:201182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].83, 64 off13504 00000040:00080000:1.0:1787826437.205086:0:201182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14e:0x0].1, 64 off8256 00000004:00080000:0.0:1787826437.205095:0:201170:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1787826437.205605:0:201190:0:(llog.c:805:llog_process_thread()) index: 82, lh_last_idx: 83 synced_idx: 0 lgh_last_idx: 83 00000040:00080000:0.0:1787826437.205610:0:201190:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14a:0x0] at index 82 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1787826437.205721:0:201190:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 82, last_idx 83 00000040:00080000:0.0:1787826437.205735:0:201190:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x14a:0x0] at index 82 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1787826437.205869:0:201190:0:(llog.c:805:llog_process_thread()) index: 83, lh_last_idx: 83 synced_idx: 83 lgh_last_idx: 83 00000040:00080000:0.0:1787826437.205872:0:201190:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14e:0x0] at index 83 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787826437.206041:0:201182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826437.206050:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787826437.206081:0:201182:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787826437.206097:0:201182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cef261 00000100:00080000:1.0:1787826437.206104:0:201182:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787826437.206109:0:201182:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8eb481222800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1787826437.206133:0:201182:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb34df16680 x1874663049465600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826437.206154:0:201182:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787826437.206193:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049465600:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1787826437.206210:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826437.206216:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.206218:0:201182:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787826437.206221:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787826437.206226:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.206228:0:201182:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787826437.206232:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787826437.206235:0:201182:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787826437.206238:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826437.206241:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.206243:0:201182:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787826437.206249:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1787826437.206250:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787826437.206253:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787826437.206257:0:201182:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787826437.206262:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787826437.206291:0:201182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df14e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201182:1874663049465728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826437.206313:0:43906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049465600 00000100:00100000:0.0:1787826437.206319:0:43906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049465600 00000100:00100000:1.0:1787826437.206369:0:201182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.206377:0:43906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22668 00000100:00100000:0.0:1787826437.206384:0:43906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3616:x1874663049465600:12345-0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787826437.206406:0:201181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049465728 00010000:00080000:0.0:1787826437.206410:0:43906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8504 last 0 00000100:00100000:1.0:1787826437.206412:0:201181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049465728 00000020:00000080:0.0:1787826437.206440:0:43906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x878a5eea00cef268 00000100:00100000:1.0:1787826437.206451:0:201181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00002000:00100000:0.0:1787826437.206453:0:43906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8eb481468800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787826437.206459:0:43906:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:1.0:1787826437.206461:0:201181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47743a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:201182:x1874663049465728:12345-0@lo:502:llog_process_th.0 00002000:00100000:0.0:1787826437.206463:0:43906:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787826437.206520:0:43906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787826437.206542:0:43906:0:(import.c:65:import_set_state_nolock()) ffff8eb48146a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826437.206554:0:201181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47743a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:201182:x1874663049465728:12345-0@lo:502:llog_process_th.0 Request processed in 95us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.206563:0:201181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826437.206590:0:43906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3616:x1874663049465600:12345-0@lo:8:llog_process_th.0 Request processed in 203us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.206599:0:43906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22668 00000100:00100000:1.0:1787826437.206606:0:201182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb450139480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826437.206627:0:201182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df14e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201182:1874663049465728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826437.206647:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000020:01000000:1.0:1787826437.206648:0:201182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787826437.206654:0:201182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:0.0:1787826437.206657:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000020:00000080:1.0:1787826437.206658:0:201182:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787826437.206664:0:201182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00080000:0.0:1787826437.206667:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787826437.206674:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787826437.206679:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb481222800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787826437.206687:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787826437.206693:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1874663049465600:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1787826437.206714:0:201190:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:2.0:1787826437.206753:0:201169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 00000004:00080000:0.0:1787826437.206759:0:201190:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8504033432989ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787826437.206779:0:201190:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 10000000:01000000:2.0:1787826437.206791:0:201169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787826437.206808:0:201169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724ecc00/0x878a5eea00cef1ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef1b2 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.206816:0:201169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb4724ecc00/0x878a5eea00cef1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef1b2 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826437.206823:0:201169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8eb449082000 from 1 10000000:01000000:2.0:1787826437.206825:0:201169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787826437.206846:0:201169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.206852:0:201169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.206859:0:201169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826437.206869:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049465856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826437.206901:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.206917:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb341b99300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.206934:0:201175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049465856 00000100:00100000:2.0:1787826437.206937:0:201175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049465856 00000100:00100000:1.0:1787826437.206960:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049465984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826437.206963:0:201175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787826437.206972:0:201175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47743a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+8:201169:x1874663049465856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826437.206980:0:201175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826437.206991:0:201175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cef26f expref: -99 pid: 201175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826437.207005:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826437.207008:0:201175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cef26f expref: 9 pid: 201175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.207019:0:201175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef26f expref: 9 pid: 201175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.207028:0:201175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb34bf39000, rc 0) 00000100:00100000:1.0:1787826437.207044:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049465984 00000100:00100000:1.0:1787826437.207050:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049465984 00000100:00100000:2.0:1787826437.207074:0:201175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47743a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201169:x1874663049465856:12345-0@lo:101:mount.lustre.0 Request processed in 102us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.207080:0:201175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787826437.207111:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049465856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826437.207125:0:201169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.207134:0:201169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826437.207663:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466112:0@lo:256:mount.lustre.0 00000100:00080000:0.0:1787826437.207712:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826437.207740:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5955 00000100:00100000:1.0:1787826437.207751:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049465984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826437.207782:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1787826437.207830:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1874663049465984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.207836:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5955 00000100:00100000:3.0:1787826437.207907:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.207939:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4487aa540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826437.207949:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049466112 00000100:00100000:2.0:1787826437.207952:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1874663049465984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826437.207954:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049466112 00000100:00100000:0.0:1787826437.207985:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787826437.207992:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47743b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201169:x1874663049466112:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787826437.208006:0:201177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787826437.208018:0:201177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787826437.208023:0:201177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787826437.208025:0:201177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787826437.208028:0:201177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 342 00000100:00100000:0.0:1787826437.208113:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47743b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201169:x1874663049466112:12345-0@lo:256:mount.lustre.0 Request processed in 121us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.208122:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787826437.208130:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466112:0@lo:256:mount.lustre.0 00000004:00080000:0.0:1787826437.208492:0:201170:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:3.0:1787826437.208797:0:201169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787826437.208814:0:201169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.208829:0:201169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826437.208837:0:201169:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8eb449082000 from 1 10000000:01000000:3.0:1787826437.208839:0:201169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787826437.208860:0:201169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724edc00/0x878a5eea00cef27d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.208867:0:201169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb4724edc00/0x878a5eea00cef27d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.208875:0:201169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb4724edc00/0x878a5eea00cef27d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826437.208888:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826437.208917:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826437.208944:0:201181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049466240 00000100:00100000:3.0:1787826437.208945:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4487aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826437.208950:0:201181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049466240 00000100:00100000:1.0:1787826437.208988:0:201181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787826437.208995:0:201181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47743bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:205ad83e-e455-4070-92a2-f1e25b8f3f40+9:201169:x1874663049466240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826437.209004:0:201181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826437.209017:0:201181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb441357600/0x878a5eea00cef284 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cef27d expref: -99 pid: 201181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826437.209035:0:201181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb441357600/0x878a5eea00cef284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cef27d expref: 10 pid: 201181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826437.209043:0:201181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb441357600/0x878a5eea00cef284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef27d expref: 10 pid: 201181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826437.209048:0:201181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb441357600, rc 0) 00000100:00100000:1.0:1787826437.209085:0:201181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47743bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201169:x1874663049466240:12345-0@lo:101:mount.lustre.0 Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.209091:0:201181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787826437.209179:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826437.209190:0:201169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb4724edc00/0x878a5eea00cef27d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef284 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.209197:0:201169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb4724edc00/0x878a5eea00cef27d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef284 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826437.209247:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826437.209277:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.209292:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4487aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826437.209311:0:201179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049466368 00000100:00100000:1.0:1787826437.209317:0:201179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049466368 00000100:00100000:1.0:1787826437.209372:0:201179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787826437.209380:0:201179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201169:x1874663049466368:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826437.209496:0:201179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201169:x1874663049466368:12345-0@lo:501:mount.lustre.0 Request processed in 116us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.209513:0:201179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787826437.209517:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826437.209559:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826437.209595:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.209616:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4487aa540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826437.209640:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049466496 00000100:00100000:0.0:1787826437.209645:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049466496 00000100:00100000:0.0:1787826437.209680:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826437.209687:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47743b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201169:x1874663049466496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826437.209777:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47743b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201169:x1874663049466496:12345-0@lo:503:mount.lustre.0 Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.209782:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787826437.209794:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826437.210021:0:201192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201192:1874663049466624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826437.210053:0:201192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.210075:0:201192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4487aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826437.210130:0:201181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049466624 00000100:00100000:1.0:1787826437.210134:0:201181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049466624 00000100:00100000:1.0:1787826437.210189:0:201181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787826437.210196:0:201181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201192:x1874663049466624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826437.210727:0:201181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201192:x1874663049466624:12345-0@lo:502:llog_process_th.0 Request processed in 530us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.210737:0:201181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787826437.210778:0:201192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201192:1874663049466624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826437.210805:0:201192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826437.210823:0:201192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826437.210826:0:201192:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787826437.210834:0:201192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb449082000 00000020:00000080:3.0:1787826437.210841:0:201192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787826437.210847:0:201192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826437.210850:0:201192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826437.210851:0:201192:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787826437.210853:0:201192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787826437.210855:0:201192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826437.210857:0:201192:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787826437.210859:0:201192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8eb449082000 00000020:00000080:3.0:1787826437.210861:0:201192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787826437.210946:0:201192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201192:1874663049466752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826437.210982:0:201192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.211017:0:201192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb477422840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826437.211276:0:201179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049466752 00000100:00100000:1.0:1787826437.211280:0:201179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049466752 00000100:00100000:1.0:1787826437.211313:0:201179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787826437.211344:0:201179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47743ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201192:x1874663049466752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826437.211432:0:201179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47743ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201192:x1874663049466752:12345-0@lo:502:llog_process_th.0 Request processed in 111us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.211444:0:201179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787826437.211465:0:201192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201192:1874663049466752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826437.211487:0:201192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826437.211494:0:201192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826437.211496:0:201192:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787826437.211500:0:201192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787826437.211594:0:201169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1787826437.211621:0:201169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787826437.211642:0:201169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb4724edc00/0x878a5eea00cef27d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef284 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.211652:0:201169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb4724edc00/0x878a5eea00cef27d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef284 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826437.211705:0:201169:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787826437.211708:0:201169:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8eb449082000 10000000:01000000:0.0:1787826437.211711:0:201169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8eb449082000 10000000:01000000:0.0:1787826437.211716:0:201169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787826437.211721:0:201169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eb449082000 from 1 10000000:01000000:0.0:1787826437.211724:0:201169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826437.211746:0:201169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a568c00/0x878a5eea00cef28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.211754:0:201169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff8eb34a568c00/0x878a5eea00cef28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.211775:0:201169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff8eb34a568c00/0x878a5eea00cef28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826437.211789:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826437.211818:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.211846:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb460149f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826437.211867:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049466880 00000100:00100000:3.0:1787826437.211873:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049466880 00000100:00100000:3.0:1787826437.211914:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787826437.211921:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:201169:x1874663049466880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826437.211942:0:201177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826437.211954:0:201177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eb4724ec400/0x878a5eea00cef292 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x878a5eea00cef28b expref: -99 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.211973:0:201177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb4724ec400/0x878a5eea00cef292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x878a5eea00cef28b expref: 11 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.211983:0:201177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eb4724ec400/0x878a5eea00cef292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef28b expref: 11 pid: 201177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826437.211991:0:201177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eb4724ec400, rc 0) 00000100:00100000:3.0:1787826437.212038:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201169:x1874663049466880:12345-0@lo:101:mount.lustre.0 Request processed in 110us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826437.212045:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787826437.212563:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049466880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826437.212578:0:201169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff8eb34a568c00/0x878a5eea00cef28b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef292 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826437.212588:0:201169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff8eb34a568c00/0x878a5eea00cef28b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x878a5eea00cef292 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826437.212639:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049467008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826437.212668:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826437.212697:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.212707:0:201181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049467008 00000100:00100000:2.0:1787826437.212712:0:201181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049467008 00000100:00100000:2.0:1787826437.212746:0:201181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787826437.212754:0:201181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb47743b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201169:x1874663049467008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826437.212880:0:201181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb47743b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201169:x1874663049467008:12345-0@lo:501:mount.lustre.0 Request processed in 127us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.212888:0:201181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787826437.212908:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049467008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826437.212935:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049467136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826437.212975:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826437.212994:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.213017:0:201179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049467136 00000100:00100000:2.0:1787826437.213023:0:201179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049467136 00000100:00100000:2.0:1787826437.213056:0:201179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787826437.213063:0:201179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201169:x1874663049467136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826437.213142:0:201179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201169:x1874663049467136:12345-0@lo:503:mount.lustre.0 Request processed in 79us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.213149:0:201179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826437.213182:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049467136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826437.213693:0:201194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201194:1874663049467264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826437.213728:0:201194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.213796:0:201194:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb4502c4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.213831:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049467264 00000100:00100000:2.0:1787826437.213836:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049467264 00000100:00100000:2.0:1787826437.213910:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826437.213919:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201194:x1874663049467264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826437.214048:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201194:x1874663049467264:12345-0@lo:502:llog_process_th.0 Request processed in 130us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.214056:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787826437.214114:0:201194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201194:1874663049467264:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787826437.214164:0:201194:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787826437.214177:0:201194:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8eb46a870000) 00000020:00000080:0.0:1787826437.214198:0:201194:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787826437.214275:0:201194:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8eb449082000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787826437.214278:0:201194:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8eb449082000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787826437.214280:0:201194:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8eb449082000 4 00010000:00080000:0.0:1787826437.214299:0:201194:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8eb4607e2000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1787826437.215977:0:201194:0:(ldlm_pool.c:973:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1787826437.216174:0:201194:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787826437.216213:0:201194:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787826437.216226:0:201194:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x878a5eea00cef2a0 00000100:00080000:0.0:1787826437.216235:0:201194:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787826437.216240:0:201194:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8eb4607e2000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1787826437.216266:0:201194:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8eb472977480 x1874663049467392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826437.216297:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049467392:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826437.216381:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.216441:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049467392 00000100:00100000:0.0:1787826437.216447:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049467392 00000100:00100000:0.0:1787826437.216479:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:0.0:1787826437.216486:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049467392:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826437.216535:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb472976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1874663049467392:12345-0@lo:38:llog_process_th.0 Request processed in 48us (154us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787826437.216542:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:0.0:1787826437.216573:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787826437.216579:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8eb4607e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826437.216602:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787826437.216608:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874663049467392:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787826437.216628:0:201194:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787826437.218014:0:201194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201194:1874663049467520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826437.218078:0:201194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.218122:0:201175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049467520 00000100:00100000:0.0:1787826437.218124:0:201194:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34240e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.218128:0:201175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049467520 00000100:00100000:2.0:1787826437.218177:0:201175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787826437.218187:0:201175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201194:x1874663049467520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826437.218322:0:201175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201194:x1874663049467520:12345-0@lo:502:llog_process_th.0 Request processed in 137us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.218372:0:201175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787826437.218377:0:201194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201194:1874663049467520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826437.218422:0:201194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201194:1874663049467648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826437.218458:0:201194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.218481:0:201194:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34240e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.218568:0:201179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049467648 00000100:00100000:2.0:1787826437.218572:0:201179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049467648 00000100:00100000:2.0:1787826437.218599:0:201179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787826437.218605:0:201179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201194:x1874663049467648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826437.218664:0:201179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201194:x1874663049467648:12345-0@lo:502:llog_process_th.0 Request processed in 59us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.218672:0:201179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787826437.218685:0:201194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:205ad83e-e455-4070-92a2-f1e25b8f3f40:201194:1874663049467648:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787826437.218709:0:201194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787826437.218786:0:201169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787826437.218807:0:201169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787826437.218819:0:201169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff8eb34a568c00/0x878a5eea00cef28b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef292 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826437.218827:0:201169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff8eb34a568c00/0x878a5eea00cef28b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x878a5eea00cef292 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787826437.218868:0:201169:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787826437.218870:0:201169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826437.218871:0:201169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826437.218872:0:201169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826437.218873:0:201169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826437.218874:0:201169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826437.218875:0:201169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826437.218876:0:201169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826437.218878:0:201169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826437.218879:0:201169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826437.218882:0:201169:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787826437.218884:0:201169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787826437.218884:0:201169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787826437.218885:0:201169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826437.218886:0:201169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826437.218887:0:201169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826437.218887:0:201169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826437.218888:0:201169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826437.218889:0:201169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787826437.218889:0:201169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826437.218890:0:201169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787826437.218901:0:201169:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787826437.218907:0:201169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049467776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787826437.218932:0:201169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.218956:0:201169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb47f984a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826437.218993:0:201177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049467776 00000100:00100000:3.0:1787826437.218998:0:201177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049467776 00000100:00100000:3.0:1787826437.219028:0:201177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826437.219037:0:201177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb45eb77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201169:x1874663049467776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787826437.219059:0:201177:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787826437.219073:0:201177:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826437.222479:0:201177:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826437.222506:0:201177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787826437.222579:0:201178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787826437.222584:0:201178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787826437.222603:0:201178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.222620:0:201178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x878a5eea00cef26f expref: 11 pid: 201175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.222626:0:201178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.222664:0:201178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x878a5eea00cef26f expref: 11 pid: 201175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.222676:0:201178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x878a5eea00cef26f expref: 11 pid: 201175 timeout: 8604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826437.222693:0:201178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201178:1874663049467904:0@lo:104: 00000100:00100000:0.0:1787826437.222775:0:201178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.222799:0:201177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb45eb77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:201169:x1874663049467776:12345-0@lo:253:mount.lustre.0 Request processed in 3761us (3862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.222811:0:201177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826437.222832:0:201169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:205ad83e-e455-4070-92a2-f1e25b8f3f40:201169:1874663049467776:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787826437.222837:0:201178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb34240e780 going to sleep for 11 seconds 10000000:01000000:3.0:1787826437.222850:0:201169:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787826437.222855:0:201169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787826437.222858:0:201169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:0.0:1787826437.222868:0:9494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049467904 00000100:00100000:0.0:1787826437.222875:0:9494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049467904 00000100:00100000:0.0:1787826437.222920:0:9494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4781 00000100:00100000:0.0:1787826437.222931:0:9494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb46a213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:201178:x1874663049467904:12345-0@lo:104: 00000020:01000004:3.0:1787826437.222934:0:201169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787826437.222939:0:201169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787826437.222940:0:201169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:0.0:1787826437.222943:0:9494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787826437.222950:0:201169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787826437.222953:0:201169:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787826437.222955:0:201169:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787826437.222957:0:201169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787826437.222959:0:201169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787826437.222977:0:201169:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787826437.223001:0:9494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826437.223008:0:9494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb46a213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:205ad83e-e455-4070-92a2-f1e25b8f3f40+3:201178:x1874663049467904:12345-0@lo:104: Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.223015:0:9494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4781 00000100:00100000:1.0:1787826437.223015:0:201178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb472977480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201178:1874663049467904:0@lo:104: 00010000:00010000:1.0:1787826437.223036:0:201178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223055:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826437.223061:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223075:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34bf38200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1787826437.223079:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223088:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826437.223148:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826437.223159:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826437.223202:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223210:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826437.223234:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223239:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff8eb34bf38200/0x878a5eea00cef26f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x878a5eea00cef276 expref: -99 pid: 201169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826437.223244:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049468032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826437.223259:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826437.223263:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826437.223265:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826437.223289:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826437.223319:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049468032 00000100:00100000:0.0:1787826437.223341:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049468032 00010000:00010000:0.0:1787826437.223356:0:8420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cef26f expref: 11 pid: 201175 timeout: 8604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826437.223376:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12238 00000100:00100000:0.0:1787826437.223382:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+11:3619:x1874663049468032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826437.223403:0:8420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826437.223409:0:8420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x878a5eea00cef26f expref: 11 pid: 201175 timeout: 8604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223420:0:8420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x878a5eea00cef26f expref: 11 pid: 201175 timeout: 8604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223434:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34bf39000/0x878a5eea00cef276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x878a5eea00cef26f expref: 11 pid: 201175 timeout: 8604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223448:0:8420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223455:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787826437.223465:0:8420:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000881655s 00010000:00010000:0.0:1787826437.223468:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223473:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223477:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223481:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223484:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eb34a568000 already unused, calling callback (ffffffffc0e34230) 00010000:00010000:0.0:1787826437.223487:0:8420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223494:0:8420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223633:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826437.223633:0:201178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826437.223655:0:201178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826437.223657:0:8420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826437.223665:0:201178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eb34a568000/0x878a5eea00cef2a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826437.223707:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:205ad83e-e455-4070-92a2-f1e25b8f3f40+10:3619:x1874663049468032:12345-0@lo:103:ldlm_bl.0 Request processed in 325us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826437.223716:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12238 00000100:00100000:1.0:1787826437.223724:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:205ad83e-e455-4070-92a2-f1e25b8f3f40:3619:1874663049468032:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787826437.229525:0:201169:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 330712484068 00000040:01000000:0.0:1787826437.229953:0:201169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787826437.230107:0:201200:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 330712484068 00000020:00080000:3.0:1787826437.230111:0:201200:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 330712484068 00000040:01000000:2.0:1787826437.230231:0:201201:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787826437.230255:0:201169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1787826437.230956:0:201202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201202:1874663049468160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826437.231022:0:201202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.231085:0:201202:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344f5f240 going to sleep for 11 seconds 00000040:01000000:0.0:1787826437.231416:0:201169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787826437.231448:0:201169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787826437.231751:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049468160 00000100:00100000:1.0:1787826437.231759:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049468160 00000100:00100000:1.0:1787826437.231822:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787826437.231832:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201202:x1874663049468160:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:1.0:1787826437.231874:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481afad80 x1874663049468160/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:38/0 lens 304/4320 e 0 to 0 dl 1787826448 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826437.231931:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201202:x1874663049468160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826437.231938:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787826437.231979:0:201202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481af9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201202:1874663049468160:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787826437.232005:0:201202:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787826437.232046:0:201202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201202:1874663049468288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826437.232073:0:201202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826437.232095:0:201202:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de9c0 going to sleep for 11 seconds 00000004:00000080:0.0:1787826437.232105:0:201169:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787826437.232114:0:201169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:2.0:1787826437.232135:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049468288 00000100:00100000:2.0:1787826437.232141:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049468288 00000100:00100000:2.0:1787826437.232197:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787826437.232207:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201202:x1874663049468288:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787826437.232216:0:201169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00000080:2.0:1787826437.232304:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34df15f80 x1874663049468288/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:38/0 lens 336/4320 e 0 to 0 dl 1787826448 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826437.232353:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201202:x1874663049468288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 148us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.232361:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787826437.232630:0:201202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201202:1874663049468288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826437.232682:0:201202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb34df17480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201202:1874663049468416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826437.232704:0:201202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826437.232725:0:201202:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb44f6de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.232738:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049468416 00000100:00100000:2.0:1787826437.232743:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049468416 00000100:00100000:2.0:1787826437.232778:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826437.232786:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb34df15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201202:x1874663049468416:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:2.0:1787826437.232809:0:187910:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb34df15c00 x1874663049468416/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:38/0 lens 304/4320 e 0 to 0 dl 1787826448 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826437.232851:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb34df15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201202:x1874663049468416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.232857:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787826437.233175:0:201202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb34df17480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201202:1874663049468416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826437.233245:0:201202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201202:1874663049468544:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826437.233301:0:201202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.233345:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049468544 00000100:00100000:2.0:1787826437.233349:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049468544 00000100:00100000:3.0:1787826437.233353:0:201202:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eb344f5f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826437.233454:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787826437.233461:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201202:x1874663049468544:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787826437.233949:0:201169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787826437.235262:0:201169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787826437.235308:0:201169:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787826437.235464:0:201169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00000080:2.0:1787826437.235864:0:187909:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb481af8e00 x1874663049468544/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:38/0 lens 336/33016 e 0 to 0 dl 1787826448 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826437.235919:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201202:x1874663049468544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2458us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.235928:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787826437.235949:0:201202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201202:1874663049468544:0@lo:1000:lod0000_rec0001.0 00080000:10000000:0.0:1787826437.236476:0:201169:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x86:0x0] (8/32) registered 00010000:00080000:0.0:1787826437.238066:0:201169:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 352187318285 00010000:00080000:2.0:1787826437.238698:0:201203:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 201203 00010000:02000000:2.0:1787826437.238798:0:201203:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1787826437.238802:0:201203:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1787826437.238806:0:201203:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1787826437.238986:0:201169:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787826437.239000:0:201169:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787826437.239017:0:201169:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787826437.239030:0:201169:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000040:00080000:1.0:1787826437.240016:0:201201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787826437.240082:0:201201:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00000004:1.0:1787826437.241026:0:201169:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787826437.241384:0:201169:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1787826437.243722:0:201202:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787826437.243804:0:201202:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787826437.243810:0:201202:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:3.0:1787826437.244393:0:201203:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1787826437.460722:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb348aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049468672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826437.460801:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826437.460836:0:154572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049468672 00000100:00100000:2.0:1787826437.460845:0:154572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049468672 00000100:00100000:2.0:1787826437.460905:0:154572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5956 00000100:00100000:2.0:1787826437.460916:0:154572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049468672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826437.460939:0:154572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142144 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1787826437.461004:0:154572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1874663049468672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826437.461012:0:154572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5956 00000100:00100000:0.0:1787826437.461163:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb348aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1874663049468672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826437.461452:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826437.461462:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8eb481afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049468800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826437.461493:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826437.461594:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663049468800 00000100:00100000:3.0:1787826437.461603:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663049468800 00000100:00100000:3.0:1787826437.461629:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5957 00000100:00100000:3.0:1787826437.461636:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049468800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826437.461648:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1787826437.461695:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874663049468800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826437.461702:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5957 00000100:00100000:2.0:1787826437.461783:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8eb481afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1874663049468800:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787826437.973463:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826438.842694:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826438.842742:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1787826438.842759:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043072000 00000100:00100000:1.0:1787826438.842771:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043072000 00000100:00100000:0.0:1787826438.842796:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1787826438.842834:0:201175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043071744 00000100:00100000:0.0:1787826438.842845:0:188682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043071872 00000100:00100000:2.0:1787826438.842850:0:201175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043071744 00000100:00100000:0.0:1787826438.842853:0:188682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043071872 00000100:00100000:1.0:1787826438.842856:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 502 00000100:00100000:1.0:1787826438.842869:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663043072000:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1787826438.842894:0:188682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1307 00010000:00000080:1.0:1787826438.842900:0:187905:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8eb348aeb800 x1874663043072000/t0(0) o400->c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp:39/0 lens 224/224 e 0 to 0 dl 1787826449 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826438.842906:0:188682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb348ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1874663043071872:12345-192.168.203.47@tcp:38:kworker.0 00000100:00100000:2.0:1787826438.842919:0:201175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:2.0:1787826438.842935:0:201175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb477444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2388:x1874663043071744:12345-192.168.203.47@tcp:250:kworker.0 00010000:00080000:0.0:1787826438.842942:0:188682:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'c0d7758a-4501-4a89-8ec1-407fef4f0c7f' at ffff8eb481332800, cookie 0x878a5eea00cef1f8 00010000:00080000:0.0:1787826438.842953:0:188682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c0d7758a-4501-4a89-8ec1-407fef4f0c7f@192.168.203.47@tcp recovering/t352187318286 exp ffff8eb481332800 cur 8505 last 1787826437 00010000:02000400:0.0:1787826438.842962:0:188682:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1787826438.842968:0:201175:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f40147eb-9b53-47d4-b77c-99ceedd9664c@192.168.203.47@tcp t0 exp 0000000000000000 cur 8505 last 0 00010000:00080000:0.0:1787826438.842971:0:188682:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 85 seconds 00000100:00100000:1.0:1787826438.842985:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2389:x1874663043072000:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 116us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826438.842995:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 502 00000004:00100000:0.0:1787826438.842997:0:188682:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787826438.843021:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1787826438.843028:0:201175:0:(genops.c:1385:class_connect()) connect: client f40147eb-9b53-47d4-b77c-99ceedd9664c, cookie 0x878a5eea00cef2ae 00000100:00080000:0.0:1787826438.843266:0:188682:0:(import.c:65:import_set_state_nolock()) ffff8eb443ea6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826438.843349:0:188682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb348ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043071872:12345-192.168.203.47@tcp:38:kworker.0 Request processed in 420us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826438.843357:0:188682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1307 00000100:00080000:2.0:1787826438.843616:0:201175:0:(import.c:65:import_set_state_nolock()) ffff8eb477f6b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787826438.843689:0:201175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb477444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f40147eb-9b53-47d4-b77c-99ceedd9664c+5:2388:x1874663043071744:12345-192.168.203.47@tcp:250:kworker.0 Request processed in 755us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826438.843699:0:201175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:2.0:1787826438.848216:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1787826438.848321:0:187906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874663043029632 00000100:00100000:0.0:1787826438.848531:0:187906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874663043029632 00000100:00100000:0.0:1787826438.848589:0:187906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1308 00000100:00100000:0.0:1787826438.848654:0:187906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8eb481af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043029632:12345-192.168.203.47@tcp:36:mcreate.0 00010000:00080000:0.0:1787826438.848673:0:187906:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 352187318286, current: 352187318286, replaying 00000100:00100000:0.0:1787826438.848738:0:187906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8eb481af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0d7758a-4501-4a89-8ec1-407fef4f0c7f+6:2388:x1874663043029632:12345-192.168.203.47@tcp:36:mcreate.0 Request processed in 87us (532us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826438.848745:0:187906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1308 00010000:00080000:2.0:1787826438.848784:0:201203:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1787826438.996566:0:66923:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 73232 lines, 73232 kept, 0 dropped, 0 bad.